robots.txt 书写规范

1. User-agent: *
2. Disallow: /*?*
3. Sitemap: https://www.xxx.com/sitemap.xml
4. Sitemap: https://www.xxx.com/tagid.xml
5. 其中第3行是站点地图文件，要将站点所有的全路径都包含进去
6. 

1. xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:mobile="http://www.baidu.com/schemas/sitemap-mobile/1/">
3. https://www.ky365.com.cn/article/shuifazhishiku/ix48141.html
4. 2022-12-03
5. always
6. 1.0