robots文件

yoki343

【如内容违法或虚假，请联系上述邮件删除】拿去用

User-agent: Baiduspider
Allow: /$
Disallow: /*

User-agent: Baiduspider-image
Allow: /$
Disallow: /*

User-agent: Baiduspider-news
Allow: /$
Disallow: /*

User-agent: Googlebot
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: MSNBot
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: YoudaoBot
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: Sogou web spider
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: Sogou inst spider
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: Sogou spider2
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: Sogou blog
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: Sogou News Spider
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: Sogou Orion spider
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: ChinasoSpider
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: Sosospider
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: yisouspider
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: EasouSpider
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*

User-agent: 360Spider
Disallow: /user/
Disallow: /group/
Disallow: /?*
Disallow: /*?*


User-Agent: *
Disallow: /
复制代码(关注老榕树网络旗下“网络思维”微信公众号:wlsw360 (每天都有好文章)

 

                                                   本帖如有虚假或违法，请联系邮箱删除，本社区删贴不收任何费用，欢迎举报。老榕树社区属老榕树网络旗下网站，旨在为老榕树用户提供创业咨询、网站建设技术交流、源码下载、提供各种实用工具。如有部分帖子涉及违法、虚假，请你第一时间与社区联系，把需要删除的社区链接提供给我们，我们核实之后，第一时间删除。邮箱：125175998@qq.com