blogspot的 robots.txt: 毕竟是 google 的

有 blogspot 的,有兴趣可以看看域名下面的robots.txt。
我看见的是这个情况:
—————- BEGIN robots.txt ————-
User-agent: Mediapartners-Google
Disallow:User-agent: *
Disallow: /search
Noindex: /feedReaderJson
Disallow: /
—————- END robots.txt —————
恩…… Mediapartners-Google…….

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.