2 replies to this topic

[cedano]

I have a Blog with the Following robots.txt

CODE

Sitemap: http://www.xxx.es/sitemap.xml

User-agent: *
Disallow: /wp-
Disallow: /search
Disallow: /feed
Disallow: /comments/feed
Disallow: /feed/$
Disallow: /*/feed/$
Disallow: /*/feed/rss/$
Disallow: /*/trackback/$
Disallow: /*/*/feed/$
Disallow: /*/*/feed/rss/$
Disallow: /*/*/trackback/$
Disallow: /*/*/*/feed/$
Disallow: /*/*/*/feed/rss/$
Disallow: /*/*/*/trackback/$
Disallow: /?s=
Disallow: /dogs
Disallow: /archives
Disallow: /page
Disallow: /author
Disallow: /2007
Disallow: /category
Disallow: /2008
Disallow: /2009
Disallow: /?livehit=

My blog is updated 2 times at day, but post only get good ranking if are one homepage, but when they desapear from homepage the rankings and traffic get dissapear.

Ex: one post give me 900 visits in one day just by SEPR but when the post get out from home page the post only give me 1 or 2 visits a day...

[chrishirst]

Well it appears that posts that are not on the "homepage" are not going to be crawled, because the only place they will be linked from on your site pages are blocked, is it really surprising?

[cedano]

Well it appears that posts that are not on the "homepage" are not going to be crawled, because the only place they will be linked from on your site pages are blocked, is it really surprising?

ummm so what i have to change ? (please remember that i don´t want to have duplicated content), also I have the same robots.txt in other two blogs and rank really well.

Edited by cedano, 17 September 2007 - 10:50 AM.