Are you a Google Analytics enthusiast?
More SEO Content
Robots.txt Was Ignored
Posted 09 June 2009 - 02:32 PM
I successfully removed the directory manually through webmaster tools and that seems to have cleared the unwanted pages from the index, the only thing I can't figure out is why it all of a sudden ignored my robots.txt file.
I put a few more countermeasures in place to stop them like noindexing in the meta tag for the page and a rel="noindex" in the url to the page from other pages.
Wondering if anyony has experienced this and if you were able to determine the exact cause.
Posted 09 June 2009 - 03:02 PM
I'd run the robots.txt through one or more of the several checkers out there to see what they say. Since this was a Google specific problem I'd surely run it through the one available in the Webmaster Tools area of Google.
Posted 09 June 2009 - 07:31 PM
Google's safesearch mode will also show URL-only listings for some types of content.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users