Are you a Google Analytics enthusiast?
More SEO Content
301 Redirect In .htaccess & Robots.txt File
Posted 10 September 2004 - 01:49 PM
Here's why I'm asking. I have several domains that were basically duplicate content and were all heavily cross-linked. Since joining this forum I've seen the light and realized that I was indeed making a big mistake.
So, I've used a 301 redirect in the .htacess file. Since putting up the 301 redirect, I've been advised to use the robots.txt file to tell Yahoo spider to not index those domains. Chris H with PositionTech told me that Y! does not follow 301 redirects, therefore I need to tell Y! to not spider those domains.
My question is can I leave the 301 redirect and add the robots.txt file or will one over-ride the other?
Posted 10 September 2004 - 02:32 PM
Posted 10 September 2004 - 03:30 PM
You and everyone else here who contributes so generously to this forum really rock!!
Posted 11 September 2004 - 07:22 AM
I was told some months ago by a Yahoo! rep that there are some 301s they don't handle well. No details, and I've honestly not researched enough to sort out which redirects they follow well and which they don't, however I would tend to believe that blanket statement.
I've seen times when Yahoo! follows the 301 just fine. And others where you couldn't get Slurp to the redirect even if you zapped it with a cattle prod. The same Yahoo! rep did tell me that they are aware of the problem, as well as what is causing it to happen on their end, and are working on a solution.
I would still do both though.
Posted 11 September 2004 - 09:17 AM
I don't have a lot of samples though to know for sure.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users