Are you a Google Analytics enthusiast?
More SEO Content
Which Comes First?
Posted 07 August 2006 - 08:43 PM
If we set a robots file to disallow indexing of everything and also set up mod_rewrite to redirect everything, which one is the robot going to do.
not index the content?
redirect to the other page?
Posted 07 August 2006 - 09:08 PM
But I've seen stranger things happen, especially if the spiders already know the pages exist. So I wouldn't necessarily count on them never seeing the redirect.
Posted 07 August 2006 - 09:37 PM
I found this page:
Posted 07 August 2006 - 10:03 PM
As far as the NOODP Meta tag, we have a thread about that around here somewhere. It's probably in Industry News. If memory serves, I believe MSN introduced it and Google jumped on board. I don't recall reading that Yahoo is also honoring it as yet.
<edit to add>
Here's the thread I was thinking about. Still no mention of Yahoo! implementing such a tag, but they would be sort of shooting themselves in the foot if they did since their sometimes wacky descriptions come from their own directory.
Edited by Randy, 07 August 2006 - 10:11 PM.
Posted 08 August 2006 - 09:43 PM
folder does not exist, in fact the above is being redirected to something like...
So am I able to put an entry in to stop robots from indexing /folder/ whne in fact /folder/ does not physically exist?
Posted 09 August 2006 - 01:45 AM
Sure, but that won't stop them from indexing the ultimate URL destination.
Posted 10 August 2006 - 06:09 PM
All the bots will see is the URL...
So I would guess they would still index the page. In which case I would actually have to block both URLs in the robots.txt to make sure?
Also, can you put in entries with GET variables? Like...
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users