Are you a Google Analytics enthusiast?
More SEO Content
Why Would You Disallow The Cache?
Posted 27 August 2010 - 10:40 AM
I just had a developer email me what he thinks should be in the robots txt. Its an ecommerce site its built in interspire, they have a license.
I don't understand why you would disallow the cache. I thought google worked from the cache and then just spidered whatever was new? Maybe I am mixing up cache's...Maybe its google working from their own cache...I know you want to disallow the cart, etc.
Is it an attempt to manage server load? I went on interspire's forum and found this configuration as a suggestion:
Thanks in advance. DJKay
Posted 27 August 2010 - 11:00 AM
I'm not familiar with Interspire, but it's clear that you are mixing up caches. Without looking at Interspire in detail, "Disallow: /cache/" sounds like a perfectly sensible thing to be doing to prevent duplicate content and freshness issues.
Posted 27 August 2010 - 11:51 AM
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users