Are you a Google Analytics enthusiast?
More SEO Content
Yahoo Sitematch And Non-yahoo Search Engines
Posted 24 February 2005 - 04:52 PM
For ex say my normal url is: mydomain.com?product=1234
So I submit this page to Yahoo Sitematch as: mydomain.com?product=1234&ref=sitematch
Could that 2nd url ever be found by another engine thus cause duplicate content issues? (Assuming our site never links to this page internally nor do any other sites)
Posted 24 February 2005 - 05:10 PM
Posted 24 February 2005 - 05:19 PM
Posted 24 February 2005 - 06:55 PM
You should be able to list the exact URLs you've given to Yahoo and exclude them from the appropriate engines.
Posted 25 February 2005 - 10:39 AM
Three ways to avoid duplicate content...
You can handle this using robots.txt as follows:
1) Instead of using mydomain.com/?product=1234&ref=sitematch, use mydomain.com/?ref=sitematch&product=1234
2) Then exclude ?ref= using robots.txt:
The great thing about robots.txt is that it stops lots of pages being served to robots when those pages will never be indexed. However, it's not perfect as in theory people can still link to mydomain.com/?product=1234&ref=sitematch
Alternatively, if the content is delivered dynamically, put a meta robots noindex tag in the header if the URL contains a ref query parameter:
<META NAME="ROBOTS" CONTENT="NOINDEX">
This way, the content may be requested lots of times by robots, but it will never be indexed. Use the first two solutions together for maximum benefit.
Alternatively, make mydomain.com/?product=1234&ref=sitematch a 301 redirect to mydomain.com/?product=1234 (after having set a cookie or whatever to store the referrer). This is probably the best approach but may require the most work, too.
Posted 25 February 2005 - 10:47 AM
I dont see how you would lose out even if it was classed as duplicate content? If it is the same page it is the same page.
Posted 25 February 2005 - 04:51 PM
Paz, even though they really are the same page. To a search engine they look like 2 different pages.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users