4 replies to this topic

[Googlefrog]

I am using multiple CMS's on each system out of the box it isn't good particularly for SEO, as Google keeps flagging my site as having duplicate content issues in GWT. The main problem goes something like this:

game.php?id=1234
12345/game.html

This is repeated about 500 times.

also same happens with page.php and a category URL and when having multiple pages for one category e.g. Sport games page 10 would show the same title as Sport games page 1,2,3,4,5 etc.

How do you solve this, Google doesn't index all these URLs as it seems to be able to decipher what is the connocalized url, but I think it is tripping some filters as my site bounces from page 2 to 90 and back every couple of days.

[Randy]

1. Decide which url address of each page you want to be considered the Live version.

2. Make sure all links within your site only points to this url address.

3. Exclude all other versions via robots.txt.

[Googlefrog]

Thanks so Syntax would be?

Disallow: /*.page.php
Disallow: /* game.php

[Randy]

You want to exclude the more dynamic looking urls I take it?

I'm not sure why you're using a wildcard character in there.

If the urls you want to exclude were like www.yourdomain.com/page.php?id=12345 or www.yourdomain.com/page.php?var=something and also like www.yourdomain.com/game.php?id=54321 or www.yourdomain.com/game.php?see=spotrun you could do it like:

CODE

Disallow: /page.php
Disallow: /game.php

The trick to remember is there is an implied wildcard at the end of each line if you don't tell the spider otherwise. So as long as you have the path and filename right, it wouldn't matter what variables followed. They'd all be excluded.

[Googlefrog]

Yes I'd like to filter out those dynamic urls as this is what Google thinks is duplicate content. I already use mod write.