17 replies to this topic

[MIDA]

Yes, I meant /catalog/cart.php... and anything to the right of that. I don't know how to write to robots ;-) but it seems that I don't need a wild card like /catalog/cart.php* ?

I have one other page that needs to be excluded and that's /catalog/index.php I guess I can just list that outright?

So, in my robots.txt file I list:

User-agent: *
Disallow: /catalog/cart.php
Disallow: /catalog/index.php

?
Such a cooky way to set this up, next time I'll separate the folders! Just to make sure, the above scenario would keep ...com/index.php as index-able?

Thanks!
MIDA

[Randy]

That should do the trick MIDA.

FWIW, wildcard characters aren't part of the robots.txt standard. There was some talk a few years ago about updating the accepted standard to allow for wildcard characters, but it never gained much steam.

That said, Googlebot specifically does allow you to use * as a wildcard character and will obey it. Last time I checked (ages ago) no other spider seemed to be allowing wildcards though.

[MIDA]

Thanks!