January 3, 2007
I donít understand how search engines list dynamic sites. For example, this site has a whole bunch of products. Every single product page calls up the same url: www.example.com/products.php.
Will every single page be crawled and eventually listed?
Each individual page has a unique <title> tag.
Thanks for all your help over the years, Jill.
If every product page is the same URL, then no, thatís not a crawler-friendly design, and the engines wonít be able to crawl and index the site correctly. However, if there are additional query strings appended to the end of that URL, e.g., www.example.com/products.php?product=blackhat, then there shouldnít be any problem with those URLs being indexed by the search engines.
Dynamic sites can definitely be crawled and indexed if created with the search engines in mind. Make sure that every page has a unique URL and that every page has a way to click to it via the navigation of your site rather than a search box or pulldown menus.
Those are the basic things you need to think about, but there are additional ones. You may want to visit the Dynamically Generated Site Issues section of the forum for more info.