3 replies to this topic

[supaca]

I 've already spidered by Yahoo and recently made some changes. In which time, I should expect to be updated by Yahoo.



Alexander

[Randy]

It really depends upon how much interest Yahoo! Slurp has in your site Alexander.

I have some sites that get spidered by Slurp daily, and get updated on about the same schedule as Googlebot does, and I have other sites that are evidently less interesting that only get updated every 2-3 weeks.

So somewhere between a day and a month is the only answer I can give.

[The Great Gatzby]

Okay Randy,

I have a site that is hit by the Yahoo slurp daily. However the site is rarely spidered beyond the first page (Index). It is an e-commerce page that has about 3000 products that are dynamically served to the client. Google spiders the site as often and does a much better spider of the site. My PR is 6 and has been in the Google index for more than 2 years. We have very good rankings in Google.

However my main question is why is yahoo not deeply spidering the page as google is?

Gatzby

[Randy]

It's a good question Gatzby.

My sense is that the new Yahoo! doesn't handle "shopping cart" type sites quite as well as Google, but it could also simply be a matter that they're still in the process of expanding their reach with this type of site.

Not sure if this will help you any other than to let you know you're not alone, but I have a shopping cart type of site that I've been keeping and eye on and testing with. It has not only the normal 2 modifier standard shopping cart URL's, but also has mod_rewrite links set up from some site map pages to get the deeper content spidered.

Google shows 1,200 pages spidered. Yahoo has a total of 90. Google has gotten some of the & = dynamic pages indexed, while Yahoo! has only indexed some of the /modifier/modifier mod_rewrite type of URL's indexed. Y! has none of the dynamic pages in their index.

I'm still testing with this site, but if I hit on anything that Y! seems to like a lot I'll definitely follow up. At the moment I'm just giving Yahoo! some time to see if they'll continue grabbing more of the mod_rewrite pages or not.