Are you a Google Analytics enthusiast?
More SEO Content
Better Pr, More Frequently The Crawl?
Posted 01 December 2005 - 09:17 PM
Posted 01 December 2005 - 09:57 PM
But the question is why you want to be crawled more. You want your changes to be picked up quickly, but if you're making changes in order to get crawled, that doesn't make a lot of sense. Getting crawled more doesn't help rankings.
Posted 01 December 2005 - 10:17 PM
Posted 01 December 2005 - 11:11 PM
I'm not personally bothered about how frequently my site gets crawled. The only reason I ask about this is because I was having a little debate with a friend over SEO and he mentioned that getting a site linking to you which has a good PR will get your site crawled more frequently. I was a bit suprised as I thought it only depended on how much you updated you content.
Posted 02 December 2005 - 08:35 AM
Search engines follow links. High PR sites have a lot of links pointing to them (since PR is simply a measure of links) so the crawlers get directed to that high PR site from links in a lot of other sites. As they crawl that high PR site, they follow the links on it, so having a link on that site may get your site crawled more often.
Not that it matters, unless you change your content frequently.
Posted 02 December 2005 - 08:48 AM
I have a site with top 10 rankings for several phrases (for some the number 1 spot for months) since there is not much competition. That site currently only has got 51 links pointing to it according to Google. The entrance page has got a PR of 4. As Scottie mentioned, the PR is just used for measurement.
Site useability should should not be sacrificed for PR.
Posted 02 December 2005 - 08:53 AM
I find that even sites that aren't updated often still get spidered often if they are popular sites.
Posted 02 December 2005 - 11:01 AM
Yea, there is evidence that Google more frequently crawls pages that change often, obviously so their SERPs can stay current with current content. There's no evidence to suggest this affects the depth of the crawl.
I personally feel it's fairly clear that the depth of the crawl is influenced by the importance (PR) of the pages. Google clearly isn't going to ignore a PR10 page just because it's buried four or five levels deep in a large site. Okay, so what about a PR9 or PR8? At what point a page becomes too important to ignore is anyone's best guess, but my experience indicates a PR4 at the bottom of your site hierarchy pretty much guarantees Google with take everything you have to offer. Those page, I believe, are simply too important to be ignored.
The depth of a crawl can affect frequency on even moderately large sites, simply because by the time Googlebot has finished the deep crawl, it's almost time to start at the top of the site again. I know of many sites where the spider visits every single day, but that doesn't necessarily mean it looks at every single page every day.
Posted 02 December 2005 - 11:28 AM
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users