Are you a Google Analytics enthusiast?
More SEO Content
How Deep Will They Crawl Into Dynamic Content
Posted 12 January 2004 - 09:00 PM
Posted 12 January 2004 - 11:15 PM
Take the PR of your Homepage:
PR4 sites get about 15,000-22,000
PR5 sites get about 22,000-30,000
PR6 sites get about 30,000-38,000
Give or take.
I posted some numbers like this in another thread and I'm sure they don't match these exactly, but the range is pretty close to right. The higher the "base" PR, the higher the overall average PR of the site (assuming you have good and logical linking structure). The higher this overall average PR, the deeper you get crawled.
Other search engines seem to go by the same type of guide (though the numbers vary) to determine how deep to crawl. The trick, then, if you have lots of pages, is to make good use of your robots.txt file and determine which sections to NOT let the spiders into so that you can maximize the effectiveness of what IS in there.
Posted 13 January 2004 - 12:10 AM
And based on that, it wouldn't matter how deep, like if you had to click through ten pages to get to the content, that wouldn't matter?
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users