How deep will google or others crawl into dynamic content? Lets say with a single parameter or 2 tops.
Subscribe to HRA Now!
SEO Class in Chicago, IL
Learn How To Optimize Your Website on July 26, 2013
Looking for personalized in-depth SEO training among your peers?
High Rankings is offering a 1-day customized SEO training class in Chicago. Class size is limited so please sign-up now if you want in!
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!
www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
How Deep Will They Crawl Into Dynamic Content
Started by
prophecy
, Jan 12 2004 09:00 PM
2 replies to this topic
#2
Grumpus
-
- Active Members
-
- 786 posts
HR 6
Posted 12 January 2004 - 11:15 PM
The same as in a static site. There's no hard and fast rule and it all depends upon timing and other things, but...
Take the PR of your Homepage:
PR4 sites get about 15,000-22,000
PR5 sites get about 22,000-30,000
PR6 sites get about 30,000-38,000
Give or take.
I posted some numbers like this in another thread and I'm sure they don't match these exactly, but the range is pretty close to right. The higher the "base" PR, the higher the overall average PR of the site (assuming you have good and logical linking structure). The higher this overall average PR, the deeper you get crawled.
Other search engines seem to go by the same type of guide (though the numbers vary) to determine how deep to crawl. The trick, then, if you have lots of pages, is to make good use of your robots.txt file and determine which sections to NOT let the spiders into so that you can maximize the effectiveness of what IS in there.
G.
Take the PR of your Homepage:
PR4 sites get about 15,000-22,000
PR5 sites get about 22,000-30,000
PR6 sites get about 30,000-38,000
Give or take.
I posted some numbers like this in another thread and I'm sure they don't match these exactly, but the range is pretty close to right. The higher the "base" PR, the higher the overall average PR of the site (assuming you have good and logical linking structure). The higher this overall average PR, the deeper you get crawled.
Other search engines seem to go by the same type of guide (though the numbers vary) to determine how deep to crawl. The trick, then, if you have lots of pages, is to make good use of your robots.txt file and determine which sections to NOT let the spiders into so that you can maximize the effectiveness of what IS in there.
G.
#3
prophecy
-
- Active Members
-
- 86 posts
HR 3
Posted 13 January 2004 - 12:10 AM
That's interesting, I assume those numbers are how many pages crawled? Where did you get these numbers from?
And based on that, it wouldn't matter how deep, like if you had to click through ten pages to get to the content, that wouldn't matter?
And based on that, it wouldn't matter how deep, like if you had to click through ten pages to get to the content, that wouldn't matter?
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users
