I understand the basic tagging and on page SEO keyword related material.
I am looking for something more in the way the code is constructed or possible commands that can be given from the server or from more advanced programming so that pages can be crawled the best.
Any links, references, guidelines, articles, and subjects on what I am looking for would be very helpful and very much appreciated.
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!

www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Advanced Crawler Optimization Methods
Started by
rsq1725
, Jan 24 2012 01:48 PM
4 replies to this topic
#1
Posted 24 January 2012 - 01:48 PM
#2
Posted 24 January 2012 - 06:36 PM
I understand the basic tagging and on page SEO keyword related material.
I am looking for something more in the way the code is constructed or possible commands that can be given from the server or from more advanced programming so that pages can be crawled the best.
Any links, references, guidelines, articles, and subjects on what I am looking for would be very helpful and very much appreciated.
I am looking for something more in the way the code is constructed or possible commands that can be given from the server or from more advanced programming so that pages can be crawled the best.
Any links, references, guidelines, articles, and subjects on what I am looking for would be very helpful and very much appreciated.
Implement "304 If_Modified-Since" HTTP headers.
#3
Posted 25 January 2012 - 05:47 AM
Put as few links on each page as possible. Many people screw up their crawl by creating site navigation that includes hundreds of links per page. It's better to leverage an HTML sitemap for crawling and let important pages feature/promote/highlight/draw attention to the latest or more important leaf nodes.
#4
Posted 25 January 2012 - 09:06 AM
Make sure that any piece of content can only be accessed by one URL.
#5
Posted 28 April 2012 - 08:05 AM
Use some cache plugin. It implements usually "304 Page Not Modified" HTTP status and takes care about "If-Modified-Since" HTTP headers. Your page load speed will fall. HTML code (without images) must be loaded under 500 ms.
Change your design to reduce size of images, scripts and css. Your whole page should be loaded under 2 seconds. Use Ctrl+F5 (Force reload) to test it.
Use Google Webmaster Tools and search for any 404 Page not found HTTP status.
Install Google "Page Speed" and achieve at least 95 / 100 points. There is great help in Google Page Speed.
Change your design to reduce size of images, scripts and css. Your whole page should be loaded under 2 seconds. Use Ctrl+F5 (Force reload) to test it.
Use Google Webmaster Tools and search for any 404 Page not found HTTP status.
Install Google "Page Speed" and achieve at least 95 / 100 points. There is great help in Google Page Speed.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users








