Can anyone recommend a web log analyser (or equivalent) that lets you see what pages (and paths) googlebot and other spiders crawl over?
Funnel web is telling me that Spiders request an awful lot of pages on my site but it doesnt specifiy which ones.
thanks
Subscribe to HRA Now!
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!
www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Sponsored Content
Spider Tracking
Started by
domokun
, Feb 16 2004 12:32 PM
3 replies to this topic
#2
JohnHocking
-
- Members
-
- 13 posts
HR 2
- Location:Saint Louis, MO
Posted 16 February 2004 - 05:12 PM
You can download and install Robotstats for FREE.
I will track most of the robots and even generates charts for you
http://www.robotstats.com/en/ <- for english version
I will track most of the robots and even generates charts for you
http://www.robotstats.com/en/ <- for english version
#3
domokun
-
- Active Members
-
- 249 posts
Web jockey
Posted 17 February 2004 - 04:20 AM
thanks for the link but theres no way ill be able to transfer 'unknown' programs or code to the server.
is there anything which can run on web log files??
is there anything which can run on web log files??
#4
Vertster
-
- Active Members
-
- 327 posts
Google wristbar installed
- Location:Salt Lake City, Utah
Posted 17 February 2004 - 01:22 PM
I use and have recommended in past posts (SEARCH) a program called "Robots.Txt" which has both an analyzer and a Robots.txt editor.
You can get it at http://www.netpromoterlab.com although their site appears to be down at this moment.
You can get it at http://www.netpromoterlab.com although their site appears to be down at this moment.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users
