I noticed this crawler on one of my client sites today and wondered why? It is a genuine IBM crawler (apparently) at the risk of sounding like a horses back end can anyone tell my why it exists?
The website in question provides credit status reports on UK Companies to other companies throughout the world.
Subscribe to HRA Now!
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!
www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Sponsored Content
Www.almaden.ibm.com/cs/crawler
Started by
OldWelshGuy
, Nov 26 2003 12:32 PM
6 replies to this topic
#1
OldWelshGuy
-
- Moderator
-
- 4,713 posts
Work is Fun
- Location:Neath, South Wales, UK
Posted 26 November 2003 - 12:32 PM
#2
SEOCub
-
- Active Members
-
- 122 posts
HR 4
- Location:LSD, Chicago
#3
OldWelshGuy
-
- Moderator
-
- 4,713 posts
Work is Fun
- Location:Neath, South Wales, UK
Posted 26 November 2003 - 12:53 PM
That'l teach me not to be lazy lol
I did google it, but then i got the spider thingy page, and thought well lets ask.
Cheers Cub
I did google it, but then i got the spider thingy page, and thought well lets ask.
Cheers Cub
#4
SEOCub
-
- Active Members
-
- 122 posts
HR 4
- Location:LSD, Chicago
Posted 26 November 2003 - 01:06 PM
All good spiders leave a URL which you can use to look them up for an explanation of their activities. The IBM almaden spider leaves this URL: http://www.almaden.ibm.com/cs/crawler/
The third para on that page is:
Just like Googlebot leaves this URL: http://www.googlebot.com/bot.html
All this if it is a good spider...
FWIW, I've seen the IBM botin my logs often enough.
The third para on that page is:
For more information please refer to http://www.almaden.ibm.com/WebFountain
Just like Googlebot leaves this URL: http://www.googlebot.com/bot.html
All this if it is a good spider...
FWIW, I've seen the IBM botin my logs often enough.
#5
Googlewhacked
-
- Active Members
-
- 348 posts
Got geek?
- Location:Florida: The Plywood State
Posted 26 November 2003 - 03:58 PM
At first glance, this posting, while seeming a little off the wall (not OWG's post, but the fact that IBM created a crawler), now strikes me as making a good bit of sense.
Considering the vast amount of personal & business information available on the web, would business' / organizations benefit from having this kind of technology available for themselves? I know that there are @ least a few books (1, 2) available on the subject of crawlers, is the concept of having a "corporate crawler" very far fetched?
"Pinky, are you pondering what I'm pondering...?"
Considering the vast amount of personal & business information available on the web, would business' / organizations benefit from having this kind of technology available for themselves? I know that there are @ least a few books (1, 2) available on the subject of crawlers, is the concept of having a "corporate crawler" very far fetched?
"Pinky, are you pondering what I'm pondering...?"
#6
torka
-
- Moderator
-
- 4,392 posts
Vintage Babe
- Location:Triangle area, NC, USA, Earth (usually)
Posted 26 November 2003 - 11:07 PM
I think so, Brain, but how are we going to get the monkeys into the barrel to begin with?"Pinky, are you pondering what I'm pondering...?"
--Torka
#7
MakeMeTop
-
- Active Members
-
- 345 posts
HR 5
- Location:Northern Ireland
Posted 27 November 2003 - 12:46 AM
The Almaden spider is building a very comprehensive map of the web. IBM are doing something, and it may surprise us all. One to watch!
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users
