5 replies to this topic

[clubmilwaukee]

As I anxiously wait to be indexed by Google, I'm wondering about the comments I see here where people say "Today I saw that the googlebots visited my site"

How do you tell this? Is there an IP range I need to be looking for in my logs?

Also, I keep getting hammered by something from aol. There's a bunch of IPs that are all 64.12.116.x and they visit in droves at about 10pm every day. Any idea what that might be?

Thanks in advance

[sweepthelegnate]

this just might help you answer the question:

Spider IPs


Nathan

[qwerty]

If you're looking at raw log files, you don't need to search for a range of IP addresses. I use various applications for analyzing the logs, but the easiest way I've found for counting visits by a particular bot is just to open the log in Notepad and search for its name: googlebot, slurp, teoma, whatever.

[clubmilwaukee]

Thanks guys, I appreciate the help.

Qwerty, my log files don't show that info. I just get a date, an IP, and the page they landed on.

[qwerty]

Ouch. You don't even get the server response (200, 404, 301, etc) or the URL from which they were referred? That's not very useful.

[clubmilwaukee]

I get that info through the admin panel, but my raw log files don't record that, no.

But, on the upside, my host is reasonably priced, near where I live (so I can holler in person if necessary), fast, and I get 1.5GB of disk and 50GB of transfer. So, it's a bit of a trade off.