High Rankings Search Engine Optimization ForumHigh Rankings Advisor Search Marketing Newsletter

Welcome Guest ( Log In | Register )

Important Announcement: ***Need an Affordable SEO Website Review?***
 
Reply to this topicStart new topic
> How To Tell If You Have Been Visited By A Bot?, Probably very simple but -
lister
post Mar 29 2009, 05:39 PM
Post #1


HR 4
****

Group: Active Members
Posts: 184
Joined: 21-February 06
User's local time:
Feb 9 2010, 01:14 PM
Member No.: 10,584



Hi I am using Google Analytics (GA). Am I being very dumb here - how do I tell if a bot - or more specifically if a google bot has decided to pay me a visit. I am sure it has since it has generated a little javascript for me to use -

Thanks!
Go to the top of the page
 
+Quote Post
Jill
post Mar 29 2009, 06:33 PM
Post #2


High Rankings Advisor
Group Icon

Group: Admin
Posts: 29,196
Joined: 21-July 03
User's local time:
Feb 9 2010, 08:14 AM
From: Ashland, MA
Member No.: 2



I don't believe Google analytics provides you with the bot info.
Go to the top of the page
 
+Quote Post
torka
post Mar 29 2009, 09:32 PM
Post #3


Vintage Babe
Group Icon

Group: Moderator
Posts: 4,142
Joined: 31-July 03
User's local time:
Feb 9 2010, 08:14 AM
From: Triangle area, NC, USA, Earth (usually)
Member No.: 89



IIRC, Google's Webmaster Tools will tell you the last time Googlebot visited your site. (Not GoAn, though, because AFAIK bots generally don't execute JavaScript.)

--Torka (IMG:style_emoticons/default/mf_prop.gif)
Go to the top of the page
 
+Quote Post
1dmf
post Mar 30 2009, 05:39 AM
Post #4


Keep Asking, Keep Questioning, Keep Learning
*******

Group: Active Members
Posts: 1,950
Joined: 24-May 07
User's local time:
Feb 9 2010, 01:14 PM
From: Worthing - England
Member No.: 17,339



GOAN will tell you if the GoogleBot has visited.

I have been puzzling this with my thread and some stats which show as 0x0 screen resolution, this could be a bot, Randy and I cannot say for sure though.

Check your screen resolution / browser stats and see if you find the same.
Go to the top of the page
 
+Quote Post
Randy
post Mar 30 2009, 06:19 AM
Post #5


Convert Me!
Group Icon

Group: Admin
Posts: 17,377
Joined: 17-August 03
User's local time:
Feb 9 2010, 07:14 AM
Member No.: 551



Remember though 1dmf, there are some Googlebots today that execute Javascript. Those are the only ones GoAn is going to see.

For my own sites the GoAn reported (JS enabled) Googlebots hits are a fraction of Googlebot hits I see in my log analyzer stats software.

And that's the key to the original question. Google Analytics doesn't see most spider visits at all. For exactly the reason Torka already said, because GoAn requires Javascript to see a hit or anything about it, and the spiders as a general rule do not execute Javascript. The only exception to this as far as I know is one version of Googlebot that crawls around processing JS to look for nefarious javascript redirects and such.

You'll need a stats program that analyzes your Log Files to see spider hits. Most hosts these days automatically set up such log based stats programs for you these days. So the info is probably already there in your hosting account somewhere.
Go to the top of the page
 
+Quote Post
1dmf
post Mar 30 2009, 06:24 AM
Post #6


Keep Asking, Keep Questioning, Keep Learning
*******

Group: Active Members
Posts: 1,950
Joined: 24-May 07
User's local time:
Feb 9 2010, 01:14 PM
From: Worthing - England
Member No.: 17,339



hmm, well I guess I won't know then without trawling my server logs and I really do have better things to do!

Plus I could write a scraping tool that pretends to be IE browser, so you will never get a true picture, as many bots with 'disguise' themselves. (IMG:style_emoticons/default/naughty.gif)
Go to the top of the page
 
+Quote Post

  
Fast ReplyReply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



This forum is sponsored by High Rankings, a Boston SEO Agency
- Lo-Fi Version Time is now: 9th February 2010 - 08:14 AM