Jump to content

  • Log in with Facebook Log in with Twitter Log In with Google      Sign In   
  • Create Account

Subscribe to HRA Now!


Are you a Google Analytics enthusiast?

Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE! 




From the folks who brought you High Rankings!

- - - - -

Wordpress Post Crawled By Googlebot Several Times. Bad ?

  • Please log in to reply
4 replies to this topic

#1 kslnor


    HR 2

  • Members
  • PipPip
  • 40 posts
  • Location:USA

Posted 07 January 2013 - 12:31 PM

Here's hoping there are a few Wordpress pro's available...I use a plugin with my Wordpress blog that scans for problems as well as shows human visitors and crawlers.  I have noticed that it appears Googlebot crawls the same page multiple times in a day.  Said page indicated is the url followed by  ?pid=  then a string of numbers,  then a few words and symbols, then pg=25  The next item crawled is identical except the end where pg=26, the next one is pg=27, etc. 


Not sure what this means and why it looks like the same url is crawled multiple times. 


Does anyone have any clue what is going on ?



#2 Jill


    Recovering SEO

  • Admin
  • 33,244 posts

Posted 07 January 2013 - 12:34 PM

Are those additional URLs being indexed? I wouldn't worry so much about the crawling, but if they're being indexed, you could have a duplicate content problem happening. In which case you may need something like rel=canonical.


Also are those real URLs? The ones with the  pg=25, etc.? Do they exist on your site? If so, then you want them to be crawled (usually).

#3 chrishirst


    A not so moderate moderator.

  • Moderator
  • 7,718 posts
  • Location:Blackpool UK

Posted 07 January 2013 - 04:04 PM

Does anyone have any clue what is going on ?

Google found a bunch of links that point to those URLs and decided to 'check them out'.

#4 qwerty


    HR 10

  • Moderator
  • 8,695 posts
  • Location:Somerville, MA

Posted 07 January 2013 - 04:39 PM

If there are page numbers in the URLs, these are probably archives of posts for a particular category, tag, or time period. Most of the time, you'll want your content indexed as individual posts, each with their own URL, so it's usually wise to block indexation of some (and sometimes all) of your archive pages.

#5 kslnor


    HR 2

  • Members
  • PipPip
  • 40 posts
  • Location:USA

Posted 08 January 2013 - 05:09 PM

Thanks for all help..


When I enter the URL in the Google search, the result is "Your search....did not match any documents". 


When I enter the URL in the address bar, I am taken to the post that has the URL without the ?pid= etc...


The ones with the pg=25...are not the real URL's and they don't exist on my site. 


Does this mean they are not indexed, therefore no worries? 

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

We are now a read-only forum.
No new posts or registrations allowed.