Jump to content

  • Log in with Facebook Log in with Twitter Log In with Google      Sign In   
  • Create Account

Subscribe to HRA Now!

 



Are you a Google Analytics enthusiast?

Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE! 

 



 

 www.CustomReportSharing.com 

From the folks who brought you High Rankings!



Photo
- - - - -

Bots Following Links For Members Only...should I Do Something?


  • Please log in to reply
4 replies to this topic

#1 detzx

detzx

    HR 2

  • Active Members
  • PipPip
  • 23 posts

Posted 06 July 2011 - 08:06 AM

They all 404 if you're not a member but Google hits them all daily and in webmaster tools it shows we have tons of 404's because of it. Is there something I should do about this or does it matter?

#2 Jill

Jill

    Recovering SEO

  • Admin
  • 32,956 posts

Posted 06 July 2011 - 08:10 AM

You could robots.txt them out, although they still might show up in Google's index.

Or if you want people to actually get to some of the members only info from Google, you could use their first click free program.

#3 detzx

detzx

    HR 2

  • Active Members
  • PipPip
  • 23 posts

Posted 06 July 2011 - 08:22 AM

QUOTE(Jill @ Jul 6 2011, 09:10 AM) View Post
You could robots.txt them out, although they still might show up in Google's index.

Or if you want people to actually get to some of the members only info from Google, you could use their first click free program.


Does it "hurt" to have Google 404'in these pages? I personally don't care as long as we're not penalized for having so many.

#4 Jill

Jill

    Recovering SEO

  • Admin
  • 32,956 posts

Posted 06 July 2011 - 08:50 AM

Hard to say. Probably not, but in general it's not something you want if you can help it.

#5 Michael Martinez

Michael Martinez

    HR 10

  • Active Members
  • PipPipPipPipPipPipPipPipPipPip
  • 5,117 posts
  • Location:Georgia

Posted 06 July 2011 - 12:17 PM

There are indirect consequences of allowing Google to crawl 404 URLs. For example, Google says you get only so much crawl for your Website. It would be better for you if Google scheduled fetches of real pages rather than non-existing pages. So it's a good idea to use robots.txt to block those URLs. Just don't worry about them if they show up in Google's index. As Jill pointed out, Google may index links it discovers but cannot crawl.




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

SPAM FREE FORUM!
 
If you are just registering to spam,
don't bother. You will be wasting your
time as your spam will never see the
light of day!