SEO Class in Chicago, IL
Learn How To Optimize Your Website on July 26, 2013
Looking for personalized in-depth SEO training among your peers?
High Rankings is offering a 1-day customized SEO training class in Chicago. Class size is limited so please sign-up now if you want in!
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!

www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Bots Following Links For Members Only...should I Do Something?
Started by
detzx
, Jul 06 2011 08:06 AM
4 replies to this topic
#1
Posted 06 July 2011 - 08:06 AM
They all 404 if you're not a member but Google hits them all daily and in webmaster tools it shows we have tons of 404's because of it. Is there something I should do about this or does it matter?
#2
Posted 06 July 2011 - 08:10 AM
You could robots.txt them out, although they still might show up in Google's index.
Or if you want people to actually get to some of the members only info from Google, you could use their first click free program.
Or if you want people to actually get to some of the members only info from Google, you could use their first click free program.
#3
Posted 06 July 2011 - 08:22 AM
You could robots.txt them out, although they still might show up in Google's index.
Or if you want people to actually get to some of the members only info from Google, you could use their first click free program.
Or if you want people to actually get to some of the members only info from Google, you could use their first click free program.
Does it "hurt" to have Google 404'in these pages? I personally don't care as long as we're not penalized for having so many.
#4
Posted 06 July 2011 - 08:50 AM
Hard to say. Probably not, but in general it's not something you want if you can help it.
#5
Posted 06 July 2011 - 12:17 PM
There are indirect consequences of allowing Google to crawl 404 URLs. For example, Google says you get only so much crawl for your Website. It would be better for you if Google scheduled fetches of real pages rather than non-existing pages. So it's a good idea to use robots.txt to block those URLs. Just don't worry about them if they show up in Google's index. As Jill pointed out, Google may index links it discovers but cannot crawl.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users










