Jump to content

  • Log in with Facebook Log in with Twitter Log In with Google      Sign In   
  • Create Account

Subscribe to HRA Now!

 



Are you a Google Analytics enthusiast?

Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE! 

 



 

 www.CustomReportSharing.com 

From the folks who brought you High Rankings!



Photo

Is There Something Wrong With This Robots.txt File?


  • Please log in to reply
2 replies to this topic

#1 Say Yebo

Say Yebo

    HR 4

  • Active Members
  • PipPipPipPip
  • 217 posts
  • Location:USA

Posted 12 October 2010 - 03:08 PM

Can anyone confirm if this is correct or has an error:

CODE
User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search

Sitemap:  http://company.blogspot.com/feeds/posts/de...orderby=updated


Thanks

Edited by Jill, 13 October 2010 - 08:12 AM.


#2 Say Yebo

Say Yebo

    HR 4

  • Active Members
  • PipPipPipPip
  • 217 posts
  • Location:USA

Posted 14 October 2010 - 12:27 PM

Sorry, I just realized that it's hard to tell if it has an error if you don't know what the site owner intends in the first place :-0

They want the site to be indexed by all search engines, except for the 'search'.

I've never used the sitemap feature before, so I'm not sure if that's a valid instruction.

#3 Jill

Jill

    Recovering SEO

  • Admin
  • 32,775 posts

Posted 14 October 2010 - 02:35 PM

I think you need a trailing slash after /search so it would be /search/




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

SPAM FREE FORUM!
 
If you are just registering to spam,
don't bother. You will be wasting your
time as your spam will never see the
light of day!