Jump to content

  • Log in with Facebook Log in with Twitter Log In with Google      Sign In   
  • Create Account

Subscribe to HRA Now!

 



Are you a Google Analytics enthusiast?

Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE! 

 



 

 www.CustomReportSharing.com 

From the folks who brought you High Rankings!



Photo

Is My Robots.txt Correct? Just Want To 100% Sure!


  • Please log in to reply
2 replies to this topic

#1 lister

lister

    HR 5

  • Active Members
  • PipPipPipPipPip
  • 416 posts

Posted 06 July 2013 - 07:08 PM

I want to exclude my terms and privacy directories -

 

so -

 

User-agent: *
Disallow: /terms/
Disallow: /privacy/

 

That's all good right? And I place this at the root level?

I know that bad bots ignore this but I just dont want these two docs to be indexed -

 

THANKS - I just want to be 100% sure I have it right.

 

 



#2 qwerty

qwerty

    HR 10

  • Moderator
  • 8,625 posts
  • Location:Somerville, MA

Posted 06 July 2013 - 07:53 PM

Yes, that will disallow all compliant bots from everything in those two directories.



#3 lister

lister

    HR 5

  • Active Members
  • PipPipPipPipPip
  • 416 posts

Posted 06 July 2013 - 08:20 PM

Thanks






0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

SPAM FREE FORUM!
 
If you are just registering to spam,
don't bother. You will be wasting your
time as your spam will never see the
light of day!