Jump to content

  • Log in with Facebook Log in with Twitter Log In with Google      Sign In   
  • Create Account

Subscribe to HRA Now!

 



Are you a Google Analytics enthusiast?

Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE! 

 



 

 www.CustomReportSharing.com 

From the folks who brought you High Rankings!



Photo
- - - - -

How To Make An Entire Directory Nofollow - Htaccess?


  • Please log in to reply
10 replies to this topic

#1 lister

lister

    HR 5

  • Active Members
  • PipPipPipPipPip
  • 416 posts

Posted 11 July 2014 - 10:43 AM

Hi - I have a job feed from indeed - and - id prefer to make all outgoing links nofollow - that just seems a sensible thing to do...

does anyone know of a php or htaccess hack to force all href links in that directory to be nofollow or must that be added in the actual XML/ php?

Thanks!



#2 Alan Perkins

Alan Perkins

    Token male admin

  • Admin
  • 1,642 posts
  • Location:UK

Posted 11 July 2014 - 11:17 AM

Pass all links through a redirect that is excluded by robots.txt



#3 chrishirst

chrishirst

    A not so moderate moderator.

  • Moderator
  • 7,099 posts
  • Location:Blackpool UK

Posted 11 July 2014 - 11:41 AM

Or a meta robots directive.



#4 lister

lister

    HR 5

  • Active Members
  • PipPipPipPipPip
  • 416 posts

Posted 11 July 2014 - 11:54 AM

Pass all links through a redirect that is excluded by robots.txt

 

thanks - this seems to do the job... https://gist.github....jdevalk/5622742


Or a meta robots directive.

 

...right....

but this seems to block out all bots from any sort of investigation...Id just like to nofollow outgoing links...

 

thanks all the same



#5 chrishirst

chrishirst

    A not so moderate moderator.

  • Moderator
  • 7,099 posts
  • Location:Blackpool UK

Posted 11 July 2014 - 11:59 AM

 

but this seems to block out all bots from any sort of investigation...Id just like to nofollow outgoing links...

 

All depends what directives are applied apply.

 

NOINDEX is to block the contents from being indexed, then there is NOFOLLOW ... ...



#6 lister

lister

    HR 5

  • Active Members
  • PipPipPipPipPip
  • 416 posts

Posted 14 July 2014 - 04:37 AM

I found the best solution and it is so obvious...

I just sneaked a rel="nofollow" into the php - so when it spits out a URL it just adds rel="nofollow"

So much easier and that is much more respected i reckon than robots.txt

Robots.txt just seems like an 'honesty box' - i think most bots just flat out ignore it.



#7 Alan Perkins

Alan Perkins

    Token male admin

  • Admin
  • 1,642 posts
  • Location:UK

Posted 14 July 2014 - 04:40 AM

So much easier and that is much more respected i reckon than robots.txt

Robots.txt just seems like an 'honesty box' - i think most bots just flat out ignore it.

 

You asked for advice and was given it. It's up to you what you do with it but, for the record, the above comment is absolute nonsense.



#8 lister

lister

    HR 5

  • Active Members
  • PipPipPipPipPip
  • 416 posts

Posted 14 July 2014 - 06:46 AM

 

You asked for advice and was given it. It's up to you what you do with it but, for the record, the above comment is absolute nonsense.

 

No worries - im really glad and grateful for all advice - the php solution just seems the easiest - hey, after all - this is a forum of discussion right ;)

So - you reckon robots.txt is always obeyed?



#9 Alan Perkins

Alan Perkins

    Token male admin

  • Admin
  • 1,642 posts
  • Location:UK

Posted 14 July 2014 - 07:08 AM

Yep, it's always obeyed by the key search engines, e.g. Google and Bing.



#10 chrishirst

chrishirst

    A not so moderate moderator.

  • Moderator
  • 7,099 posts
  • Location:Blackpool UK

Posted 15 July 2014 - 02:49 AM

And what makes you think that adding rel="nofollow" is "respected" by any other bots than ones that are run by the organisations that actually created the 'protocol' in the first place?



#11 Michael Martinez

Michael Martinez

    HR 10

  • Active Members
  • PipPipPipPipPipPipPipPipPipPip
  • 5,157 posts
  • Location:Georgia

Posted 15 July 2014 - 08:24 AM

Most bots are not coming from search engines and they don't care about "rel='nofollow'". In fact, many SEO link research bots claim they will honor "robots.txt" DISALLOW directives but they are less clear about what they do with "rel='nofollow'".




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

SPAM FREE FORUM!
 
If you are just registering to spam,
don't bother. You will be wasting your
time as your spam will never see the
light of day!