Jump to content

  • Log in with Facebook Log in with Twitter Log In with Google      Sign In   
  • Create Account

Subscribe to HRA Now!

 



Are you a Google Analytics enthusiast?

Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE! 

 



 

 www.CustomReportSharing.com 

From the folks who brought you High Rankings!



Photo
- - - - -

How To Stop Links From An External Page.. (Other Web Sites Except Sea


  • Please log in to reply
12 replies to this topic

#1 Turtleman

Turtleman

    HR 1

  • Members
  • Pip
  • 5 posts
  • Location:Arizona, USA

Posted 14 May 2014 - 02:42 PM

Maybe I'm posting in the wrong location but I'm guessing who better to ask than people who know how to gain referances.. I'd hope they know how to stop it to...

 

The real issue is I get "Allot" of links that show up in my C-Panel under the heading of ;

Links from an external page (other web sites except search engines).

The bad part is 90% of them are from Urkraine, China or Russa and point to Porn Sites. So far what I've been doing is locating the sites IP and adding that CIDR to my htaccess file.. that really dosent seem to block much,, I follow the same process with the Spam mail I get from China and others that arn't in my market area.

 

Isn't there a way to block all traffic from specific countries?

 

I've looked at all of information on "Country Blocks of IP's" but the fact is,, none of them seem to really do the job.

 

I've only found one site that took all of a given country's IP's and did a re-direct to point that IP Range to the location of the re-direct.

 



#2 chrishirst

chrishirst

    A not so moderate moderator.

  • Moderator
  • 7,114 posts
  • Location:Blackpool UK

Posted 14 May 2014 - 04:34 PM

They are NOT 'links' it's just referrer spam.

 

And by adding them to .htaccess you are adding additional useless load on your server.


  • Turtleman likes this

#3 Turtleman

Turtleman

    HR 1

  • Members
  • Pip
  • 5 posts
  • Location:Arizona, USA

Posted 14 May 2014 - 09:34 PM

Then I have to conclude theres no way to stop referrer spam..

 

If thats the case I'll just close my eyes and try to ignor it.


  • Jill likes this

#4 torka

torka

    Vintage Babe

  • Moderator
  • 4,637 posts
  • Location:Triangle area, NC, USA, Earth (usually)

Posted 15 May 2014 - 09:26 AM

That's the best course of action, really. Spend your time and energy instead on stuff that makes a difference. :thumbup:

 

--Torka :oldfogey:


  • Turtleman likes this

#5 Michael Martinez

Michael Martinez

    HR 10

  • Active Members
  • PipPipPipPipPipPipPipPipPipPip
  • 5,157 posts
  • Location:Georgia

Posted 15 May 2014 - 12:08 PM

The referrer spam can be blocked but you have to examine your server logs to see where the spammy links are being placed from. In other words, out there someone on server ALPHA is running software that drops a "Trackback" notice or some other false notification on your server claiming that someone followed a link from server BETA.

You were blocking server BETA but you should have been blocking server ALPHA. It's not that you need (or can) block links from other Websites. You need to block the software that is hammering your site with false referral information.
  • Turtleman likes this

#6 Turtleman

Turtleman

    HR 1

  • Members
  • Pip
  • 5 posts
  • Location:Arizona, USA

Posted 15 May 2014 - 10:01 PM

The referrer spam can be blocked but you have to examine your server logs to see where the spammy links are being placed from. In other words, out there someone on server ALPHA is running software that drops a "Trackback" notice or some other false notification on your server claiming that someone followed a link from server BETA.

You were blocking server BETA but you should have been blocking server ALPHA. It's not that you need (or can) block links from other Websites. You need to block the software that is hammering your site with false referral information.

 

LOL.. Yes I understand what your saying.. I've been adding IP's from any other country except the US by viewing the "Latest Vistors" and checking IP's then adding that to the Access file also.. Yes,, the log is getting HUGE :sorry:



#7 chrishirst

chrishirst

    A not so moderate moderator.

  • Moderator
  • 7,114 posts
  • Location:Blackpool UK

Posted 16 May 2014 - 12:53 PM

You do know that every line of .htaccess has to be read, possibly twice, every time a URL is requested from your site, so "blocking" the bots is actually adding twice as much load to your server than just ignoring the referrer spam bots 'hits' in your site logs does.

#8 Turtleman

Turtleman

    HR 1

  • Members
  • Pip
  • 5 posts
  • Location:Arizona, USA

Posted 17 May 2014 - 08:24 AM

You do know that every line of .htaccess has to be read, possibly twice, every time a URL is requested from your site, so "blocking" the bots is actually adding twice as much load to your server than just ignoring the referrer spam bots 'hits' in your site logs does.

 

Yes Chrishirst,, I understand that,, the amount of crawlers/bots that run over my site is Unbeliveable.. I think I have every script on the Planet going over my site... All of them except the few I want... The amount of spam in my mail isn't a few dozen each day... It's Pages and Pages!

I'm thinking (maybe wrong) that the amount of bandwidth and usage is out of controal,, but if I can remove the crawlers I can stop some of the nonsence.....the Hotlinking issues I had I got under controal and thats helped... From what I've learned here so far I'm shooting myself in the foot by trying to stop this stuff.. Since I cant stop it I shouild just clean out my HTACCESS and ROBOTs files,,, close my eyes (maybe add another year of thearphy to my life) and pay my host for more bandwidth.. then find a way to simply re-direct all the trash...LOL



#9 chrishirst

chrishirst

    A not so moderate moderator.

  • Moderator
  • 7,114 posts
  • Location:Blackpool UK

Posted 17 May 2014 - 09:19 AM

Using .htaccess to block one shot bot hits is not going to save any data transfer, bandwidth is actually something else but the hosting companies don't seem to know that.

 

If you need to save data transfer, the individual IPs or the CIDR range need to be blocked at the server firewall or by using TCP Wrappers.



#10 Jill

Jill

    Recovering SEO

  • Admin
  • 33,012 posts

Posted 17 May 2014 - 09:25 AM

I've used these lists to block IPs in my .htaccess for years.

 

Hope it helps!



#11 Turtleman

Turtleman

    HR 1

  • Members
  • Pip
  • 5 posts
  • Location:Arizona, USA

Posted 18 May 2014 - 01:54 PM

Using .htaccess to block one shot bot hits is not going to save any data transfer, bandwidth is actually something else but the hosting companies don't seem to know that.

 

If you need to save data transfer, the individual IPs or the CIDR range need to be blocked at the server firewall or by using TCP Wrappers.

I'm the first to admit I dont really know what I should for the things I do for my business's site.. but I do check the server logs and select the items I dont want,, some I add to a DENY on the robots.txt file but many times that doesnt help so I also use the CIDR and add to htaccess. The TCP Wrappers is really interesting to me,, I'm reading more now and its something my host would accomadate me with..

 

Jill, Thank you for the link,, they will help!.



#12 chrishirst

chrishirst

    A not so moderate moderator.

  • Moderator
  • 7,114 posts
  • Location:Blackpool UK

Posted 18 May 2014 - 04:49 PM

"bad" bots do not even bother reading the robots.txt file.


  • Turtleman likes this

#13 Michael Martinez

Michael Martinez

    HR 10

  • Active Members
  • PipPipPipPipPipPipPipPipPipPip
  • 5,157 posts
  • Location:Georgia

Posted 19 May 2014 - 09:11 PM

You should use this tool to block RANGES of IP addresses rather than individual IP addresses.

http://bgp.he.net/

So instead of blocking aaa.bbb.ccc.1 and aaa.bbb.ccc.244 separately you might end up blocking aaa.bbb.ccc.0/20.

Alternatively, you could just arbitrarily block aaa.bbb.ccc.0/24, which blocks 256 addresses from ...0 to ...255. This helps to keep your .htaccess file smaller.

One other resource to look at is this list of downloadable files containing IP addresses by country:

http://www.ipdeny.com/ipblocks/

You'll find that a lot of the rogue crawlers come from within the United States, though. For example, Amazon controls several million IP addresses and many of the rogue crawlers come from their cloud service. Cloudflare also (unwittingly) hides many rogue crawlers.

You can try adding the following code to your .htaccess file, but it may block some legitimate services coming out of Amazon, too. You'll have to test this to see if it helps or hurts.

Order Deny, Allow
deny from www.amazonaws.com





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

SPAM FREE FORUM!
 
If you are just registering to spam,
don't bother. You will be wasting your
time as your spam will never see the
light of day!