Are you a Google Analytics enthusiast?
More SEO Content
Question On .htaccess Blocking
Posted 15 November 2011 - 11:44 AM
Posted 15 November 2011 - 03:10 PM
Only if they are crawling from those IP addresses. Many (if not all) of the rogue spiders actually use extensive proxy networks built on hubs around the world. There are, of course, a lot of "research" spiders crawling the Web from various universities and technical institutes. And then there are the social media sites, the blog directories, etc.
Posted 06 December 2011 - 10:40 AM
Anyway, Ip addresses from visitors are different than IPs from spiders. So, if you block IPs visitors use, spiders from that country would still make it to your site.
If you wan to block spiders, block by user agents instead, you may also block proxies, and get rid off about 90% of spammers.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users