Jump to content

  • Log in with Facebook Log in with Twitter Log In with Google      Sign In   
  • Create Account

Subscribe to HRA Now!

 



Are you a Google Analytics enthusiast?

Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE! 

 



 

 www.CustomReportSharing.com 

From the folks who brought you High Rankings!


More SEO Content

International SEM  | Social Media  |  Search Friendly Design |  SEO |   Paid Search / PPC  |  Seminars  |  Forum Threads  |  Q&A |  Copywriting |  Keyword Research   |  Web Analytics / Conversions  |  Blogging  |  Dynamic Sites  | Linking  |   SEO Services  |  Site Architecture  | Search Engine Spam  | Wrap-ups  | Business Issues |  HRA Questions  |  Online Courses

Sponsored Content

 

 
 

Photo

Big Robot File

Started by adi_azar , Oct 30 2006 12:07 PM

  • Please log in to reply
1 reply to this topic

#1 adi_azar

adi_azar

    HR 4

  • Active Members
  • PipPipPipPip
  • 124 posts
  • Location:Los Angeles, CA

Posted 30 October 2006 - 12:07 PM

I was wondering if the big robot files will reduce the fetch rate of crawlers or not ?

#2 chrishirst

chrishirst

    A not so moderate moderator.

  • Moderator
  • 5,881 posts
  • Location:Blackpool UK

Posted 30 October 2006 - 01:05 PM

Nope. Robots.txt will be read on the crawlers schedule
Back to Robots.txt


0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

  1. HRF SEO Forum
  2. → Technobabble
  3. → Technology and Coding
  4. → Robots.txt
  5. *READ FIRST*--> Forum Rules