Jump to content

  • Log in with Facebook Log in with Twitter Log In with Google      Sign In   
  • Create Account

Subscribe to HRA Now!

 



Are you a Google Analytics enthusiast?

Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE! 

 



 

 www.CustomReportSharing.com 

From the folks who brought you High Rankings!


Sponsored Content

 

 
 

Photo

Disallow Dynamic Part Of Site Been Spidered


  • Please log in to reply
1 reply to this topic

#1 subwoofer

subwoofer

    HR 2

  • Members
  • PipPip
  • 10 posts

Posted 20 December 2006 - 06:19 AM

Hi whitehat.gif

A part of our site is dynmaic. We have made static url's for these (using mod rewrite). I would like to make sure that search engines dont also index the dynamic urls's of these pages as they would index duplicate content. All of our dynamic pages url start with filter_nav.do . If I add "Disallow: /filter_nav.do" to the robot.txt file will this be sufficient? - not sure if search engine would see this as not to index /filter_nav.do but would still index /filter_nav.do?entry=1 ?

Subwoofer

#2 Randy

Randy

    Convert Me!

  • Moderator
  • 17,540 posts

Posted 20 December 2006 - 07:26 AM

The engines should exclude them all.

robots.txt exclusions have an implied wildcard at the end.




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users