Hello Everyone!
I am trying to block a specific file from the robots. For example, there is a file called mark.asp. The file mark.asp allows querystrings. Mark.asp is in a folder/directory called technology. In the technology folder/directory there are other querystring possibilities from other files. I only need to block technology/mark.asp?search= and anything after that. Has anyone tried to be this specific within a robots.txt file? If anyone one can help it would be greatly appreciated!
Make it a Great Day,
SnowBall
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!

www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Robots.txt + Querystring
Started by
SnowBall
, Dec 17 2007 05:43 PM
5 replies to this topic
#1
Posted 17 December 2007 - 05:43 PM
#2
Posted 17 December 2007 - 06:47 PM
I think this should do it
This should allow the specific URL "yourwebsite.com/technology/mark.asp?search=" but disallow any URL's with the added query string.
CODE
user-agent: *
Disallow: technology/mark.asp?search=
Disallow: technology/mark.asp?search=
This should allow the specific URL "yourwebsite.com/technology/mark.asp?search=" but disallow any URL's with the added query string.
#3
Posted 18 December 2007 - 05:33 AM
You've made a slight mistake there, Ahmed, and missed out a slash. The correct answer is:
CODE
User-Agent: *
Disallow: /technology/mark.asp?search=
Disallow: /technology/mark.asp?search=
#4
Posted 18 December 2007 - 03:26 PM
Hehe thank you for the correction Alan
I'm sloppy with slashes sometimes maybe I give robots too much credit.
#5
Posted 18 December 2007 - 05:20 PM
Thank you VERY much! I really appreciate the help.
Happy Holidays,
SnowBall
Happy Holidays,
SnowBall
#6
Posted 18 December 2007 - 05:43 PM
You are welcome, SnowBall.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users







