Hello Everyone!
I am trying to block a specific file from the robots. For example, there is a file called mark.asp. The file mark.asp allows querystrings. Mark.asp is in a folder/directory called technology. In the technology folder/directory there are other querystring possibilities from other files. I only need to block technology/mark.asp?search= and anything after that. Has anyone tried to be this specific within a robots.txt file? If anyone one can help it would be greatly appreciated!
Make it a Great Day,
SnowBall
Subscribe to HRA Now!
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!
www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Sponsored Content
Robots.txt + Querystring
Started by
SnowBall
, Dec 17 2007 05:43 PM
5 replies to this topic
#2
Ahmed
-
- Active Members
-
- 96 posts
HR 3
- Location:Quebec, Canada
Posted 17 December 2007 - 06:47 PM
I think this should do it
This should allow the specific URL "yourwebsite.com/technology/mark.asp?search=" but disallow any URL's with the added query string.
CODE
user-agent: *
Disallow: technology/mark.asp?search=
Disallow: technology/mark.asp?search=
This should allow the specific URL "yourwebsite.com/technology/mark.asp?search=" but disallow any URL's with the added query string.
#3
Alan Perkins
-
- Admin
-
- 1,559 posts
Token male admin
- Location:UK
Posted 18 December 2007 - 05:33 AM
You've made a slight mistake there, Ahmed, and missed out a slash. The correct answer is:
CODE
User-Agent: *
Disallow: /technology/mark.asp?search=
Disallow: /technology/mark.asp?search=
#4
Ahmed
-
- Active Members
-
- 96 posts
HR 3
- Location:Quebec, Canada
Posted 18 December 2007 - 03:26 PM
Hehe thank you for the correction Alan 
I'm sloppy with slashes sometimes maybe I give robots too much credit.
I'm sloppy with slashes sometimes maybe I give robots too much credit.
#5
SnowBall
-
- Members
-
- 2 posts
HR 1
Posted 18 December 2007 - 05:20 PM
Thank you VERY much! I really appreciate the help.
Happy Holidays,
SnowBall
Happy Holidays,
SnowBall
#6
Alan Perkins
-
- Admin
-
- 1,559 posts
Token male admin
- Location:UK
Posted 18 December 2007 - 05:43 PM
You are welcome, SnowBall.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users
