Hi Guys,
How can I disallow this link from Yahoo?
blogs/join.aspx?ReturnUrl=/members/
I have this on my robots.txt file
Disallow: blogs/join.aspx
but yahoo is still crawling this blogs/join.aspx?ReturnUrl=/members/
can someone help me out?
Thanks,
Jhantraz
Subscribe to HRA Now!
SEO Class in Chicago, IL
Learn How To Optimize Your Website on July 26, 2013
Looking for personalized in-depth SEO training among your peers?
High Rankings is offering a 1-day customized SEO training class in Chicago. Class size is limited so please sign-up now if you want in!
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!
www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Disallow
Started by
jhantraz
, Dec 25 2007 10:48 PM
2 replies to this topic
#2
Randy
-
- Moderator
-
- 17,540 posts
Convert Me!
Posted 26 December 2007 - 09:17 AM
You've got a slight syntax error there Jhantraz. The Disallow url's need to have a leading slash to be technically correct. Slurp is probably ignoring what you have there because they simply don't understand it.
Try:
Try:
CODE
Disallow: /blogs/join.aspx
#3
jhantraz
-
- Active Members
-
- 33 posts
HR 2
Posted 26 December 2007 - 11:53 PM
oh! thanks for catching that up.
thank you so much randy
thank you so much randy
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users
