CODE
User-agent: *
Disallow:
Sitemap: http://blog.example.com/sitemap.xml.gz
Disallow:
Sitemap: http://blog.example.com/sitemap.xml.gz
Thanks for your help!
Subscribe to HRA Now!
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!
www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Sponsored Content
Robots.txt: Is This Setup Correctly?
Started by
suzstephens
, Feb 24 2010 02:48 PM
3 replies to this topic
#1
suzstephens
-
- Active Members
-
- 115 posts
HR 4
Posted 24 February 2010 - 02:48 PM
I'm working on a Wordpress blog that has not yet been indexed. Is the robots.txt file set up correctly? I don't know what this stuff means:
Thanks for your help!
Thanks for your help!
#2
qwerty
-
- Moderator
-
- 8,295 posts
HR 10
- Location:Somerville, MA
Posted 24 February 2010 - 02:55 PM
If your intention is not to block any robots from any pages, then what you have is fine. Specifically, what you've written is that all user-agents are disallowed access to nothing.
#4
Jill
-
- Admin
-
- 32,325 posts
High Rankings Advisor
Posted 24 February 2010 - 03:44 PM
Make sure that your settings in the wordpress admin are to allow spiders to visit and to index. The default is the opposite.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users
