Good to see that the white text on a pale blue background has gone!
I am just starting the process of creating my Robots.txt file. The question I am trying to resolve is this: I am serving up my style sheets - I rely heavily on style sheets - from a virtual directory called, appropriately enough, styles. Is it necessary to allow the spider to fetch style sheets from there.
In other words would Disallow: /styles/ be a bad idea?
Judging from the responses I have had to my post regarding the use of H# tags etc I would be inclined to think it would be a bad idea - the spider might try to weight text based on the styles used. Nevertheless, it would be useful to get a few views on the subject.
Subscribe to HRA Now!
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!
www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Sponsored Content
Robots.txt & Styles
Started by
FredAt
, Dec 20 2006 09:09 AM
1 reply to this topic
#2
Randy
-
- Moderator
-
- 17,540 posts
Convert Me!
Posted 20 December 2006 - 09:18 AM
You can exclude your styles subdirectory if you want. Not that it's going to gain you much, if anything.
Most times the spiders aren't going to grab that external css file anyway since they're not really in to analyzing those yet.
Most times the spiders aren't going to grab that external css file anyway since they're not really in to analyzing those yet.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users
