Are you a Google Analytics enthusiast?
More SEO Content
Robots.txt Dissalow Url
Posted 15 March 2008 - 07:09 AM
I am new to web design and know very little about code so I am using dreamweaver cs3.
I pretty much understand the concept and how to generate my own robots.txt file, however, I am struggling to decide which urls to disallow.
My site has a picture gallery. This involves clicking on a thumbnail that I have set to open up a url in another browser window tailored to my images (without navi & menu bars etc). These url's are linkless and only include images with a brief description. The user then closes the window themselves.
Question is. Would i be right to disallow spiders access to these kind of url's? There are around 40 of them and as they are not really part of the main structure of my site - I can't see the point in spiders visiting them. Would they be kind of dead end as they are linkless?
Once again thanks very much for baring with me
Posted 15 March 2008 - 07:44 AM
If there's no actual page address right after the href the spiders will leave that link alone.
If the href does include a real page address it's probably not hurting you since those pages contain no content other than a picture. However you can exclude them if you want since they're not doing you any good either.
Posted 15 March 2008 - 08:43 AM
Let me explain a little more. Here is the code from the thumbnail page:
Basically I run the website for a breed of terrier. The thumbnail links to a new window containing a large pic and text naming the dog. It is all done through the behaviors panel in dreamweaver. However, it links to a page I have created not just the image. This way I can add more images and info on the dog to the page at a later date.
From what you are saying it seems like i don't have to bother as the spiders will not follow these kind of links?
Posted 15 March 2008 - 07:26 PM
Posted 16 March 2008 - 04:16 AM
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users