Are you a Google Analytics enthusiast?
More SEO Content
Posted 11 March 2004 - 03:39 AM
Posted 11 March 2004 - 07:16 AM
Just open notepad, don't type anything, and save the file with the name robots.txt. Then upload it to the root (main) directory of your site, so it can be found at (if, for example, your site is www.domain.com) www.domain.com/robots.txt.
The spiders will look for it, find it, see that it's blank, and crawl your site normally. The only difference will be that you won't get that 404 error anymore.
Posted 13 March 2004 - 08:33 PM
Posted 14 March 2004 - 01:16 PM
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users