Are you a Google Analytics enthusiast?
More SEO Content
Removing Robots.txt Exclusion
Posted 29 November 2004 - 01:29 AM
we have 4 different domain for the same site and all have same content and everything so it was making duplication of our website so i suggested to add either robots.txt or to redirect every domain to main site and finally it was decied to add robots.txt and our system admin did mistake of adding robots.txt file to main site which was made to stop all the spiders crawling other domains, and it was there for a week .
so google removed our site from database.. now even when i do URL search nothing comes up, i lost PR which i achived so far, and everything is gone.
i need help in this , if you have any tips related to how to get site back in google soon..
please give me...
Posted 29 November 2004 - 01:47 AM
Google checks for the robots.txt once each session - so it will remember the exclusions during that visit, but forget them upon leaving the site.
I don't think you have a serious long term issue - but you will have to wait until the spider visits again and grabs the new robots.txt. Then there will be a slow "respidering" of the site.
I have had a client that accidently did something similar, so I contacted Google on their behalf and explained the situation, and it was fixed the following month.
However, I'm not sure that the fix was any faster than it would have been if I had not contacted them. It did give my client some relief to know that G knew about it and that the robots were coming back, so from a stress/psychological perspective contacting G was very helpful.
The speed you are re-indexed will be related to the size of your site and the number and PR of your incoming links (as well as your navigation structure and spiderability, of course).
Posted 29 November 2004 - 01:58 AM
currently i dont have any robots.txt file on my site. do you suggest adding one giving full access of the site to spiders.
Posted 29 November 2004 - 02:04 AM
Just open Notepad, create an empty file named robots.txt, and upload it to the root directory.
Posted 29 November 2004 - 02:11 AM
will this help me in getting back in google soon.... ???
Posted 29 November 2004 - 02:44 AM
Posted 29 November 2004 - 02:48 AM
and any tips for how to get back again in Google. ????
Posted 29 November 2004 - 08:12 AM
Posted 29 November 2004 - 09:12 AM
Read my article How to Redirect Multiple Domain Names to figure out how to straighten your situation out.
As to Google, just don't think about it and your site will soon be back in the database. There's really nothing you can do but wait, so just forget about it for a few days or weeks and eventually all will be fine. In the meantime, figure out how to do the redirect so you can get the other domains doing what you want.
Posted 30 November 2004 - 12:47 AM
Thanks for your advice... and ARTICLE is also great help for me...
Posted 01 December 2004 - 08:21 AM
Thanks.. to all of you.. for helping me and solving my problem.....
Thanks..Scottie........Jill.........mcanerin for helping me....
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users