Ohh Actually we did small test & our developer added noindex tag to three domain. So now it shows noindex tag to all three except one.
But what you said if its true then i am scared that our one website will de-index from SE?.
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!

www.CustomReportSharing.com
From the folks who brought you High Rankings!
Posted 31 January 2013 - 02:19 PM
Ohh Actually we did small test & our developer added noindex tag to three domain. So now it shows noindex tag to all three except one.
But what you said if its true then i am scared that our one website will de-index from SE?.
Posted 31 January 2013 - 02:24 PM
If you managed to do that, that means either that it's not actually the same document displaying on the four domains, or your developer is dynamically adding the tag based on the requested domain (as I mentioned earlier in this thread). That's fine if it's working. If the tag doesn't display on any of the pages of the domain you want to keep in the index, there's no problem.
But again, it goes on each page, not the site.
Edited by qwerty, 31 January 2013 - 02:25 PM.
Posted 31 January 2013 - 02:36 PM
Its pointing to one root directory & all four website is just copy & paste just association name is different & color theme. But I checked source page that one has index follow & rest of three has noindex tag to all pages.
Posted 31 January 2013 - 02:47 PM
Then this isn't an issue.
Posted 31 January 2013 - 02:55 PM
Yes. But I want to use Robots method option. By adding noindex tag, SE will crawl website first & then will take time to de-index, but through robots it will block quickly.
I just heard this re-write code method something like:
RewriteCond %{HTTP_HOST) ^(www\.)?([^.]+)\.com$
RewriteRule ^robots\.txt$ /robots-%2.txt [L]
But I am not sure about this, how to use exactly & where to add?
Posted 01 February 2013 - 01:04 PM
how to use exactly & where to add?how to use exactly & where to add?
In a .htaccess file in the root directory.
Posted 01 February 2013 - 02:09 PM
In a .htaccess file in the root directory.
Yes, but do I need to add my site name in this code? or put as is? I don't understand this ^robots\.txt$ /robots-%2.txt [L] what exactly it will effect on website?
Posted 01 February 2013 - 07:07 PM
HTTP_HOST IS your sitename.
RewriteRule ^robots\.txt$ /robots-%2.txt [L]
Regular expression
^ says "start from the characters following the carat(^)
The /. 'escapes the dot '.' to make it a literal rather than the "any characters" wildcard.
The $ means "match to the end of the string"
and the %2 means "Insert the second match from the condition here.
So if you format the robots.txt file name(s) as
robots-domain.tld.txt and that is what will be served in response to a HTTP request for sitename.tld/robots.txt
0 members, 0 guests, 0 anonymous users