Are you a Google Analytics enthusiast?
More SEO Content
Msnbot Crawling Only Homepage
Posted 19 March 2012 - 01:00 PM
What does your robots.txt look like?
Posted 19 March 2012 - 09:45 PM
# All robots will spider the domain User-agent: * Disallow: /*?print$ Disallow: /cgi-bin/ Disallow: /blog/admin/ Disallow: /update/ Disallow: /images/
I have some other folders too. But I removed them to post it here.
Posted 20 March 2012 - 12:29 PM
It tells us that how to identify the real msnbot. It seems that ip is for real msnbot.
But my question is: why am I not seeing bingbot?
Posted 20 March 2012 - 03:20 PM
Back to your robots.txt -- it looks okay. If your XML Sitemap is relatively small, please send me a PM with a sample of the code and I'll take a look for you. If it's a huge file, just PM me the domain name.
Posted 23 March 2012 - 10:21 AM
My xml sitemap is correctly created. No problem with it. Thanks for the offer though.
Posted 28 March 2012 - 01:16 PM
Msnbot going deep into the site. And 3 clicks came from bing.com with three new keywords.
I made sure site doesn't have html erros or page not found etc etc.
1 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users