20 replies to this topic

[hegu]

I submitted my sitemap to bing WMtools. Since then msnbot only crawling my homepage. Every day it crawling the home page like 10 or 20 times. Not going into anyother links.

1. I have textlinks.

2. No javascripts.

3. I submitted the sitemap

4. HTML code validated.

5. No block in robots.txt

6. No ips are banned.

I checked almost every other possibility, but still ... Any advice?

[Michael Martinez]

Do you have links pointing to deeper parts of your Website that are indexed in Bing? If not, Bing probably doesn't feel your deep content is worth indexing.

Do not rely on link reports from other sources, except to provide you with lists of URLs to look for in Bing's index.

If people do not click on a listing in Bing the search engine is more likely to drop the listing from its index, and therefore its links may not help you with crawling and ranking. Hence, a lot of sites that rely on low-quality links really struggle with Bing.

[hegu]

Do you have links pointing to deeper parts of your Website that are indexed in Bing?

How could I possibly know this?

[Michael Martinez]

How could I possibly know this?

Well, when you look at your analytics reports, do you see referring traffic coming from other Websites? If so, where does that traffic land on your site?

[torka]

Uhm.... look to see what pages from your site are indexed in Bing?

If the links on your home page point to these pages, then the answer to the question is "yes," and apparently Bing thinks (at least some of) your deeper content is worth indexing. (It would also, I think, tend to indicate they are, in fact, spidering those pages -- or, more accurately, they spidered them at least once, since it's difficult for them to be indexed otherwise.) It may be they simply aren't visiting these pages often because they don't think they're that important, or they've figured out these pages don't change all that often, or maybe there's some other issue.

However, if none of the interior pages linked from your home page are indexed (or, worse yet, none of your interior pages, are indexed, period), then the answer to the question is "no," and it would seem Bing doesn't think (at least some of) your deeper content is worth indexing. Or that there's some technical problem preventing them from spidering/indexing.

--Torka

[hegu]

Both of you lost me ...

I am asking how would I know that what pages are indexed in Bing? (apart from looking into my site analytics)

In google we can do a search like 'site:mysite.com'. It shows all pages indexed in google from that site. Sameway is there any technique for bing?

[Michael Martinez]

BING supports the site: query operator as well.

[hegu]

Thanks Michael.

Bing has 562 pages from my site. It is almost 85% of my pages. Good to know. But getting very less traffic from bing compared to google.

Any advice there?

I searched bing webmaster tools. But help topics are not as extensive as google though.

[chrishirst]

. Every day it crawling the home page like 10 or 20 times. Not going into anyother links.

Sounds perfectly normal and from that, I deduce that you are only actively promoting the one page.

[chrishirst]

But getting very less traffic from bing compared to google.

And so is getting less traffic compared to Google.

My average is around 70-80% of SE referrals from Google, with Yahoo & Bing (being the same results anyway) making up the rest.

[hegu]

Sounds perfectly normal and from that, I deduce that you are only actively promoting the one page.

No. I am actively promoting around 12 pages. All are linked from homepage. That is what I don't understand. Why msnbot stopping at homepage though all active pages are linked from homepage. Not even an attemt to go into one of those internal pages.

[Michael Martinez]

There are three main reasons why people get less traffic from Bing than from Google:

• Bing is not used as much as Google
• Most Webmasters optimize for the wrong keywords in Bing because they only use Google keyword data to set targets
• Bing is much pickier about which pages to keep in its listings than Google so you generally have less search visibility in Bing

Because of reason number 3 Bing's traffic is probably more evenly (perhaps even more fairly) distributed across a greater number of Websites (proportionate to the size of its index) than Google's traffic. But that's no consolation to people who struggle to get more traffic from Bing and Yahoo!.

One of the secrets to Bing optimization success is to entice people to click on your listings (doing it yourself may just get you banned from Bing). You entice people with good page titles and meta descriptions but Bing's core search audience thinks differently from Google's core search audience so you may have to take that into consideration (this need probably varies by vertical).

Another secret to Bing optimization success is to obtain links from Websites (and pages) that are actually indexed in Bing. Many people assume the low quality links that they believe Google likes will work for Bing. Of course, Google does allow some low quality links to get past its filters but Bing is less likely to index the low quality links to begin with.

[hegu]

Thanks Michael.

So it comes to the point that Msnbot is more pickier and less energetic than Googlebot. (I was thinking that there is some problem with my site that stopping msnbot crawling deep.)

I will keep an eye on my logs for Msnbot activity.

Thanks for your time.

[Michael Martinez]

I wouldn't say it's less energetic. If anything, it seems to be a more aggressive crawler. It's not normal, in my experience, for BingBot to only be looking at the home page of a Website.


Um...you keep saying MSNBot. You ARE seeing BINGBot though, right?

Edited by Michael Martinez, 16 March 2012 - 05:02 PM.

[hegu]

No I am talking about Msnbot.

msnbot-207-46-193-59.search.msn.com
United States

I am seeing the above with that range of ips.

I haven't seen Bingbot in my logs until now.