Are you a Google Analytics enthusiast?
More SEO Content
Is Google Site: Command Still Best Way To Check Indexed Page Count?
Posted 19 March 2010 - 06:26 PM
Posted 19 March 2010 - 08:23 PM
But you can also submit XML sitemaps to Google Webmaster Tools. In fact, Vanessa Fox recommends multiple sitemaps for each section of your site. That way you can see what's being crawled (or not) for each section individually.
I haven't tried this yet, but it sounds like a great idea for a very large, dynamic site.
Posted 20 March 2010 - 09:01 AM
Jill: I have done a side-by-side comparison over a 6-month period for the number of pages indexed from the XML sitemap as reported in GWMTs versus the data from a "site:" search. The "site:" data is ALWAYS higher.
I'm assuming that this is due to the XML file not including every single file that Googlebot finds such as PDFs. The site I did this experiment on is large so it's not feasible to try to figure out what's missing.
Has anyone else tried this?
Posted 20 March 2010 - 01:22 PM
The google site: seems to get a realistical result, but it makes me wonder what the webmaster tools numbers are about then.
When i made a few queries on google, "site:domain.fi/ fi/product" and "site:domain.fi/en/product" i noticed there are only 8000 items in the en index, and 15000 items in the fi index. We link heavily to the finnish side but there are only a handful of links to the english side. Maybe this has an effect too despite all the pages are in the sitemap.
Edited by qwerty, 20 March 2010 - 02:33 PM.
Posted 21 March 2010 - 02:45 AM
WMT gives more stable data.
@ttw - Yes, I've gone down the multi map route, my site has over five million pages. I've broken the maps down to the sections of the site so I can see which is getting indexed the best and which section is struggling.
It makes for interesting reading.
Posted 23 March 2010 - 05:39 PM
Posted 24 March 2010 - 07:45 AM
The idea is to do spot checks on what IS indexed and see if it makes sense. If the number of pages indexed is way more than you know you even should have on your site, you're likely getting duplicate content indexed. If the number is way too small, you likely have crawling and/or PageRank issues.
Exact numbers aren't necessary, nor all that useful, imo.
Posted 24 March 2010 - 04:37 PM
There is no 100% effective way of determining how many pages of a site are indexed by Google, but drilling down as far as you can go -- and using the site operator on sub-sections of your site -- is more reliable than the data you'll get from Google's Webmaster Tools and other reports.
Take any report with a grain of salt, and don't try to compare them to each other. You need to establish a baseline with a tool you feel comfortable with and just follow that. You may not be using the best tool at any time, but if you're using a tool you like you can still make adjustments to your optimization if you're not happy with what you see.
Posted 24 March 2010 - 08:55 PM
Michael, in his post after yours, has it exactly right. It's a tool, like any other tool. And it provides valuable information if you know how to use it.
Posted 25 March 2010 - 10:32 AM
It's free, so I can't really complain of course, but I'm surprised it's not up to the level of quality of most of Google's offerings.
Posted 25 March 2010 - 11:07 AM
Posted 25 March 2010 - 11:29 AM
Nope. I feel exactly the same way.
Posted 25 March 2010 - 01:37 PM
Nope, not at all.
I literally review WMT data maybe once or twice per year for each of my sites that are signed up for an account. But no more. And I rarely bother to take the time to force myself to look more than once per year if I haven't already seen something in my web stats that indicates there may be a problem.
Stats I glance at weekly and do a full workup on monthly. For every site that's important to me. Webmaster Tools .... bleh, not so much. And not at all except when I am trying to track down something that's not quite as it should be in a perfect world.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users