Are you a Google Analytics enthusiast?
More SEO Content
Any Thoughts On Google Sitemap?
Posted 03 June 2005 - 03:04 AM
Probably a good idea so we can better monitor our sites on whether they are crawled by the search engines successfully or not.
Posted 03 June 2005 - 07:29 AM
Never tried it myself, but I may when I release my next new site in a few weeks just to see if it makes a difference in how quickly some of those deeper pages get spidered.
Posted 03 June 2005 - 07:52 AM
Posted 03 June 2005 - 07:53 AM
You can use any reasonably large access log (i.e., an Apache log) to submit your URLs. The Sitemap Generator allows you to generate a Sitemap from a list of URLs, from your access logs, or by pointing to a directory path hosting static files corresponding to URLs.
From Google Sitemap Help
Posted 03 June 2005 - 08:38 AM
Posted 03 June 2005 - 09:36 AM
They claim they will always be free though, so it isn't paid-inclusion. But this will go right along with the NPR stuff, etc.
I think it's a great thing, and a great way to get stuff indexed that would otherwise be part of the invisible web. Google is smart to want to index whatever they can get their hands on.
Posted 03 June 2005 - 10:00 AM
I always understood the term 'invisible web' to mean content that was password protected or disallowed from spiders via robots.txt. I didn't see where this XML sitemap info indicated that Google would crawl or index content that was password protected or disallowed by robots.txt.
Posted 03 June 2005 - 10:01 AM
Of course, it does rely on web managers to know this exists.
Are we going to see another round of "submitting my site" type of questions as a result of this?
Posted 03 June 2005 - 10:33 AM
Posted 03 June 2005 - 11:02 AM
This is very good news indeed, and is yet another step forward for google. This means that all those great content sites on forums and other dynamic sites can now carry google adsense ads. It also means that G has upped the anti with regard session id's etc. All geat stuff.
Interesting to not (as an aside) that Googleguy has now out and out said that the use of '&ID' in any url effectively renders it useless.
Posted 03 June 2005 - 11:09 AM
No, although that may be part of it (but I don't even think it is) the invisible web is often content that the engines simply can't index for one reason or another, very often because it's all contained in a database. I don't think that's the only stuff, but that's a big part of the invisible web.
I'm pretty sure that Chris Sherman has written a lot on this subject, and in fact I believe one of his books is in regards to the invisible web.
Posted 03 June 2005 - 11:37 AM
Posted 03 June 2005 - 02:58 PM
That's what I meant - content that they can't index (because it is restricted in some way) as opposed to just won't index or haven't found. Your original post made it seem like restricted content might be indexed under this new scheme, but I read elsewhere earlier today that the Google Engineer confirmed that Google will respect robots.txt over the XML. I just wanted to draw a clarification.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users