Are you a Google Analytics enthusiast?
More SEO Content
Google Indexing (deeper And Deeper)
Posted 01 April 2005 - 11:40 AM
Greetings from Amsterdam - I am new to the board - but have been following the discussion for a while now. Thank you for the tips, tricks and sound advice. It's been quite helpful.
I have a (perhaps for many of you) simple question,
How or when does the google spider start indexing deeper into the website. We have recently launched our new site (stepped away from flash and went completely html) and somehow the googlebot keeps passing the index.html but doesn't seem to go deeper. I have followed many of the tips i have found online (html menu at the bottom of the page, clear links deeper into the site on the homepage, etc..).
I am just being impatient or have i overseen something.
thank you for advice!
Posted 01 April 2005 - 11:49 AM
That's the one thing that seems to spur a greater interest from the bots that gets them doing deeper crawls.
Oh, and welcome !
Posted 01 April 2005 - 11:54 AM
It just takes patience. at some point the deep crawl will be scheduled, exactly when or how is as good as anyones guess.
Posted 01 April 2005 - 11:56 AM
thanks for the quick reply and welcome - we are still working on our linking campaign (when using the link button in the google toolbar - only one site shows up so far). However I know that we have far more incoming links to the homepage. However as far as i know at the moment there are no incoming links that go deeper into the site. Perhaps that is one of the problems?
Greetings from our sunny capital. Spring is on it's way! :-)
Posted 01 April 2005 - 12:01 PM
If it makes sense to get some sites linking to your deeper pages it certainly won't hurt. But as long as you continue getting more links you should start seeing crawls that go deeper into your site, even if all of the links point at your home page.
Posted 05 April 2005 - 09:10 PM
You don't have to wait for Google to deep-crawl your site. You can submit your secondary page URLs to Google directly. There is no guarantee that Google will crawl them, but if your site is internally well-linked (I recommend that every page link to a site map if you have more than 10 pages), Google will start to follow those links.
Make sure your pages are relatively small (say, under 25K) and not heavily burdened with page formatting code (CSS, nested table structures, and so forth).
Posted 05 April 2005 - 09:45 PM
You can, but don't expect it to actually do anything.
Posted 05 April 2005 - 10:38 PM
Google has crawled every URL I've submitted to it since December (including for a previously sandboxed site). The pages usually turn up in the next weekly index update. So far, only one site did not appear quickly, but that was apparently because I had inserted a background graphic and forgot to change the page's background color to black. When I removed the graphic and restored the normal black-text-on-white-background (default) colors, the page appeared in Google the next Monday.
So, I stand by what I said. Google does accept content through the SUBMIT URL tool, but they warn that they don't guarantee a crawl. Since they provide that warning, I will pass it on.
But as long as they continue to crawl whatever I submit to them, my days of waiting for Google to find new content are over. I just don't have that kind of patience.
I should perhaps point out that Google recently added a validation field to their submission page. You have to type in a nonsense word that is displayed in a graphic. So, I suspect that the tool's previous ineffectiveness was probably due more to robotic spam submissions than anything else.
Posted 06 April 2005 - 07:33 AM
More links + Small page size + good site structure + site updates are some of the things I recommend
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users