7 replies to this topic

[maleman]

I debuted a new site not long ago, 4 or 5 weeks. It's popping in G and the others now for keywords.

The owner had the domain for a while before the site was built. Before the site was put put up, when you went to the address, you got the standard "site coming soon" page.

Now, I ask you. A domain that's been registered for quite a while and no official homepage made yet, can this domain get out of the sandbox just by being registered for quite a while even though the "coming soon" page is all that's seen on a crawl?

[Jill]

Now, I ask you. A domain that's been registered for quite a while and no official homepage made yet, can this domain get out of the sandbox just by being registered for quite a while even though the "coming soon" page is all that's seen on a crawl?

It's doubtful, but if it had some links I guess ya never know.

[maleman]

It's doubtful, but if it had some links I guess ya never know.

Thanks Jill,
AFAIK, it didn't have any links before putting up the site. It's had a few for about 3 weeks.

In log files of other sites I made I see bots that crawl right away even though no linking has been set up and no SE submittals.

I've kinda wondered if some SEs may start crawling new domains they find somewhere other than your standard links.

[Jill]

Google definitely does index pages it finds via toolbar data and other sources. I just wouldn't expect those low/no pagerank pages (the real kind) to show up for any keyword searches, however.

[Randy]

I usually see them start hitting new domains if I slap 'em up on a server and pay attention. And I usually buy domains for new projects I have in the back of my mind months (sometimes years it seems!) in advance of when I actually find the time to work on them. Too many ideas, too few hours in the day.

I've never watched it all that closely, but one of my spare domains that has only an index page and has never had a link pointing at it to my knowledge has had its single page indexed by Google and Yahoo. Additionally, the domain is set up to have the server send me log file compilations every Sunday morning. When I bother to glance at those I see Slurp and Googlebot in there every week, Slurp more often it seems. This spare domain also gets hits from whois.sc and some other non-search bots. I don't recall ever seeing MSNbot in those log files, but I've never really paid all that much attention either. But it would make sense of MSNbot doesn't come by since that's the only of the Big 3 that doesn't have the single page indexed.

[maleman]

Too many ideas, too few hours in the day.

Aint it the truth. I always struggled to get enough work to keep me busy. Nowadays (since I got more into programming), I have more work than time to get it done.

I've also wondered if some of these SE bots crawl some index somewhere like maybe whois may have so they can pick up new sites right away. Nowadays, they sure do start hittin fast after a site goes up, even without your traditional links.

[Randy]

Who knows how they do it exactly maleman. There are sources out there where they can get the new domain registration information. Or who knows, perhaps whois.sc provides them with a back door so that they don't have to use the normal form lookup.

I can't remember ever hearing any of the engine reps talk about it specifically. But just from the anecdotal evidence it sure looks like some of them are starting their spider runs pretty early in the process.

[chrishirst]

I still remain 100% unconvinced about sites been indexed through the toolbar

especially when there are things like this about;

http://www.who.is/wh...index/index.php