Are you a Google Analytics enthusiast?
More SEO Content
Is Frequent Spidering Important?
Posted 13 December 2004 - 07:39 AM
Still kind of chicken & egg, though...
I've never actually paid any attention to spider visits. Does a visit from a spider always result in an update to the SERPs?
Posted 13 December 2004 - 06:00 PM
I would also be worried if the spiders didn't visit.
Posted 13 December 2004 - 06:03 PM
You wouldn't be saying that if you had a forum. the little buggers eat datatransfer like ther is no tomorrow, running around eating everything in sight
Posted 13 December 2004 - 06:07 PM
Posted 13 December 2004 - 06:35 PM
Freshness might be important to me if I were to search for a baseball player's batting average. I wouldn't care about a site that had not been updated in over six months.
Whether this "freshness" feature will catch on, we'll have to wait and see, but it looks like the new MSN search engine thinks maybe so.
Posted 13 December 2004 - 10:12 PM
Your probably right. I'm not going to start one to talk to myself. Tried that years ago in another area and it was a flop. Guess I will have to be satisfied as long as the little spiders are interested at all.
Posted 13 December 2004 - 11:24 PM
Putting that together, people may erroneously conclude that they need the spider to visit more often.
Which doesn't work logically at all if pages aren't actually changing.
But who ever said folks were logical?
Sure folks are not logical, but wouldn't we expect spiders or the SE' that send them out to be logical?
There are lots of stale pages on the web. Lots of dynamic content too.
Surely the spiders know the last date any given web page was revised. If that is the case, if a page remained static (no changes) after a few spider visits wouldn't it make sense that the spider would schedule itself to visit less frequently?
I would think that scaling back the frequency of spidering stale pages would make sense to conserve "spider resources".
If this is true, a page that got updated say, less than once a year, could expect to wait quite a while for the next spider visit. Does this ring true for any of you SEM webmaster techies?
Posted 14 December 2004 - 01:01 AM
Posted 14 December 2004 - 01:56 AM
When I update a few pages or add a new page that usually causes an increase in spider activity for a few days.
The adding of new content is where a forum can become a valuable asset to a site. Especially if the forum is active.
Bob would you give the key words again for finding your forum or PM me the url. I didn't look at it when you mentioned it previously. I would like to see your forum.
Posted 14 December 2004 - 10:29 AM
I happen to have answer if 61.8% or more content changed spider will think it's fresh.
Search 0.618 at google you will find out why.
Posted 14 December 2004 - 12:28 PM
It's not an SEO forum, so I doubt many people here would find it very interesting, but it's at www.annasinkovska.com/fashion-forum/
Posted 14 December 2004 - 01:28 PM
Hmmm. I'd say, though, it's equally likely the answer is 42...
Posted 14 December 2004 - 06:11 PM
Phi on your cryptic algorithms!!
Phi, I say!!!
Posted 15 December 2004 - 04:36 PM
Well, it's easy enough to keep them out of the forum pages if you want to.
> One thing I have noted in checking the search engines for completeness-of-listing is that the pages which change most often (specifically blog pages), and the most recently created stuff generally, tends to appear at the top of the listing for a site:mydomain.com check.
Does the order the pages display in a site: listing mean anything? Is it officially supposed to be the most recent first, or is that just something you're guessing? That doesn't seem to be the case with my sites.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users