Are you a Google Analytics enthusiast?
More SEO Content
Is Frequent Spidering Important?
Posted 11 December 2004 - 10:00 AM
The spider visits, sucks up some bandwidth, finds all the pages the same as they were the last time she visited, and goes on to the next site. How do you think this affects your website?
If you are constantly changing your pages to add fresh content, the spiders will naturally visit more often because they don't want outdated pages in their index. This happens as well if you are constantly tweaking keyword density or changing the page structure or other things that people think they can do to affect their rankings. But all that "tweaking" can lead to incorrect cause-and-effect conclusions.
In the meantime, who's monitoring the sales? Who is tweaking the copy to sell more if all you are ever doing is worrying about rankings? Does anyone know what happens when a searcher actually reaches their site?
I suspect most people don't know why they want spiders visiting more often; they just think it's a good sign. Or possibly they think the spiders give them a rankings boost every time they visit... I don't know. Why else are people so concerned about spider visits?
If your page is in the index already and you haven't changed it, it doesn't matter when then next spider visit is! Or am I missing something? Is there some other value to getting your site crawled that has nothing to do with new content?
Posted 11 December 2004 - 10:06 AM
I'm currently running some tests on my site, and because the site isn't spidered often (because I don't update it on a regular basis), I have to wait for the search engines to get around to finding my new content in order to get any results for my tests. So I have to wait a couple of weeks. Big deal.
I have read a number of articles that announce that search engines "like" fresh content, but I don't think any of them have been clear about how search engines treat this content that they like so much. Yes, they spider it more often, but I don't think any of those articles come out and claim that this means better rankings.
Posted 11 December 2004 - 11:41 AM
If something is out of my control such as that, then why would I waste my time checking it and worrying about it?
Posted 11 December 2004 - 11:47 AM
It's certainly not a goal in and of itself! It's just a means to get changes and new content into the indexes.
Posted 11 December 2004 - 12:26 PM
They hear that the spiders will visit more popular sites, more often, and think that somehow the spidering MAKES their site more popular.
The most common thing we deal with is a mix up of cause and effect, in this biz. Just too many people who only half understand stuff posting all over the net their misunderstood info.
Anyone who wants to do SEO needs to figure stuff out for themselves, do their own tests, be careful of mixing up cause and effect, and use common sense to decide what the results they see mean.
Posted 11 December 2004 - 12:36 PM
Posted 11 December 2004 - 12:53 PM
Posted 11 December 2004 - 02:07 PM
The proof's in the pudding!
Posted 11 December 2004 - 04:39 PM
Now, that may not be indicative for a real SERP query, but it is one thing that will lead people to believe that more recent content ranks better, and to see more recent content, the spider has to drop in regularly.
Putting that together, people may erroneously conclude that they need the spider to visit more often.
Which doesn't work logically at all if pages aren't actually changing.
But who ever said folks were logical?
<edit>because my fingers cannot spell today </edit>
Edited by leadegroot, 11 December 2004 - 09:18 PM.
Posted 11 December 2004 - 06:13 PM
Posted 11 December 2004 - 07:28 PM
It's not about tricking the engines into thinking your content is fresh. If you really want the spiders to visit often, for whatever reason, then you actually need REAL fresh content.
But again, you don't need fresh content to rank well, and you don't need the spiders to visit often to rank well. I have some very competitive keyword phrases that have ranked well for years on some client's sites that have never been updated since I did them like 5 or 6 years ago.
Fresh doesn't always equal better, and the engines know this.
Posted 11 December 2004 - 08:08 PM
It boost your ego when the spiders are crawling. You live in the hope that in this crawl you will get better rankings . People tend to forget about cached pages (or data). You are right it's no big deal as long as the spiders hit your site regularly. Have to admit I would really be worried if the spiders completely ignored me for a month even though my site is pretty static.
Posted 12 December 2004 - 08:10 AM
This is obviously great for someone like me who has a lot to learn.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users