August 28, 2013
While uncovering and fixing technical issues has always been an important part of SEO, in the wake of Panda and Penguin, technical SEO has moved closer to the forefront. You may have thought that the better Google gets, the less effect technical problems would have on SEO -- I know I did. But in fact, it has been the opposite. It's not that Google can't figure out technical SEO problems and work around them -- they most certainly can and have done it for years. But it seems that they have decided to force webmasters to clean up their sites now.
It does make sense from Google's perspective. Why should they waste their computing power to sort through badly coded websites and misconfigured servers? I can totally see them deciding that if you don't have the time or wherewithal to fix blatant errors, then why should they show your website to their users (aka the searchers)?
Enter Google's Webmaster Tools
For many years Google has provided a host of free webmaster tools to diagnose technical SEO issues. Yet I imagine that only a very small percentage of website owners actually use the tools, and an even smaller percentage are likely to fix the problems. So it seems that Google eventually decided to take drastic measures by downgrading sites that had the most egregious technical issues.
What better way to make site owners take notice than taking away some of their traffic?
Now, I'm not saying that all sites with any technical problems are being downgraded by Google. They're most certainly not. But if sites have other issues that Panda and Penguin caught, PLUS they have a lot of technical issues, it's easy to imagine the creation of a perfect storm, so to speak. Which is partly why some sites that fix their spammy SEO issues without fixing their technical ones may never quite recover.
Why would Google care about technical website problems?
In most cases, it's not the technical issues themselves that are hurting your SEO efforts, but the results that are caused by the errors they create. For instance, most of us agree that Google had made a big push toward showing the most user-friendly sites first in their search results. Well, what's less user friendly than a site where many of the links produce "Internal Server Error" pages instead of what they're supposed to show?
Google is really a "referral engine."
Think of it this way: What if I recommended a particular product to you, but after you bought it, it didn't work very well? Would you trust me for future product recommendations? Probably not. It's the same with Google. They need to refer searchers to the most relevant results that also work as they should. A site with lots of technical errors *should* be downgraded by Google because it provides a poor user experience.
By now you're probably wondering what sorts of technical SEO issues might cause Google's black-and-white animal hitmen to downgrade your site. While the list is long, below are the ones I've compiled that I see the most often when I'm auditing penalized sites. They're generally ones that either cause a poor user experience or simply make your site harder for Google to crawl, index, or read.
Technical SEO issues include (but are definitely not limited to):
How to diagnose technical SEO issues
As previously mentioned, you can find most of these issues by digging into your Google Webmaster Tools account. You'll find lists of 404-errors, soft-404's, crawl errors, and pages that Google simply can't access. You can even try to fetch problematic pages as Googlebot to gain additional insight.
I also highly recommend using a spidering tool such as ScreamingFrog. This tool will spider your entire site and provide you with all kinds of feedback. One thing to remember if you use a tool like this, however, is that just because the tool finds all kinds of strange things, it doesn't mean that Google is also finding them. Be sure to double-check Google's index before you panic!
The key takeaway here is to not just find your site's technical errors, but to actually fix them. Even if your site hasn't lost any traffic over the years, if you find a bunch of technical errors, they could be keeping you from receiving all the search engine traffic you deserve. It's very possible that spending a day fixing these problems could pay off handsomely in the long run. If nothing else, it will certainly keep your users happier!
Jill Whalen has been an SEO Consultant and the CEO of High Rankings, a Boston area SEO Company since 1995. Follow her on Twitter @JillWhalen
If you learned from this article, be sure to sign up for the High Rankings Advisor SEO Newsletter so you can be the first to receive similar articles in the future!