Are you a Google Analytics enthusiast?
More SEO Content
How Does This Trick Work?
Posted 18 March 2009 - 03:55 PM
How do large sites like facebook, mapquest and compete, get these types of pages indexed? The page above is obviously not linked from their home page. How do they provide a large database of search terms to index their site for? This does not seem to be the regular SEO of creating a page and linking to it in the navigation map of the site. Is this through massive sitemaps?
Posted 18 March 2009 - 04:53 PM
Posted 18 March 2009 - 05:22 PM
We have no way of knowing if someone submitted that page to Google. We have no way of knowing if someone visited that page and had Google's Toolbar installed. We have no way of knowing if someone somewhere out there is linking to that specific page. And we have no way of knowing if Compete is feeding that url to Google for some reason.
Any of the above and several other possible scenario's could be the root cause. But if the domain doesn't restrict the url via robots.txt or deliver a different status code than 200 OK, the engines are perfectly right in indexing the url. And as Michael said above, historically Compete doesn't do a very good job of protecting those urls to keep them out of the index.
Posted 18 March 2009 - 06:03 PM
What is the strategy to get these very large volume of search term related pages indexed? I am sure map shows up for maps and directions from literally any place you mention on google. They have massive number of pages pre-created that are being indexed. What is the strategy behind this. Is this some kind of directory that they create or they submit pages not on the site through sitemap.. how does it work?
Posted 18 March 2009 - 07:26 PM
I guess I don't get the question. Are you asking what method they're using to get the pages spidered? The method won't really matter as long as they're making it available. And if they have a site search tool they may not have to go to any special means to make the urls available. Google especially been known recently to try searches on a site search tool and index any page that gets returned if it contains data.
Posted 18 March 2009 - 07:34 PM
Posted 19 March 2009 - 06:56 AM
In theory they could also be providing those urls via an XML Sitemap too.
Or if the pages are only reachable via a search form it could be something Google has picked up on. Google does in fact utilize some site search forms and include the results pages in their results these days. This newish thing happens with a lot of the more authoritative sites. And in fact I've had it happen with some of my own sites even though most of them are only authoritative in their (much smaller) markets.
Posted 19 March 2009 - 12:53 PM
This query shows that lots of information about HighRankings is exposed to the search engines.
How did that info get there? Maybe as Randy suggested through a complex network of XML sitemaps.
I opened one of those compressed sitemaps and found analytics page URLs for thousands of domains.
So Compete is making the information freely available to the search engines.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users