If you click on that result and get a log-in or register box you may not be a happy camper, but it is up to the site how they want to allow access to their content.
It's also up to the search engine what content they want to index. A search engine needs to see what the searcher will see to make this decision.
This is a very normal situation with the large online research companies who require a subscription and payment before you can access their online content. Do you believe that their research and papers should not be indexed. so that a person can find them if they want them?
Yes, that's exactly what I think! It's also what most free access, free inclusion, general purpose search engines think, IMO.
Some engines, e.g. the old Northern Light, allow "special collections" of paid content to be searched, separately to the free search - not as part of it.
These days, if you use a PFI program you may be OK. I suggest checking with your PFI provider first! The general rule of thumb, though, is that search engines want searchers to see what the spider saw without having to offer any kind of payment.
Scottie's solution is the generally accepted workaround.
FWIW I don't see any problem with using Content Delivery to remove session IDs from URLs. I wouldn't call that cloaking - just as I wouldn't call it cloaking to use Content Delivery to add
session IDs to URLs for browsers that supported sessions ... it amounts to the same thing.
Edited by Alan Perkins, 03 August 2003 - 05:04 PM.