1 reply to this topic

[webwyse]

Hello
I am looking for a web crawler. I have no experience in this area and need your help, please. The

crawler will be used to track online infringements. The plan is to also integrate it with a case

management system. The requirements that I have are:
- specify start and end point of the crawl
- end point of the crawl may be defined after the crawl has been initiated
- regular monitoring of pre-programmed sites
- allow additional sites to be added on ad-hoc basis
- results matched to pre determined patterns both automatically and manually

I am pretty much open to opensource or non-opensource crawlers, trying to find the best possible

options available. Highly appreciate your help!

Thanks

[BBCoach]

Try reading this Wiki http://en.wikipedia....iki/Web_crawler At the bottom are several resources for web crawlers.