Hello
I am looking for a web crawler. I have no experience in this area and need your help, please. The
crawler will be used to track online infringements. The plan is to also integrate it with a case
management system. The requirements that I have are:
- specify start and end point of the crawl
- end point of the crawl may be defined after the crawl has been initiated
- regular monitoring of pre-programmed sites
- allow additional sites to be added on ad-hoc basis
- results matched to pre determined patterns both automatically and manually
I am pretty much open to opensource or non-opensource crawlers, trying to find the best possible
options available. Highly appreciate your help!
Thanks
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!

www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Looking For Web Crawler - Help Required!
Started by
webwyse
, May 22 2009 09:41 AM
1 reply to this topic
#1
Posted 22 May 2009 - 09:41 AM
#2
Posted 22 May 2009 - 01:00 PM
Try reading this Wiki http://en.wikipedia....iki/Web_crawler At the bottom are several resources for web crawlers.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users





This topic is locked


