Hello
I am looking for a web crawler. I have no experience in this area and need your help, please. The
crawler will be used to track online infringements. The plan is to also integrate it with a case
management system. The requirements that I have are:
- specify start and end point of the crawl
- end point of the crawl may be defined after the crawl has been initiated
- regular monitoring of pre-programmed sites
- allow additional sites to be added on ad-hoc basis
- results matched to pre determined patterns both automatically and manually
I am pretty much open to opensource or non-opensource crawlers, trying to find the best possible
options available. Highly appreciate your help!
Thanks
Subscribe to HRA Now!
SEO Class in Chicago, IL
Learn How To Optimize Your Website on July 26, 2013
Looking for personalized in-depth SEO training among your peers?
High Rankings is offering a 1-day customized SEO training class in Chicago. Class size is limited so please sign-up now if you want in!
Are you a Google Analytics enthusiast?
Share and download Custom Google Analytics Reports, dashboards and advanced segments--for FREE!
www.CustomReportSharing.com
From the folks who brought you High Rankings!
More SEO Content
International SEM | Social Media | Search Friendly Design | SEO | Paid Search / PPC | Seminars | Forum Threads | Q&A | Copywriting | Keyword Research | Web Analytics / Conversions | Blogging | Dynamic Sites | Linking | SEO Services | Site Architecture | Search Engine Spam | Wrap-ups | Business Issues | HRA Questions | Online Courses
Looking For Web Crawler - Help Required!
Started by
webwyse
, May 22 2009 09:41 AM
-
This topic is locked
1 reply to this topic
#2
BBCoach
-
- Moderator
-
- 402 posts
HR 5
Posted 22 May 2009 - 01:00 PM
Try reading this Wiki http://en.wikipedia....iki/Web_crawler At the bottom are several resources for web crawlers.
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users
