I'm looking to make a web crawler, which crawls the page everyday convert it to plain text. Match with the last day results and see if there is any difference of content. If there is it releases Alert via email and RSS Telling what exactly the difference is and on which website.
To make it fast please use any ready-made tool like scrapy, pispider or anyone which have a built-in database and user interface.
I am looking for someone who can do it with in 2-3 days. These 3 tasks.
1. Web crawler framework install, make a UI to enter website links or load them mass via JSON
2. custom script to store results, monitor pages and send rss n email if changes occur (we can use modules)
3. deploy on amazon web server.
This will be on-going project which you can maintain for long -time. No agencies please. No
Skills & Expertise RequiredPhantomJS
Offer to work on this project closes in 4 days!Submit A Proposal
Share this project with your friends