make a web crawler to monitor websites




Jenny Nieves Canada


OpenAug 3, 2018
Hey Guys:

I'm looking to make a web crawler, which crawls the page everyday convert it to plain text. Match with the last day results and see if there is any difference of content. If there is it releases Alert via email and RSS Telling what exactly the difference is and on which website.

To make it fast please use any ready-made tool like scrapy, pispider or anyone which have a built-in database and user interface.

I am looking for someone who can do it with in 2-3 days. These 3 tasks.
1. Web crawler framework install, make a UI to enter website links or load them mass via JSON
2. custom script to store results, monitor pages and send rss n email if changes occur (we can use modules)
3. deploy on amazon web server.

This will be on-going project which you can maintain for long -time. No agencies please. No

Skills & Expertise Required

PhantomJS Python Scrapy Web Scraping 

Offer to work on this project closes in 4 days!

Submit A Proposal

Share this project with your friends

Freelancers You May Hire

Here are our top professional picks for you to hire

Similar Projects

Java Expert

Looking for someone who is very good at Java
Java Programming expert

Hourly, $10.00

Am looking to create an automated a...

Looking to design an algo to trade a MACD indicator. The algo is already written in Python and I need someone to hook up the data and to my Interactive Brokers account. Want to be able to back more

Hourly, $36.00

Talend + AWS Senior Developer

Migration of on-premises ETL processes into AWS, using Talend. The work must be done on-site, in Portugal. Candidates must be available for traveling and stay in Portugal for at least 6 months.

Hourly, $28.00

Need a webpage scraped for informat...

Need a script written to scrape a particular website

I will provide the sample pages and the list of information that needs to be extracted. The program should extract the information then more

Hourly, $18.00