Remote Data Mining And Management Job In Data Science And Analytics

make a web crawler to monitor websites

Find more Data Mining And Management remote jobs posted recently Worldwide

Hey Guys:

Im looking to make a web crawler, which crawls the page everyday convert it to plain text. Match with the last day results and see if there is any difference of content. If there is it releases Alert via email and RSS Telling what exactly the difference is and on which website.

To make it fast please use any ready-made tool like scrapy, pispider or anyone which have a built-in database and user interface.

I am looking for someone who can do it with in 2-3 days. These 3 tasks.
1. Web crawler framework install, make a UI to enter website links or load them mass via JSON
2. custom script to store results, monitor pages and send rss n email if changes occur (we can use modules)
3. deploy on amazon web server.

This will be on-going project which you can maintain for long -time. No agencies please. No
About the recuiter
Member since Nov 11, 2022
Admin Contact
from Khomas, Namibia

Skills & Expertise Required

PhantomJS Python Scrapy Web Scraping

Open for hiringApply before - Aug 16, 2024

Work from Anywhere

40 hrs / week

Hourly Type

Remote Job

$191.62

Cost

Offer to work on this project closes in 92 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

Word Press web designer with great eye and aesthetics - Fixed
Developer needed to make a small game in HTML 5 - Hourly
Looking for someone to sew a dress printed on stretchy fabric. - Hourly
Programmer wanted to create an app for a single player game - Fixed
Colorado attorney wanted - Hourly
ManageEngine ADAudit Plus configuration - Fixed
Script for job alerts to be emailed in real-time - Fixed
Marketing PLAN FOR Adult Family Home - Fixed
Desktop Technician Freelancer - Hourly
Security Monitoring of website using SIEM Tool - Hourly
Urgent requirement for Java Lead | 5-8 years experience - Hourly

Similar Projects

Craglists searcher.

Looking for an experienced programmer with scraping, as i got links for scraping and keywords. So i want the software to watch and scrape all those links and then sending the result that matches my search through email.

Python developer for automation

Looking for experienced Python developer to develop an website to provide a automation testing platform to software testing team. => Automation tool

Expert in Data Science; Min. 7 years Experience

1. We are are 150-people technology startup focused on helping poor people (monthly salary<$250) find relevant jobs

2. over the past 5 years of our existence, we have generated significant data within our database

3. We want to buil...read more

Need Help To Move Files Based On Filename List Using Command Line

I have a folder on my Windows 10 computer which has several subfolders. Inside each subfolder, there are thousands of different types of files (documents, photos, videos, audio, etc...). I have a text file with a list of some specific filenames of di...read more

need help with django unit testing

i need help with django unit testing, its an ongoing project. but i will give flexible hours, you can work on weekends or weekdays, whenever you want you can work there is no particular time to work for me.