Remote Data Mining And Management Job In Data Science And Analytics

make a web crawler to monitor websites

Find more Data Mining And Management remote jobs posted recently Worldwide

Hey Guys:

Im looking to make a web crawler, which crawls the page everyday convert it to plain text. Match with the last day results and see if there is any difference of content. If there is it releases Alert via email and RSS Telling what exactly the difference is and on which website.

To make it fast please use any ready-made tool like scrapy, pispider or anyone which have a built-in database and user interface.

I am looking for someone who can do it with in 2-3 days. These 3 tasks.
1. Web crawler framework install, make a UI to enter website links or load them mass via JSON
2. custom script to store results, monitor pages and send rss n email if changes occur (we can use modules)
3. deploy on amazon web server.

This will be on-going project which you can maintain for long -time. No agencies please. No
About the recuiter
Member since Mar 14, 2020
Renditya Pramas
from Fargona, Uzbekistan

Skills & Expertise Required

PhantomJS Python Scrapy Web Scraping

Open for hiringApply before - Jul 4, 2024

Work from Anywhere

40 hrs / week

Hourly Type

Remote Job

$191.62

Cost

Offer to work on this project closes in 56 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

Need strong front end developer for building a dynamic component - Fixed
Building an APP Testing Environment with VMware ThinApp & AWS - Hourly
Logical Reasoning Multiple Choice Questions - Fixed
Ansible/Docker/DevOps Training - Hourly
User Scraper Instagram - Hourly
shopify website final touches. - Hourly
Looking for a ServiceNow Expert - Hourly
Online product sourcing assistant - Hourly
Web scraper, Data harvester,data mining person needed - Hourly
CAD/3D kitchen planner - Hourly

Similar Projects

Graph d3 visualization project

We are seeking a senior developer to design and build the d3 visualizations for the UI components of our cyber security analysis and reporting products. Focuses heavily on presentation of data to users in the form of nodes and networks with accompany...read more

Urgent-OpenCV TensorFlow DataSet Update

I have 60% completed python project mainly processes images for dataset and need to complete in this week. Apply if you can work full time until this week and complete it perfectly. Thanks

Looking for live data crawler

I am looking for someone that is speacialized in live data extraction

Thingspeak Data Time Interval Python Script

I have a Python3 script that is running on a Raspberry PI that is using a HC-SR04 Ultrasonic Sensor that is reading and posting data to Thingspeak. This setup is monitoring my sump pump pit depth and sump activity. The Thingspeak dashboard link wi...read more

KVM-QEMU Cloud Platform Development and Engineering

We have reviewed various open source projects such as Openstack, Eucalyptus and Cracow Cloud One, based on this, we want to develop our cloud with KVM-QEMU infrastructure using Python language. We are looking for very experienced software engineers.