Remote Data Mining And Management Job In Data Science And Analytics

make a web crawler to monitor websites

Find more Data Mining And Management remote jobs posted recently Worldwide

Hey Guys:

Im looking to make a web crawler, which crawls the page everyday convert it to plain text. Match with the last day results and see if there is any difference of content. If there is it releases Alert via email and RSS Telling what exactly the difference is and on which website.

To make it fast please use any ready-made tool like scrapy, pispider or anyone which have a built-in database and user interface.

I am looking for someone who can do it with in 2-3 days. These 3 tasks.
1. Web crawler framework install, make a UI to enter website links or load them mass via JSON
2. custom script to store results, monitor pages and send rss n email if changes occur (we can use modules)
3. deploy on amazon web server.

This will be on-going project which you can maintain for long -time. No agencies please. No
About the recuiter
Member since Mar 14, 2020
Shashank Sharma
from Missouri, United States

Skills & Expertise Required

PhantomJS Python Scrapy Web Scraping

Open for hiringApply before - Sep 30, 2024

Work from Anywhere

40 hrs / week

Hourly Type

Remote Job

$191.53

Cost

Offer to work on this project closes in 140 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

Survey reporting (Analyze and report survey results) - Hourly
Amazon Mechanical Turk setup and management for PHP - Fixed
Illustrator / cartoonist to produce a few black ink victorian cartoon panels for passion project - Hourly
LANDING PAGE CREATOR/MAILCHIMP - Hourly
Wordpress developer to code a theme from provided design, copy and photos. - Fixed
LiDAR vehicles counting based on its classes using ML - Fixed
Learn Dash Expert - Fixed
Cinematographer and post-production editor needed for a conceptual, experimental short film project - Hourly
Software Engineer/Architect (Cloud - Application Build) - Fixed
Setup of $PAC - PACCOIN - Masternode - Hourly
3D Modeling and Rendering - Fixed
OpenVPN Expert / Consultant Needed. - Hourly
Accumatica report expert requirement for sales application - Hourly
Programmer for mobile app and web - Fixed
Teach CLV analysis using Tableau Superstore data - Fixed

Similar Projects

Sql server and power bi visualization help

I need help writing a sql code and visualizing it on power bi. Custom visual will be plus

Hadoop and Spark developers needed

I am searching for someone who is good in hadoop and spark. I have some tasks for you. if your work quality is good, you will start getting tasks on daily basis

Web Scraping and Data Entry for Education Start-Up. Thank You!

I am looking to collect data on guidance counselors that is publicly available on schools websites. This is the first half of a project that will be extended later this summer. There will be additional projects in the future that involve similar sk...read more

TensorFlow expert required.

I am looking for a Tensor Flow expert with the ability to work in Phyton Framework.
You must have a very good understanding of tf-pose.

Since its for Mobile devices so plz lookup TF lite for Mobile and all details share with candidate...read more

Interviewer for candidates for Data Engineering bootcamp

- 40-60 minutes interview of candidates for Data Engineering bootcamp.
- Inside the interview:
1. Go over candidates homework and make sure he actually did them
2. Short coding online question
3. Record candidates answers to some pr...read more