Remote Data Mining And Management Job In Data Science And Analytics

Crawling a classified website

Find more Data Mining And Management remote jobs posted recently Worldwide

I need a ruby (alternatively python) library / class for crawling a classifieds website: olx.pl, written in ruby.
Data to be extracted by the library:
- Title
- Price
- Phone number
- Date
- Size
- Area
- Description
- URL.

Additional requirements:
The script has to send the data in json to a address of choice as it crawls the website.
The script has to be able to run without a ban / downtime from the website
About the recuiter
Member since Mar 14, 2020
Rory Millikin
from South Carolina, United States

Skills & Expertise Required

Web Crawling Data Mining Data Scraping Ruby Scrapy

Candidate shortlisted and hiredHiring open till - Jun 12, 2022

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$69.45

Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

oAUTH implementation in Ruby on Rails. - Hourly
List 10 products that are rising in google trends - Fixed
ELectronic Data Interchange - Hourly
Senior TPM for Data Platform initiatives - Hourly
Retail Point of Sale (POS) System Installers - Hourly
URGENT Scrap Results from one website - Existing Python Code to be customised - Fixed
Creative Website Designer Needed - Hourly
Custom Wordpress plugin development - Hourly
Contractor or Consultant for Citect SCADA work - Hourly
Bookkeeper/Accountant needed for payroll reconciliation. - Hourly
DevOps person needed for setup CI/CD solution - Hourly
Gsuite custom app - Fixed
Plivo/Mautic Help Needed - Hourly
Adobe Esign Individual Account Bulk Document Download - Fixed
ACF relationship field get IDs - Hourly
Data Collector for Dev Ops Toolset on Google Cloud Services - Hourly

Similar Projects

data mining

Look in our CSV File the name and address of our clients and mine telephone numbers from the following websites (and others if you can come up with more):
(removed by Toogit admin)
Also, I would like to have a Specialist to start finding the...read more

Web Scraper - Researcher - Data Analysis : Scraping And Data Extraction Wanted For Career Website

I AM CREATING A CAREER DATABASE BASED ON ABOUT 1000 DIFFERENT OCCUPATIONS.

OCCUPATIONS RANGING FROM ACCOUNTANT TO ZOOLOGIST

I NEED UNIQUE CONTENT TO ADD TO EACH ONE OF THESE INDIVIDUAL OCCUPATIONS.

EXAMPLE:

OCCUPA...read more

Python+NLTK Scraping Work

I have a scraping work that needs to be completed in Python and need to use NLTK library.

I need someone who can start right away and complete fast.

Need Commercial Retail Real Estate Articles

Deliverable:
(i) Commercial real estate articles and/or papers on challenges facing retail properties (multi-tenant or single tenant) owners, both operationally and financially
(ii) Commercial real estate articles and/or papers on what trigge...read more