Remote Data Mining And Management Job In Data Science And Analytics

Web Scraping - Python Scrapy

Find more Data Mining And Management remote jobs posted recently Worldwide

Create E-commerce site crawling Framework. We are looking to develop python scrapy based framework to crawl data from e-commerce sites. The site we want to scrap has very good anti-crawl mechanisims, lots of API requests has to be made to get data, x-paths are bound to change frequently. So use xpath in a seperate json file, so it would be easy to modify.
We have 12-14 sites to be scraped. Following details are to be scraped:
1) Available_sizes
2) Price
3) URL
4) Normalized_sizes (UK, EU and US)
5) Currency
6) Stock
7) Discounted_price
8) Release_date
9) Release_timestamp
10) Retailer
11) Title
12) Description
13) Product Images
14) Style Code
15) ASIN/EAN/UPC
16) Colors
17) Brand Name

Deliverables:
complete source code in python using scrapy framework
data in json format. (JSON schema will be shared after starting the work)

Budget:
$100/site (I am happy to listen to offers or high bid)
About the recuiter
Member since May 20, 2018
Rajiv Sharma
from Aragua, Venezuela

Skills & Expertise Required

Data Science & Analytics Data Mining & Management 

Candidate shortlisted and hiredHiring open till - Apr 28, 2021

Work from Anywhere

40 hrs / week

Fixed Type

Remote Job

$69.55

Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Similar Projects

Looking for a Google Sheet Expert and/or Excel Sheet Expert

Hello computer geniuses,

We are looking for an expert at entering formulas in google spreadsheets and/or excel spreadsheet to create a button that will grab all the data on one tab and populate it in another tab.

We have created a v...read more

expert needed for implementation of google tag manager (cross domain)

I need to setup google tag manager on our system. we need to track activity on our site, and possibly add cross domain.

Urgent web scraping

Need a good developer with python and automation skills for web scraping.