Create E-commerce site crawling Framework. We are looking to develop python scrapy based framework to crawl data from e-commerce sites. The site we want to scrap has very good anti-crawl mechanisims, lot's of API requests has to be made to get data, x-path's are bound to change frequently. So use xpath in a seperate json file, so it would be easy to modify.
We have 12-14 sites to be scraped. Following details are to be scraped:
1) Available_sizes
2) Price
3) URL
4) Normalized_sizes (UK, EU and US)
5) Currency
6) Stock
7) Discounted_price
8) Release_date
9) Release_timestamp
10) Retailer
11) Title
12) Description
13) Product Images
14) Style Code
15) ASIN/EAN/UPC
16) Colors
17) Brand Name
Deliverables:
complete source code in python using scrapy framework
data in json format. (JSON schema will be shared after starting the work)
Budget:
$100/site (I am happy to listen to offers or high bid)
About the recuiterMember since May 20, 2018 Rajiv Sharma
from Aragua, Venezuela