This is just a trial project we have continuous scraping work
We have a suite of Python tools running to scrape the websites of various companies to extract price intelligence.
We are looking for people to help configure/rewrite our existing toolset as necessary, but primarily to help in the ongoing maintenance of web scraping. We expect this could be a regular 1 day a week to monitor the results and make adjustments, ad-hoc 2 or 3 days writing and testing of scripts as we add new urls, Blocks of 5 to 10 days as we either upgrade our existing code or re-platform.
Essential is experience of Python + Selenium + Chrome to scrape websites that use Javascript and have a variety of anti-bot measures
Desired is experience of GCP VMs, ProxyIPs/VPNs,
Desired is experience of Crawler & Scraping hub developer tools
Please submit some examples of code and results
About the recuiterMember since Mar 14, 2020 Anshul Kumar
from Uttar Pradesh, India