Looking for developer to can developer a scrap that can scrap millions of product details from Amazon ..
Looking for someone who has experience scraping large amount of data with proxy rotation, capacha solving and other methods. Scrap will have wrapper API so it can take custom input request for scraping and also some scraping will run automatically on schedule.
I am ok with any framework, language, library. Let me know what language / framework / library you plan to use. Also write 'iread' before application and also let me know if you have experience scraping large amount of data from Amazon. You should also know how to setup code on cloud using AWS, Google CLoud or Heroku.. Caching should be implemented to improve scraper speed and performance for repeated requests..
I have some old code in python / scrapy which might be reusable but I am open to new solution ..
About the recuiterMember since Nov 11, 2022 Assam Bank
from Latium, Italy