Required software development,Website Development freelancer for Python Developer to make changes in existing scraper job

HI,
i have already build scraper
but the site are scraping data from is keep blocking our ips
so i need to avoid bot detection
and right new we are scraping 100 links for this site every mint
i need to scrap 1000 links every mint
here is the flow
right now scraper ... scrapes 100 cars and store them in data base
then next time when scraper , scrapes data it compare the results and if the there is any new link in the list .. it update the list
i am want the same thing with 1000 links
those are main two requirements

there are one also that make the server crash .. that need to be resolved as well


I will prove all the code as well for my existing scraper

Skills & Expertise Required

software development Website Development