We would like to have a system that detect bots and fight them. The same way as cloudflare is trying to do with their 'fight mode'
KNOWLEDGE
You need to have some knowledge of Amazon DynamoDB, Amazon Kinesis Data Firehose, Amazon Kinesis Data Analytics, AWS Firewall Manager, AWS Shield, and AWS WAF, or any other alternative.
FEATURES REQUESTED:
- Being able to make difference between data centers, TOR or residential IPs
- Having some bot traps. If the bot goes to hidden pages/directories like: /images/ it gets blocked.
- Having the option to REDIRECT those bots without them knowing OR having high performance computing challenge
- Having black list but also a white list.
- Google, Twitter, Facebook, Pinterest.. should be in the White list
- A Residential ip should be banned 48 hours.
- If the bot scrape to many pages, It should trigger the Alarm and offer him a challenge.
- More the bot trigger an alarm more the ban should be longer.
- Being able clean the database automatically
- All this process should be automatically to avoid manually work.
- If you want to add AI to the system feel free.
- Any other cool features are welcome.
Thanks
About the recuiterMember since Mar 14, 2020 A Rehman
from Talofofo, Guam