I need a script in python to remove deleted markers in S3 bucket. Here are the criterias for me:
1) i like to specify the bucket or folder
2) i like to specify the time range, example between two different dates/times
3) script must be able to distinguish between IsLatest vs all deleted markers for a file. Certain files might have multiple deleted markers.
4) when having thousands of files in bucket I need the script to be able to run parallel tasks at the same time. I am using aws cli command and I can execute in parallel aws cli execution but its very slow as each command has to establish s3 bucket connection etc, hoping that python can help me. I like to be able to specify how many parallel tasks to run based on my cpu speed.
5) i am using different profiles for different environments, so script needs to be able to specify profile
About the recuiterMember since May 20, 2018 Senthil Kumar
from Centre, France