Find more Network And System Administration Remote Jobs posted recently Worldwide

Required Amazon EC2,Amazon S3 freelancer for Automation of ETL process based in AWS based on S3 and Redshift job

Posted at - Sep 15, 2022

Toogit Instant Connect Enabled


We are looking for an engineer with experience in setting up ETL processes in AWS allowing simple integrations with multiple entities with different policies.

The project will consist in setting up production-ready MVP infrastructure using existing AWS tools (i.e. Glue, etc) within a 1-2 week period working alongside our team.

If this initial project is successful there we are also looking for an opportunity to develop a long term collaboration.

Project Details:

(i) Different entities will be sharing two types of structured files (.csv) so we can load them in S3 buckets periodically (most likely on a daily basis).
(ii) These files would need to be aggregated and processed into a unique well-formatted file living in AWS (preference for Amazon Redshift).
(iii) An additional processing step will take place on this Redshift instance to create an output file to be send to the same SFTP connection.
(iv) Policies on access would need to be managed for all existing partners.

We have the the logic for all the aggregation and processing stages but mostly need help to create a stable MVP version on AWS separating Staging and Production environments.

About the recuiterMember since Mar 14, 2020 Farooq Ahmad
from Tamil Nadu, India

Skills & Expertise Required

Amazon EC2 Amazon S3 

Candidate shortlisted and hiredHiring open till - Oct 15, 2022

Work from Anywhere
40 hrs / week
Hourly Type
Remote Job
$14.09
Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions


Apply on more work from home jobs posted in Network And System Administration category.