Remote Data Mining And Management Job In Data Science And Analytics

Engineer/dev-ops experience writing Python code for data ingestion/processing

Find more Data Mining And Management remote jobs posted recently Worldwide

Looking for an experienced python developer to help with a data ingestion process. Needs:
- Data Engineering with Python 3
- Both Functional and OOP Algorithms
- Packaged with modules
- Advanced data structures
- Incorporate JSON control file
o how to validate/QA/cleanse erroneous or poor formatted incoming CSV files
o process & pipeline movement of data with compression, formats, local or remote destination, etc.
o error reporting (multiple file logging, email)
- Batchable (non-interactive) & interactive command-line driven
- CSV data cleaning/correcting
o Tracking all the cleaning operations performed on the data
o Tracking/reporting errors
- In-line/by-record Data transformations
- Familiarity of dev environments in Linux, git, and Linux/bash scripting
- AWS experience, such as S3 is an advantage
- AWS Lambda, Glue/Athena (Apache Hive) is an advantage
- multiprocessing in Python is an advantage
About the recuiter
Member since Mar 14, 2020
Reza Shokrollah
from Suceava, Romania

Skills & Expertise Required

Data Science & Analytics Data Mining & Management 

Candidate shortlisted and hiredHiring open till - Apr 16, 2024

Work from Anywhere

40 hrs / week

Hourly Type

Remote Job

$26.83

Cost

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Similar Projects

Web researcher

Our business is expanding and we require someone to help us grow by searching the right contacts through the web.
This is an ongoing full-time time job. We will start part-time 2h day, then 4h and then full-time 8h as we grow confidence on the ca...read more

Finding fall down video clips

People fall down video clips (natural) that last for few seconds, and include different kinds of fall down positions;
and people likely to fall down but not fall down the dataset (e.g., human hit a stone and almost fall), 100 clips each.

Experienced developer needed to enhance an existing R application with Visuals/Graphs

We are looking for an experienced R specialist to develop an existing application. This exciting project has two dimensions:

1- Sanity check and Debugging of the code (1500 lines)
2- Write a documentation
3- Improve the error handli...read more