Remote Network And System Administration Job In IT And Networking

Train me on hadoop ecosystem.

Find more Network And System Administration remote jobs posted recently Worldwide

1. Sourcing data from multiple system into different file formats.
2. Ingesting the extracted data into hadoop cluster (csv, xml, json, fixed width etc)
3. Using mapreduce, pig to transform the data and load it into mpp.
4. Stitch all above into one process using schedulers.


About the recuiter
Member since May 20, 2018
Atul Shah
from Nordrhein-Westfalen, Germany

Skills & Expertise Required

Apache Flume Apache Hive Apache Spark Hadoop Hbase 
Open for hiringApply before - Aug 20, 2024

Work from Anywhere

40 hrs / week

Hourly Type

Remote Job

$19.16

Cost

Offer to work on this project closes in 103 days!
Are you interested in this Opportunity?

Looking for help? Checkout our video tutorial
How to search and apply for jobs

How to apply? Do you have more questions about the Job?
See frequently asked questions

Other jobs by this client

Shopify Fastlane Theme Integration - Fixed
Expand Oracle Virtual machine on windows - Hourly
Brand Strategist - Intern Abroad for Game Developers - Fixed
Transform Excel to PDF report - Fixed
Looking for a video editor for an up and coming sports based youtube channel. - Fixed
need a design for brand logo - Fixed
Extract data and pictures from websites and structure the data - Fixed
Construction Estimator - Hourly
Linear project data collection and communication - Hourly
Firmware Developer for LPT230 module - Fixed
CAD designer to create a 3D visualization of a living room - Fixed

Similar Projects

Data Engineer

We are looking for a freelancer who has proven experience in Data Engineering projects.

The requirements we are looking for:
- Experience with Python
- Experience with Big Data tools (eg: Hadoop, Cassandra, Kafka)
- Experience wi...read more

Converting JSON or Avro files to Parquet

I need to convert JSON, Avro or other row-based format files in S3 into Parquet columnar store formats using an AWS service like EMR or Glue.

I already have code that converts JSON to parquet using Python but the process is very manual, acco...read more

Hadoop: Need a subject matter expert to review multiple choice questions on big data technologies.

We are looking for consultants to review our Multiple Choice Questions based assessment on the Apache Hadoop and its related technologies. We will share the questions with the expert and he/she will have to critically review the questions.

Data Engineer

We are looking for a freelancer who has proven experience in Data Engineering projects.

The requirements we are looking for:
- Experience with Python
- Experience creating ETL workflows
- Experience with Big Data tools (eg: Hadoo...read more

Submit A Proposal