Search & apply Apache Spark jobs online posted on Toogit, Create a free account today, & apply on the popular Apache Spark work that you love to do remotely.
Posted at one week ago
I am looking for a person who will help me finish the project. Here's what to do: - develop a connection to the MongoDb database- develop API to support the user, save, delete, modify, get information about user from MongoDB- develep front-end applications supporting API- running all application modules on spark. Currently, I ca...read more
Apply On This JobPosted at 3 weeks ago
I am looking for a Hadoop Sr Architect/Consultant who has some good hands on Spark, Kafka, BI(OpenSource Stack)
Apply On This JobPosted at 3 weeks ago
Need build data migration solution for migrating data from sources flat file/JSON/XML, RDBMS, REST API endpoints to target RDBMS/Hadoop.data sources can be in on premise or cloud and solution should be able to move data to cloud as well as on premise.Note: Should also handle security while migrating data in public internet.Devel...read more
Apply On This JobPosted at 3 weeks ago
Install spark on yarn - cdh 5.11 small t&d cluster 4 node env on Ubuntu. Need To configure spark on yarn gateways etc and basic tuning.
Apply On This JobPosted at one month ago
Looking for an experienced coder, who can write code efficiently in Java and Scala for Apache Spark Streaming. He should also have a strong knowledge of kafka and should be able to create a data pipeline between kafka and spark for huge size of streaming data.
Apply On This JobPosted at one month ago
1. Sourcing data from multiple system into different file formats.2. Ingesting the extracted data into hadoop cluster (csv, xml, json, fixed width etc)3. Using mapreduce, pig to transform the data and load it into mpp.4. Stitch all above into one process using schedulers.
Apply On This JobPosted at 2 months ago
Description:We have a running environment with MySQL db and we are starting to ingest more data than the db can handle, so we are looking for alternatives to architect Hadoop/Spark environment to offload most of that data into a Hadoop cluster.Activities:- Analyze our db and find the data that can be sent to Hadoop- Build a Hado...read more
Apply On This JobPosted at 8 months ago
Hi, what I need is the following: - I need a helm script (kubernetes) which 'installs' the latest spark version as yarn cluster on kubernetes - This setup should provide Zeppelin - All of this has to work with sparks latest structured streaming framework and should be able subscribe a kafka topic - Confluent is used as kafka pro...read more
Apply On This JobPosted at 10 months ago
Require an experienced java technical architect with over 10 years of experience , must be excellent in trouble shooting skills especially peformance related issues
Apply On This JobPosted at 10 months ago
I will share my use case and am looking to build out Advance analytics and BI platform that's cost-effective yet viable (capable of working successfully) and scalable with shortliste candidates. Current Use Case is to collect data from CRM service providers like SalesForce &Microsoft CRM 365 and then transform into meaningful da...read more
Apply On This JobPosted at 11 months ago
Hi, what I need is the following: - I need a helm script (kubernetes) which 'installs' the latest spark version as yarn cluster on kubernetes - This setup should provide Zeppelin - All of this has to work with sparks latest structured streaming framework and should be able subscribe a kafka topic - Confluent is used as kafka pro...read more
Apply On This JobPosted at 11 months ago
Hi, what I need is the following: - I need a helm script (kubernetes) which 'installs' the latest spark version as yarn cluster on kubernetes - This setup should provide Zeppelin - All of this has to work with sparks latest structured streaming framework and should be able subscribe a kafka topic - Confluent is used as kafka pro...read more
Apply On This JobCreate a free profile to broadcast your skills, experience, and desired pay rate to clients with Apache Spark expertise. You choose the payment method that's best for you to easily get paid for your online work.