Search & apply Apache Spark jobs online posted on Toogit, Create a free account today, & apply on the popular Apache Spark work that you love to do remotely.
Posted at one week ago
I am looking for a Hadoop Sr Architect/Consultant who has some good hands on Spark, Kafka, BI(OpenSource Stack)
Apply On This JobPosted at one week ago
Consulting for 2 hours approx in scala spark predictionIO. please apply if u are really experienced. need consultation over skype
Apply On This JobPosted at one week ago
i wan someone to use hadoop and spark for data mining and real time analysis respectively. freelancer must be a prodigy and self confident about what should be done its a long project..
Apply On This JobPosted at 2 weeks ago
Looking for experienced developer on spark and scala with coding knowledge and implementation towards UDFs, UDTFs, UDAFs, actions, transformation, parallize on flatfiles, DBs, Hive tables and impact on memory optimization
Apply On This JobPosted at 2 weeks ago
Description:We have a running environment with MySQL db and we are starting to ingest more data than the db can handle, so we are looking for alternatives to architect Hadoop/Spark environment to offload most of that data into a Hadoop cluster.Activities:- Analyze our db and find the data that can be sent to Hadoop- Build a Hado...read more
Apply On This JobPosted at 3 weeks ago
I am looking for a Hadoop developer with Java and scala experience. Looking for someone who have good experience and can take the pressure. This is a full time support and looking for someone who can work new york standard time from Mon thru Friday from 10 to 5 eastern time. Please don't waste my time and your time, if you are...read more
Apply On This JobPosted at 3 weeks ago
I will share my use case and am looking to build out Advance analytics and BI platform that's cost-effective yet viable (capable of working successfully) and scalable with shortliste candidates. Current Use Case is to collect data from CRM service providers like SalesForce &Microsoft CRM 365 and then transform into meaningful da...read more
Apply On This JobPosted at 3 weeks ago
We are looking for subject matter experts to review our Big Data Engineer interview screen tests: Spark-Python and related topics. These questions will be used as interview questions in a hiring process and we need to be sure that the problem statements, codes, options and the answer are all valid and correct.We have set of 10 q...read more
Apply On This JobPosted at one month ago
Consulting for 2 hours approx in scala spark predictionIO. please apply if u are really experienced. need consultation over skype
Apply On This JobPosted at one month ago
1. Sourcing data from multiple system into different file formats.2. Ingesting the extracted data into hadoop cluster (csv, xml, json, fixed width etc)3. Using mapreduce, pig to transform the data and load it into mpp.4. Stitch all above into one process using schedulers.
Apply On This JobPosted at 2 months ago
Install spark on yarn - cdh 5.11 small t&d cluster 4 node env on Ubuntu. Need To configure spark on yarn gateways etc and basic tuning.
Apply On This JobPosted at 2 months ago
I need to convert JSON, Avro or other row-based format files in S3 into Parquet columnar store formats using an AWS service like EMR or Glue.I already have code that converts JSON to parquet using Python but the process is very manual, accounting for NULL values in the JSON elements by looking at each and every field/column and...read more
Apply On This JobPosted at 3 months ago
I am looking for a Hadoop developer with Java and scala experience. Looking for someone who have good experience and can take the pressure. This is a full time support and looking for someone who can work new york standard time from Mon thru Friday from 10 to 5 eastern time. Please don't waste my time and your time, if you are...read more
Apply On This JobPosted at 3 months ago
Looking for experienced developer on spark and scala with coding knowledge and implementation towards UDFs, UDTFs, UDAFs, actions, transformation, parallize on flatfiles, DBs, Hive tables and impact on memory optimization
Apply On This JobPosted at 4 months ago
Hi, what I need is the following: - I need a helm script (kubernetes) which 'installs' the latest spark version as yarn cluster on kubernetes - This setup should provide Zeppelin - All of this has to work with sparks latest structured streaming framework and should be able subscribe a kafka topic - Confluent is used as kafka pro...read more
Apply On This JobPosted at 5 months ago
I am looking for a Hadoop developer with Java and scala experience. Looking for someone who have good experience and can take the pressure. This is a full time support and looking for someone who can work new york standard time from Mon thru Friday from 10 to 5 eastern time. Please don't waste my time and your time, if you are...read more
Apply On This JobPosted at 6 months ago
Require an experienced java technical architect with over 10 years of experience , must be excellent in trouble shooting skills especially peformance related issues
Apply On This JobPosted at 6 months ago
I will share my use case and am looking to build out Advance analytics and BI platform that's cost-effective yet viable (capable of working successfully) and scalable with shortliste candidates. Current Use Case is to collect data from CRM service providers like SalesForce &Microsoft CRM 365 and then transform into meaningful da...read more
Apply On This JobPosted at 6 months ago
Hi, what I need is the following: - I need a helm script (kubernetes) which 'installs' the latest spark version as yarn cluster on kubernetes - This setup should provide Zeppelin - All of this has to work with sparks latest structured streaming framework and should be able subscribe a kafka topic - Confluent is used as kafka pro...read more
Apply On This JobPosted at 6 months ago
Hi, what I need is the following: - I need a helm script (kubernetes) which 'installs' the latest spark version as yarn cluster on kubernetes - This setup should provide Zeppelin - All of this has to work with sparks latest structured streaming framework and should be able subscribe a kafka topic - Confluent is used as kafka pro...read more
Apply On This JobCreate a free profile to broadcast your skills, experience, and desired pay rate to clients with Apache Spark expertise. You choose the payment method that's best for you to easily get paid for your online work.