Search & apply Pyspark jobs online posted on Toogit, Create a free account today, & apply on the popular Pyspark work that you love to do remotely.
Posted at 2 months ago
I need to convert JSON, Avro or other row-based format files in S3 into Parquet columnar store formats using an AWS service like EMR or Glue.I already have code that converts JSON to parquet using Python but the process is very manual, accounting for NULL values in the JSON elements by looking at each and every field/column and...read more
Apply On This JobPosted at 6 months ago
Need an expert Data background ML engineer who has the following skills - Python3+, Spark3+, DataBricks, ReactJS, MLib, Sphinx. We have a performance requirement of processing 3Million records in 1 min or under so only who have work experience in high scalable enterprise projects, please apply.Else please dont waste time.Skill S...read more
Apply On This JobPosted at 9 months ago
We are looking for a superstar software engineer, with strong hands-on experience writing production-quality code in Scala & Python. This project involves a library & use cases for natural language processing and machine learning on top of Spark, so knowledge in these areas is a strong plus. Proven experience and/or an advanced...read more
Apply On This JobCreate a free profile to broadcast your skills, experience, and desired pay rate to clients with Pyspark expertise. You choose the payment method that's best for you to easily get paid for your online work.