Priyanka C. - Hadoop Developer

Priyanka C.

Hadoop Developer

India | Asia/Kolkata (INR)

$6/hr
Full-time : 30+ hrs/week
0, Followers

ABOUT ME

• 6+ years of experience in the field of IT including two and half years of experience on Big data Hadoop eco system.
• Experienced in using different programming languages Scala, Python, Core Java and SQL.
• Good knowledge of Hadoop Architecture and expertise in using various components such as HDFS, YARN, Spark, MapReduce, Hive, Impala, HBase, and Kafka.
• Extensive work in ETL process consisting of data transformation, data sourcing, mapping, conversion and loading using Spark API.
• Expertise in developing data driven applications using Spark with Scala on Jupiter Notebooks.
• Expertise with data visualization and analysis tools like Tableau and RStudio.
• Well versed with Optimizing and performance tuning of Spark and Hive jobs running on Hadoop.
• Expertise in MapReduce programs in HIVE and PIG to validate and cleanse the data in HDFS, obtained from heterogeneous data sources, to make it suitable for analysis.
• Analyzed or transformed stored data by writing MapReduce jobs based on business requirements.
• Worked with Big Data Spark applications on cloud through Amazon Web Services (AWS) EMR and S3.
• Experience in developing Pig scripts and Hive Queries.
• Managing and scheduling batch Jobs on a Hadoop Cluster using Oozie.
• Hands on experience working with NoSQL database including MongoDB and HBase.
• Experience in optimizing Spark jobs by using different optimization techniques.
• Participated in multiple big data POCs to evaluate different architectures, tools and vendor products.
• Hands on experience in using Sqoop to import data into HDFS from RDBMS and vice-versa.
• Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
• Well versed in developing the complex SQL queries using Hive and SparkSQL.
• Experienced in preparing and executing unit test plan and unit test cases during software development.
• Strong understanding in Object-Oriented Programming concepts and implementation.
• Experience in providing training and guidance to new team members in the Project.
• Experience in detailed system design using use case analysis, functional analysis, modeling program with class & sequence, activity and state diagrams using UML and rational rose.

SKILLS