Gopinath M.

ABOUT ME

Dear team,
Totally I have around 12+ years of experience in Big Data Engineering & Software development with various industries domain. (Within that 2+ Years of Onsite experience with ETAS GmbH in Germany)
Key strengths:
Implemented the complete Big-data pipeline with near real-time processing using Kafka.
Condense hundreds of terabytes of log data into a consumable report
Extract Real time feed using Kafka and Spark Streaming and convert it to RDD and process data in the form of Data Frame and save the data as Parquet format in HDFS.
Used Spark and Spark-SQL to read the parquet data & create tables in hive using Scala API.
Developed Spark code in Scala using Spark SQL & Data Frames for aggregation
Worked with Sqoop to ingest & retrieve data from various RDBMS like Oracle DB & MySQL
Created schema in Hive with performance optimization using bucketing & partitioning.
TECHNICAL SKILLS:
Programming Languages: SQL, PLSQL, Scala, Python, Java, C#, VB Scripting.
DevOps Tools: Jenkins, Docker, Pentaho, Intellij
Big data Tools: Sqoop, Flume, Spark, Hbase, Kafka, Hive, Spark streaming…
Analytics Tools Tableau, Apache Spark, Excel
Certifications:
German A2.1 Language Certification.
Oracle SQL Certification.
AWS Certified Solutions Architect.
Microsoft windows server Administration.
Thank you. Regards, Gopinath. M

SKILLS