Big Data Engineer

Summary

Developed framework to read the data from file and load in hive tables using spark scala.
Developed framework to extract the data from hive tables and write into file.
Developed Hive queries to analyse large datasets.
Worked on various optimization techniques to run our job much faster and efficient.
Worked on ingesting the data from RDBMS to HDFS using Sqoop.
Applying SQL to query databases, cleanse, test and align data from different sources.
Worked on UCD to deploy our code
Worked on Autosys tool to schedule job in production

Expectations

I'm looking for an opportunity to grow as a professional.

Employment Preferences

Expected Base Salary

*,*00,000 INR

Academic Degree

Experience

Skills

• Spark
• Scala
• Hive
• Impala
• Sql
• Sqoop
• Hadoop
• HDFS
• Autosys
• Linux
• Shell Scripting