Data Engineer

Summary

I have in total of 2.5 years of Experience, My major part i have worked on was Spark with Python and Spark with Scala.
Worked on multiple types of data (csv and json mostly) and organized data into
the databases as per spark design principles with Scala and Python.
Worked on ingesting, reconciling, compacting and purging base table and
incremental table data using Hive and HBase.
Written Spark SQL and Hive QL for data analysis to meet the business
requirements.
Effectively used Kafka cluster to extract the data from it.

Expectations

Worked on multiple types of data (csv and json mostly) and organized data into
the databases as per spark design principles with Scala and Python.
Worked on ingesting, reconciling, compacting and purging base table and
incremental table data using Hive and HBase.
Written Spark SQL and Hive QL for data analysis to meet the business
requirements.
Effectively used Kafka cluster to extract the data from it.

Employment Preferences

Expected Base Salary

*,*00,000 INR

Academic Degree

Experience

Skills

• Apache Spark
• Pyspark Developer
• Python
• Hive
• Hadoop
• HDFS