Data Engineer, Bigdata Engineer, BigData Developer
Summary
Having 2 years of working Experience in Big Data Development.
Expert in development of solutions for Big Data using the Hadoop technologies like HDFS,
Hive, Sqoop,Spark.
Involved in creating Hive tables, data loading and Hive queries and Managed Hive tables.
Hands-on on Sqoop Incremental imports, Modification imports and serialization.
Experience in creating tables, partitioning, bucketing, loading and aggregating data using Hive.
Developing Spark programs using Python to compare the performance of spark with Hive and SQL.
Hands on experience on Spark RDD operations and schema evolution.
Capable of processing large sets of Structured, Semi-structured data.
Spark-Hive integration functions.
Working Knowledge with Spark DataFrames and Datasets.
Developing Spark Scripts as per Client Requirement
Working on AWS Components like S3, EC2, EMR.
Performed Import and Export of remote data to AWS S3.
Developed Spark code and deployed it in EMR.
Experience in working with the Different file formats like CSV, AVRO, XML, JSON, PARQUET.
Strong data base work experience in Oracle.
Attending daily standup meeting and updating daily activities in JIRA tool for tracking by Agile
Expectations
Spark, Pyspark, Python, SQL, Hive, BigData, AWS Cloud, Azure Cloud ect.,
Employment Preferences
Expected Base Salary
**0,000 INR
Academic Degree
Experience
Total Professional Experience
Startup Experience
Big-Tech Companies
Enterprise Experience
Skills
Contacts are hidden
Send a connection request to the candidate to get their contact details.
Contact Candidate