Data Engineer

Summary

Highly enhanced Data Engineer with over 2.6 years of professional experience in the IT industry, specializing in PySpark and Cloud services, specifically Amazon Web Services (AWS). Skilled in building data pipelines using AWS services and writing data extraction logic in PySpark. Demonstrated experience in handling large amounts of structured and unstructured data, integrating data from diverse sources, and performing data transformations to derive valuable insights. Proficient in AWS services such as S3, EC2, AWS EMR, RDS, Redshift, Glue, Lambda, SQS, SNS, and DMS.
Experienced in working with Spark architecture, including Spark-Core and Spark-SQL. Knowledgeable in file compression techniques and various file formats like ORC, Parquet, and AVRO. Capable of exploring and understanding new business domains and technologies. Skilled in data flow, data pipeline, and workflow management using tools like Jira. Familiarity with Agile/Scrum methodology and hands-on experience with Unix/Windows operating systems.
Analytical mindset, strong problem-solving abilities, and a continuous learner with a commitment to professional development. Proven ability to optimize data processing using PySpark's built-in functions. Effective communicator and a collaborative team player.

Expectations

I'm living in Bangalore. Because of some family reason I need to be there that's why I'm looking for Maharashtra location.

Employment Preferences

Expected Base Salary

**0,000 INR

Academic Degree

Experience

Skills

• Pyspark
• Spark
• Python
• SQL
• AWS Services
• Databricks