Data Engineer

Job Description

Job Responsibility
Develop and design the architecture for data systems, including databases, data lakes, and data warehouses.
Create, maintain, and optimize ETL (Extract, Transform, Load) processes to ensure efficient data flow and transformation.
Collaborate closely with data scientists and analysts to understand data requirements and objectives.
Lead data refinement and enrichment initiatives, ensuring the integrity and quality of datasets.
Design, build, and maintain datasets using AWS and Dataiku platforms.
Develop scalable data systems to support multiple projects, ensuring optimal performance and efficiency.
Stay informed about industry best practices, emerging technologies, and advancements in data engineering. Apply research findings to enhance data processes.
Optimize data systems for performance, addressing bottlenecks and improving overall efficiency.
Maintain thorough documentation of data processes, systems, and configurations for knowledge sharing and future reference.
Mandatory Skills
Technical skills

Proficient in AWS services like S3, AWS Glue & Athena with hands-on experience in designing and implementing data solutions on the platform.
Expertise in using Dataiku for data preparation, integration, and advanced analytics.
Strong programming skills in languages such as Python (PySpark), SQL or Scala.
Experience with data modeling, ETL processes, and data warehousing concepts.
Ability to optimize and tune data systems for performance and scalability.
Strong understanding of cloud computing and optimization techniques.

Soft Skills:

Excellent verbal, written and presentation communication skills.
Strong oral and written communication skills required to effectively and concisely present key findings to senior management/ Client is a must.

Work in India

Work Week

Employment Options

Base Salary

1,500,000 - 2,100,000 INR

Required Academic Degree

Professional Experience

Skills

• S3
• AWS Glue
• Athena
• Dataiku
• Python
• PySpark
• SQL
• Scala