Data engineer

Summary

Lead Data Migration and Generative AI Projects: Manage data migration and AI initiatives for
a top telecom client, focusing on data curation, ETL, and cleansing using Python, Snowflake,
and Databricks and Skilled in extracting data from APIs.
Proficient in Snowflake Utilities and Snow-SQL: Expertise in Snowflake utilities and Snow-SQL
techniques using Python, with a deep understanding of Snowflake Data Warehouse, ETL
concepts, and data modelling principles.
Expert in Data Cleansing and Management: Perform extensive data cleansing and
management tasks, including curation and handling of Change Data Capture (CDC) Type 2 and
Type 3 scenarios, ensuring data accuracy and consistency.
SQL and Data Modeling: Design and implement complex SQL queries and logical data models
tailored to meet business requirements. Develop and optimize data models to support robust
analytics and reporting.
End-to-End Data Testing: Conduct comprehensive end-to-end testing of data processes from
source to target, ensuring integrity and accuracy throughout the data migration lifecycle.
Innovative Proof-of-Concept (POC) Initiatives: Participate in multiple POC initiatives to
explore and validate new technologies and methodologies in Generative AI, contributing to
the adoption of cutting-edge solutions.
Azure Data Migration Management: Schedule, create, and manage data migration jobs on
Azure, optimizing workflows and ensuring efficient data transfer and integration.
Client Collaboration: Work directly with clients to gather and refine requirements, designing
and delivering tailored solutions both individually and as part of a team.
Solution Design and Delivery: Architect and implement end-to-end data solutions,
overseeing individual and team-based deliveries to meet project goals and client
expectations.
Data Acquisition and Pre-Processing: Demonstrated ability to acquire and pre-process data
from various sources, including web scraping and API integration, using Python libraries.

Expectations

For better role and better compansation,and also I want to explore the new skills.

Employment Preferences

Expected Base Salary

*,*00,000 INR

Academic Degree

Experience

Skills

• Snowflake
• Python
• Pyspark
• Databricks
• Azure Data Factory
• Data Modelling
• Data Warehousing