Data Engineer

Summary

5 years IT experience working as Azure Data Engineer (ADE), 5 years in Azure Data Factory and a year experience in Azure Databricks orchestrating data pipelines (Data Extraction, Transformation, Loading, Transformation, Visualization and Reports) using Azure Cloud.

One of my latest achievement is achieving a cost savings of 30%, improving operation efficiency by 17% and creating new insights for revenue stream for my client.

By interpreting the client business requirements into technical requirements and solution. I built an ETL pipeline to extract data from a legacy on-premise database , by performing a batch copy of the data into Azure Data Lake Gen2, mounting ADLS Gen 2 Storage on Azure Databricks to read the data and perform some transformations(drop irrelevant columns, and create new required columns and finally perform necessary aggregations functions) then load the curated data into the gold storage in ADLS gen2 which was connected to Power BI to create Business reports and insight.

Expectations

I am looking up to environment that rewards achieving desirable team objectives above individual interests , that has a dynamic growth environment and future centric.

Employment Preferences

Expected Base Salary

**,000 USD

Expected Hourly Rate

** USD/hr

Academic Degree

Experience

Skills

• In Azure Cloud Data Services Including Azure Data Factory V2
• Azure Databricks
• Medallion Architecture
• Apache Kafka
• Apache Airflow
• Azure Data Lake Gen2
• AWS S3 Bucket
• Azure Key Vault
• Azure Active Directory
• Microsoft Entra ID
• Azure Blob Storage
• Azure SQL Database
• Microsoft SQL Server Management Studio
• SQL
• Python
• Pyspark
• Spark. SQL
• Creating Delta Tables
• Data Migration
• Batch
• Sequential Loading
• Incremental Loading
• Using Change Data Capture
• Slowly Changing Dimensions
• Date- Time Method
• Data Visualization
• Power BI
• Data Quality