Data Engineer

BigData Development Mississauga, Ontario, Canada

Profile
Contacts

Summary

I am a highly skilled and experienced data engineer with a strong background in data management, warehousing, and analysis. Throughout my career, I have demonstrated a deep understanding of data engineering concepts and have been able to apply them in various projects. I have experience in designing, developing and maintaining data pipelines using different technologies like Spark, Hive, Pig, Sqoop and Kafka. I have also worked with big data platforms like Hadoop, Yarn and HDFS. I have experience with cloud platforms like AWS and Azure. I have strong familiarity with data modeling, database design and data warehousing. I have strong analytical and problem-solving skills, and I am able to extract insights from large data sets. Additionally, I have a good understanding of machine learning and data visualization tools.

Expectations

In my search for a new role, I am targeting Data Engineer positions where I can leverage my extensive experience and skills in data warehousing, ETL development, and cloud-based data solutions. With nearly five years of hands-on experience, I excel in optimizing ETL pipelines, building complex data marts, and developing robust data analytics platforms utilizing various cloud services such as AWS (including Glue, S3, Redshift) and Azure (including Data Factory, Synapse). I have a strong command of programming languages such as Python, SQL, and Pyspark, and I am adept at utilizing tools like Spark, Hive, Hadoop, and Airflow for big data processing and orchestration. My recent roles have involved leading teams in designing and implementing data analytics platforms, handling large volumes of data, and ensuring efficient data governance practices. I am eager to contribute my expertise to a dynamic team in Canada, where I can continue to drive innovation and solve complex data challenges.