Azure Data Engineer

Job Description

Job Title: Azure Data Engineer (Remote)
Location: Remote

Position Overview:
We are seeking a talented Azure Data Engineer to join our team remotely. As an essential member of our data engineering team, you will be responsible for designing, developing, and maintaining end-to-end data pipelines on the Azure platform. The ideal candidate will have expertise in PySpark and Databricks, with a strong background in Azure services. This is a contracting position with the opportunity to work on exciting projects in a dynamic environment.

Responsibilities:

Design, develop, and implement scalable and efficient data pipelines on the Azure platform using PySpark and Databricks.
Collaborate with cross-functional teams to gather and analyze requirements for data pipeline solutions.
Optimize and tune data pipelines for performance, reliability, and scalability.
Ensure data quality and integrity throughout the pipeline by implementing appropriate validation and error handling mechanisms.
Monitor and troubleshoot data pipeline issues, proactively identifying and resolving issues to minimize downtime.
Document data pipeline architecture, design decisions, and processes for future reference.
Stay up-to-date with the latest trends and best practices in data engineering and Azure technologies.

Qualifications:

Bachelor's degree in Computer Science, Engineering, or related field.
Proven experience as a data engineer designing and implementing data pipelines.
Strong proficiency in PySpark and Databricks.
Experience working with Azure services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, and Azure Blob Storage.
Knowledge of data modeling concepts and techniques.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
Ability to work independently and as part of a team in a remote environment.
Azure certification(s) is a plus.

Work in United States

Employment Options

Professional Experience

Skills

• PySpark
• Databricks
• Data Pipelines
• Azure