Data Engineer

Job Description

Are you passionate about data and its journey from source to actionable insights?

We are seeking a Data Solutions Engineer with a deep understanding of best practice business intelligence implementations.

The ideal candidate has a passion for data, thrives on continuous learning, and is adept at navigating multiple business units to drive strategic insights.

If you excel in communication and data analysis and are looking to elevate your career in a dynamic environment, this is the perfect opportunity for you.

Position details:

Type: Permanent
Primary Purpose: In this role, you will be responsible for transforming (big) data from multiple sources into reliable assets aimed at driving business evolution. You'll collaborate with top-notch Solution Architects to design and implement cutting-edge cloud, hybrid, and on-prem solutions. Your work will span across the full spectrum of descriptive, diagnostic, predictive, and prescriptive analytics, leveraging advanced technologies such as ML, AI, cognitive services, and data science. You'll also ensure data lineage and metadata are maintained effectively and develop impactful dashboards for business.

Job description / core competencies:

Delivery

Wrangling (big) data from multiple sources into a reliable asset that is aimed at evolution instead of maintaining a status quo

Working together with our best-of-breed Solution Architects to design and implement state-of-the-art cloud, hybrid and on-prem solutions

Designing and implementing the best possible data pipelines for each data source and data store, as well as delivering impactful advanced analytics using ML, AI, cognitive services, and data science

Working along the full spectrum of descriptive, diagnostic, predictive and prescriptive analytics

Familiarising yourself with ML algorithms and AI approaches like clustering, regression, classification, speech recognition, OpenAI, LLMs, vision, search, and translator

Understanding DataOps and MLOps approaches to ensure our solutions will continuously be deployed in short delivery cycles with maximum business impact and the highest quality standards possible

Ensuring data lineage and all metadata is maintained effectively

Designing and developing the sexiest possible dashboards for business

Using your combination of technical and data analytics expertise to improve existing or proposed business innovations

People

Working with multi-skilled teams that contain experts from neighboring crafts like Software Engineering, User Experience and Quality Assurance

Demonstrating maturity and soft skills like time management and motivation

Influencing change within your team

Building relationships and collaborating within your team

Working with teams to solve complex business problems, and make an impact, while pushing yourself and others to become more

Coordinating with teams to meet quality standards and timelines

Mentoring and growing others

Holding others accountable to a standard of excellence

Galvanising team members

Customer

Being pragmatic in making the best technological choices for the customers needs

Identify opportunities for service improvements and strategic alignment

Providing insights to business owners to validate their ideas and guide them to make the most informed decisions possible with the most desirable outcome

Being prudent when it comes to data governance. We want to ensure that our customers can fully trust the data assets that we build out for them

Flexing your story-telling muscle when assembling the presentation layer for business owners

Location: Johannesburg & Cape Town

Job Qualifications, Skills & Experience:

A bachelors degree in IT, Engineering or other Sciences

Minimum 4 years of experience working as a data solutions engineer within an enterprise environment

Experience working in a delivery team together with other disciplines to deliver a product

Strong ability to model and analyse data

Solid understanding of data engineering methodologies

Good understanding of visualisation best practices

A desire to design and implement modern advanced analytics solutions and modern data warehousing solutions

Strong attention to detail but viewed from a bigger picture perspective

To collaborate and bring your unique contributions to a team environment

An ambition to continually improve your skills, embrace challenges and be driven by excellence

Technologies: Cloud environments: Azure, AWS, Google Front-end tech: Power BI, Microsoft Fabric, Amazon Quicksight, Google Data Studio, Grafana Languages: SQL, Python, Scala Data processing: Azure Data Factory, Amazon Glue, Apache Airflow, Databricks, Spark SQL Relational databases: MSSQL, PostgreSQL, Oracle, MySQL, Azure SQL, Amazon RDS NoSQL databases: MongoDB, Cosmos DB, DynamoDB, Neo4j Streaming: Azure Stream Analytics, Kafka, Databricks streaming, Spark streaming, Google Dataflow, Amazon Kinesis ML Platforms: Azure Machine Learning, Databricks ML, Amazon Sagemaker, Dataiku AI: Azure OpenAI, Azure Cognitive Services, AWS Cognitive Services, Google Cognitive Services

Work in South Africa

Employment Options

Required Academic Degree

Professional Experience

Skills

• Cloud
• Azure
• AWS
• Google Front-end Tech
• Power BI
• Microsoft Fabric
• Amazon Quicksight
• Google Data Studio
• Grafana Languages
• SQL
• Python
• Scala Data Processing
• Azure Data Factory
• Amazon Glue
• Apache Airflow
• Databricks
• Spark SQL Relational Databases
• MSSQL
• PostgreSQL
• Oracle
• MySQL
• Azure SQL
• Amazon RDS NoSQL Databases
• MongoDB
• Cosmos DB
• DynamoDB
• Neo4j Streaming
• Azure Stream Analytics
• Kafka
• Databricks Streaming
• Spark Streaming
• Google Dataflow
• Amazon Kinesis ML Platforms
• Azure Machine Learning
• Databricks ML
• Amazon Sagemaker
• Dataiku AI
• Azure OpenAI
• Azure Cognitive Services
• AWS Cognitive Services
• Google Cognitive Services