We are looking for an experienced Senior Data Engineer to join our growing Data Engineering team. In this role, you will design, build, and optimize scalable data platforms and pipelines that power business intelligence, analytics, machine learning, and AI solutions.
As a technical leader, you will architect robust data solutions, drive best practices, mentor junior engineers, and collaborate with cross-functional teams to deliver high-quality, production-ready data products in a fast-paced environment.
Responsibilities:
Design, develop, and maintain scalable data pipelines and enterprise data platforms.Build and manage end-to-end data pipelines, including data ingestion, transformation, and Data Marts within the Enterprise Data Warehouse.Develop and maintain API integrations to support increasing data volumes and complexity.Collaborate with business, analytics, and engineering teams to deliver reliable, accessible, and high-quality data solutions.Design and optimize data models, ETL/ELT processes, and dimensional data warehouse architectures.Implement data quality, monitoring, and governance frameworks to ensure trusted production data.Partner with Data Scientists to productionise machine learning and AI solutions.Build and maintain CI/CD/CT pipelines to automate deployment and delivery of data solutions.Troubleshoot production data issues and implement sustainable solutions.Qualifications and experience:
Bachelor's or master's degree in computer science, information technology, engineering, or a related technical discipline.5+ years of experience as a data engineer or in a similar role.5+ years of Python development experience.5+ years of Microsoft SQL Server experience (PostgreSQL is advantageous).Strong experience designing and implementing enterprise data warehouses, dimensional modelling, and schema design.Experience designing, building, and maintaining data processing systems across cloud platforms (Azure, AWS, Microsoft Fabric) and on-premises environments (Microsoft SQL Server, SSIS).Strong experience developing ETL/ELT processes and scalable data pipelines.Hands-on experience with Apache Spark.Experience implementing CI/CD/CT pipelines for automated deployment and delivery.
The reference number for this position is NG61441 which is a permanent, Hybrid role in Cape Town, offering a salary of up to R1.2mil per annum salary negotiable based on experience. E-mail Nokuthula on [[nokuthulag@ e-Merge.co.za]] or call her for a chat on 011 463 3633 to discuss this and other opportunities.
Are you ready for a change of scenery? E-Merge IT recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies, in the right roles. Check out the e-Merge IT website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals
An established and forward-thinking technology organisation passionate about innovation, quality, and delivering solutions that make a real difference is on the hunt for a C# Full...
An established and forward-thinking technology organisation passionate about innovation, quality, and delivering solutions that make a real difference is on the hunt for a C# Full...
A global leader in Customer Communications Management and engagement technology is growing their development team and looking for a talented .NET Developer to join them. This is a...
Build the backend powering the next generation of AI.
An exciting opportunity is available for a Backend Developer with strong Python experience to join a senior engineering tea...