CSG Resourcing is seeking a skilled Data Engineer to join their team in Centurion. This role focuses on designing and optimizing data pipelines using modern tools and technologies.
As a Data Engineer at CSG Resourcing, you will play a crucial role in designing and building scalable data pipelines. Your main tools will include Databricks and Azure Data Services, where you will implement advanced ETL and ELT processes to manage data from various sources, including SAP. This position is ideal for someone who enjoys working with data and has a strong technical background.
Your daily responsibilities will involve: • Designing and managing robust data pipelines using Databricks and Delta Live Tables. • Implementing ETL/ELT processes to transform and ingest data efficiently. • Utilizing Unity Catalog to ensure data governance and manage access controls.
To succeed in this role, you should have at least 5 years of experience in data engineering, with a solid understanding of Spark-based processing and programming in Python and SQL. A Databricks certification is preferred, which will enhance your credibility in this position. This role is suited for mid-level professionals who are eager to work with cutting-edge data technologies and contribute to innovative data solutions.
You'll be taken to the original listing on PNet to apply.