CSG Resourcing is seeking a skilled Data Engineer to join their team in Centurion. You'll work closely with data analysts and business stakeholders to create reliable data pipelines and ensure data quality.
As a Data Engineer at CSG Resourcing, you will play a crucial role in building and optimizing data pipelines that support various business functions. Your day-to-day tasks will involve collaborating with data analysts, scientists, and business stakeholders to ensure that the datasets you deliver are clean and trustworthy. This role is ideal for someone who enjoys working with data and has a strong technical background in modern data engineering tools.
In this position, you will design and manage scalable data pipelines using Databricks and Azure Data Services. You will implement advanced ETL/ELT processes to ingest and transform data from multiple sources, including SAP. Additionally, you will work with Unity Catalog to manage data governance and access controls, ensuring that data lineage is maintained across different environments.
To succeed in this role, you should have at least 5 years of experience in data engineering, with a strong focus on Databricks and Spark-based processing. Proficiency in Python and SQL is essential, as you will be writing scripts and queries to manipulate data effectively. Experience with Azure Data Factory or Fivetran will be beneficial, but the primary requirement is a solid understanding of data engineering principles and practices.
If you are a proactive problem-solver who thrives in a collaborative environment, this role could be a great fit for you. Join CSG Resourcing and contribute to building robust data solutions that drive business insights.
You'll be taken to the original listing on PNet to apply.