As a Data Engineer, you'll focus on designing and building data pipelines that help organizations manage their data effectively. This role is ideal for those who enjoy coding and have a strong understanding of data systems.
The Data Engineer role at Swan iT Recruitment Ltd in Cape Town is centered around creating and maintaining data pipelines that are essential for data management and analysis. You will be responsible for designing, building, and maintaining ETL/ELT processes using tools like Azure Data Factory and Databricks. This position requires a solid understanding of SQL for data modeling, transformation, and reporting, ensuring that the data is accurate and accessible for stakeholders.
In your day-to-day work, you will collaborate with other data professionals to integrate APIs and ensure seamless data flow across systems. Your tasks will include writing efficient SQL queries, troubleshooting data issues, and optimizing data processes to enhance performance. The role suits individuals who are detail-oriented and have a passion for working with data technologies.
Key responsibilities include: • Designing and building ETL/ELT data pipelines • Writing SQL for data transformation and reporting • Integrating APIs to facilitate data flow • Collaborating with teams to improve data processes
To succeed in this role, you should have practical experience with Azure Data Factory, Databricks, and API integration. Familiarity with Azure DevOps is a plus. This position is not entry-level friendly, so a background in data engineering or a related field is preferred.
You'll be taken to the original listing on PNet to apply.