As a Data Engineer at Datafin, you'll focus on building and optimizing data pipelines and infrastructure using Microsoft Fabric. This role is ideal for someone with a strong background in data warehousing and proficiency in PySpark and Spark SQL.
Datafin is looking for a Data Engineer to join their team in Cape Town. In this role, you will be responsible for architecting and optimizing data pipelines and infrastructure within Microsoft Fabric. Your work will involve both on-premises and cloud solutions, ensuring that data flows efficiently and is readily accessible for analysis.
You will work closely with other data professionals to design and implement data warehouses, utilizing your skills in Stored Procedures and Functions. Proficiency in PySpark and Spark SQL is essential, as you will be using these technologies within notebooks to manipulate and analyze data.
This position suits someone who enjoys working with data and has a strong technical background. You should be comfortable with complex data structures and have a keen eye for optimizing data processes. If you are passionate about data engineering and want to be part of an innovative team, this role could be a great fit for you.
Key responsibilities include: • Designing and implementing data pipelines • Optimizing data warehouse structures • Writing and maintaining Stored Procedures and Functions • Utilizing PySpark and Spark SQL for data manipulation
To succeed in this role, you should have a solid understanding of data engineering principles and experience with Microsoft Fabric. This is a great opportunity to grow your skills in a dynamic and tech-focused environment.
You'll be taken to the original listing on CareerJet to apply.