As a Data Engineer at Parvana, you'll work on developing and maintaining data solutions for various industries. This role is perfect for someone with a strong background in data engineering and a passion for data quality and integration.
Parvana is looking for a skilled Data Engineer to join their team in Cape Town. The company specializes in developing and supporting software and data solutions across various industries. You will be part of a team that focuses on big data engineering and bespoke software development, providing both cloud-based and hosted solutions to clients.
In this role, your main responsibilities will include analyzing complex customer data to identify integration needs and developing scalable data integration and transformation pipelines. You will work with technologies like PySpark, SparkSQL, and Python to automate data validation and maintain quality checks. Collaboration with the product team is essential to ensure that customer data is accurately reflected and to provide insights based on your data analysis.
The ideal candidate will have at least 5 years of experience in data engineering, with a strong understanding of data quality concepts and excellent communication skills. Familiarity with Agile and Scrum methodologies will be beneficial, as will experience with modern data formats and platforms such as Parquet, Delta Lake, and cloud storage solutions like S3 or Blob Storage.
This position is suited for someone who enjoys working with data and is eager to contribute to innovative solutions. If you have a passion for data quality and integration, and are looking to grow your skills in a supportive environment, this could be the perfect opportunity for you.
You'll be taken to the original listing on PNet to apply.