As a Data Engineer at Parvana, you'll play a key role in developing and maintaining data solutions for various industries. You'll work with complex data sets and collaborate closely with the product team to ensure data accuracy and quality.
Parvana is looking for a skilled Data Engineer to join their team in Cape Town. The company specializes in developing software and data solutions tailored to various industries, with a strong emphasis on big data engineering and bespoke software development. As a Data Engineer, you will be responsible for analyzing complex customer data to identify integration needs and developing scalable data pipelines that transform and integrate this data effectively.
In your day-to-day work, you will utilize tools like PySpark, SparkSQL, and Python to create and test data integration and transformation pipelines. You will also automate and maintain data validation processes to ensure high data quality. Collaboration is key in this role, as you will partner with the product team to ensure that customer data is accurately reflected and to provide insights based on your data analysis.
This role is ideal for someone with a solid background in data engineering and a passion for working with data. You should have experience with modern data formats and platforms, such as Parquet, Delta Lake, and cloud storage solutions like S3 or Blob Storage. Familiarity with Agile and Scrum methodologies will also be beneficial, as the team operates in a dynamic and iterative environment.
Overall, this position offers a great opportunity to work with cutting-edge technology and contribute to impactful data solutions while collaborating with a talented team.
You'll be taken to the original listing on PNet to apply.