Imizizi is looking for a Senior Data Engineer to join their team in Menlyn. You will work with various AWS services and tools to build and maintain data pipelines, ensuring data quality and efficiency.
As a Senior Data Engineer at Imizizi, you'll be at the forefront of building and managing data pipelines that drive insights and decision-making. Your role will involve using AWS services like Athena, Glue, and Lambda to process and transform data efficiently. You'll also work with Python and PySpark to develop robust data processing jobs, ensuring that the data is accurate and readily available for analysis.
In your day-to-day work, you'll be responsible for designing data schemas and formats, such as Parquet and JSON, to optimize data storage and retrieval. You'll also develop ETL processes and validate data quality using tools like Great Expectations. Familiarity with streaming technologies like Kafka and AWS Kinesis will be beneficial as you work on real-time data ingestion projects.
This role is ideal for someone with a strong background in data engineering and a passion for working with cloud technologies. You should have at least 3-5 years of hands-on experience in the field and be comfortable with technical data modeling. Your expertise will help shape the data infrastructure at Imizizi, contributing to the company's innovative projects and solutions.
Key requirements include extensive experience with AWS services, proficiency in Python and PySpark, and a solid understanding of data quality practices. If you're ready to take your career to the next level in a dynamic and tech-focused environment, this position could be a great fit for you.
You'll be taken to the original listing on PNet to apply.