Senior Data Engineer (Spark & Python Specialist)

WatersEdge Solutions is seeking a Senior Data Engineer to join their team in Cape Town. This role involves working closely with clients to design and implement data solutions that are both scalable and efficient. You will be part of a dynamic team that values innovation and technical excellence, making it a great fit for someone who thrives in a fast-paced environment.

In your day-to-day work, you will leverage your expertise in Spark and Python to build data pipelines and manage large datasets. You will collaborate with other engineers and data scientists to ensure that the data infrastructure meets the needs of the business. Your responsibilities will include:

• Designing and implementing data models and pipelines
• Optimizing existing data processes for performance
• Ensuring data quality and integrity
• Collaborating with cross-functional teams to understand data requirements

This role is ideal for someone with at least five years of experience in data engineering, particularly with a strong background in Spark and Python. You should be comfortable working with large datasets and have a passion for solving complex data challenges. If you enjoy working in a collaborative environment and are looking to take your career to the next level, this position could be a great fit for you.