As a Senior Data Engineer at Confluent, you'll play a key role in building and optimizing data pipelines using Databricks. This position is ideal for someone with strong technical skills and a passion for data engineering.
Confluent is a leading debt management company in South Africa, known for its innovative approach and commitment to excellence. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining data pipelines that support various business functions. Your work will involve leveraging Databricks to ensure data is processed efficiently and effectively.
In this role, you will collaborate with data scientists and analysts to understand their data needs and translate them into technical solutions. You will also be involved in optimizing existing data processes and ensuring data quality across the organization. This position requires a strong understanding of ETL processes and experience with SQL and Python.
Key responsibilities include: • Developing and maintaining data pipelines using Databricks • Collaborating with cross-functional teams to gather data requirements • Ensuring data quality and integrity throughout the data lifecycle • Optimizing data processes for performance and scalability
The ideal candidate will have at least five years of experience in data engineering, with a proven track record of working with Databricks and other big data technologies. You should be comfortable working in a hybrid environment and be ready to tackle complex data challenges. If you are passionate about data and eager to contribute to a dynamic team, this role is for you.
You'll be taken to the original listing on CareerJet to apply.