Senior Data Engineer (Kafka Streaming, Spark, Iceberg on Kubernetes)

The Legends Agency is seeking a Senior Data Engineer to help build and scale a next-generation real-time data platform. This role is fully remote, allowing you to work from anywhere while contributing to exciting projects that leverage cutting-edge open-source technologies. You will be part of a dynamic team that values innovation and collaboration.

In this position, you will be responsible for designing and implementing data pipelines using Kafka Streaming and Spark. You will also work with Iceberg on Kubernetes to ensure the platform is robust and scalable. Your day-to-day tasks will involve collaborating with other engineers and data scientists to optimize data flow and improve system performance.

The ideal candidate for this role is someone with a strong background in data engineering and a passion for working with real-time data solutions. You should be comfortable with complex data architectures and have experience in deploying applications on Kubernetes. If you thrive in a fast-paced environment and enjoy tackling challenging problems, this role is perfect for you.

Key responsibilities include: • Designing and building data pipelines • Implementing real-time data processing solutions • Collaborating with cross-functional teams to enhance data accessibility • Monitoring and optimizing data systems for performance

To succeed in this role, you should have a solid understanding of Kafka, Spark, and Kubernetes, along with experience in data modeling and ETL processes. If you are ready to take your career to the next level and work on innovative projects, we encourage you to apply.