As a Senior Data Engineer, you'll play a crucial role in managing and optimizing data storage solutions. This position is ideal for someone with strong technical skills in Spark and Python, looking to lead projects in a cloud environment.
In this role, you will be a key player in the data engineering team, responsible for designing and implementing robust data solutions that prioritize performance and privacy. Your expertise in Spark and Python will be essential as you work on optimizing data storage and ensuring efficient data processing workflows in a cloud environment.
You will lead initiatives to improve data orchestration and storage techniques, including Z-Ordering and Vacuuming, to enhance performance. Collaboration with other teams will be crucial as you support the transition to code-centric orchestration methods, ensuring that data handling aligns with best practices and compliance standards.
This position is best suited for experienced data engineers who are passionate about leveraging technology to solve complex data challenges. You should have a strong background in cloud data engineering and be comfortable working in a fast-paced environment where innovation is encouraged.
Key responsibilities include: • Designing and implementing data storage solutions • Optimizing data processing workflows using Spark and Python • Leading projects focused on data privacy and compliance • Collaborating with cross-functional teams to enhance data strategies
To succeed in this role, you should have at least five years of experience in data engineering, with a solid understanding of cloud technologies and data optimization techniques. Strong problem-solving skills and a proactive approach to learning new technologies will also be important for your success.
You'll be taken to the original listing on CareerJet to apply.