As a Senior Data Engineer, you'll play a crucial role in managing and optimizing data systems. This position is ideal for someone with strong technical skills in Spark and Python, looking to lead projects and innovate in a cloud environment.
In this role, you will be a key player in the data engineering team, focusing on building and maintaining robust data pipelines. Your expertise in Spark and Python will be essential as you work on optimizing data processing and ensuring high performance across various cloud platforms. You will also be responsible for managing memory, tuning shuffles, and partitioning to enhance cost-effectiveness and efficiency.
Your day-to-day responsibilities will include: • Designing and implementing data solutions that meet business needs • Collaborating with data scientists and analysts to understand data requirements • Monitoring and troubleshooting data pipeline performance • Leading technical discussions and providing guidance to junior team members
This position is well-suited for experienced data engineers who are passionate about working with big data technologies and cloud environments. You should have a strong background in data warehousing and ETL processes, as well as a proactive approach to problem-solving. If you thrive in a fast-paced, innovative environment and are eager to take on leadership responsibilities, this role could be a great fit for you.
You'll be taken to the original listing on CareerJet to apply.