Join a dynamic team focused on modernizing data platforms. As a Data Engineer, you'll leverage your Python and Spark skills to transform legacy systems into efficient data pipelines.
In this role, you'll be part of a team dedicated to modernizing data platforms by transitioning legacy T-SQL workloads to Spark and Delta Lake pipelines. Your expertise in Python and Spark will be crucial as you work on data engineering, API development, and integrating AI capabilities into existing systems. This position is ideal for someone who enjoys tackling complex challenges and is passionate about building efficient data solutions.
Your daily tasks will involve writing type-safe and well-tested Python code, ensuring that the solutions you develop meet high standards of quality and performance. You will collaborate closely with other team members to design and implement robust data pipelines that enhance the overall functionality of the data platform. A strong understanding of modern Python features, such as type hints and packaging tools, will be essential for success in this role.
To thrive here, you should have at least four years of professional experience in Python development, with a solid grasp of Spark and Delta Lake. Familiarity with T-SQL and modern Python libraries will be beneficial but not mandatory. If you are a proactive problem-solver who enjoys working in a fast-paced environment, this role could be a great fit for you.
You'll be taken to the original listing on PNet to apply.