Join a dynamic team focused on modernizing data platforms. This role is ideal for someone with solid Python experience and a passion for data engineering and AI.
In this role, you will be part of a team dedicated to modernizing data platforms by transitioning legacy T-SQL workloads to Spark and Delta Lake pipelines. Your work will involve a mix of data engineering, API development, and integrating AI capabilities into existing systems. The focus will be on writing type-safe, well-tested Python code that adheres to specifications, ensuring high-quality outputs.
You will be expected to leverage your expertise in Python, particularly version 3.12, and utilize modern tools and practices such as type hints and Pydantic. Your responsibilities will include:
This position is best suited for someone with at least four years of professional experience in Python development, particularly in data engineering contexts. A strong understanding of Spark and Delta Lake is crucial, as is familiarity with modern packaging tools like uv or Poetry. If you are passionate about data and eager to work in an innovative environment, this role could be a great fit for you.
You'll be taken to the original listing on PNet to apply.