Join a high-performing engineering team as a Senior Data Engineer, where you'll build and optimize scalable cloud-based data solutions. This role is perfect for someone with strong expertise in Spark and Python, particularly in developing high-performance data processing engines.
Collaborative and innovative
As a Senior Data Engineer at Tumaini Consulting, you will be part of a dynamic team dedicated to creating and enhancing scalable data solutions in the cloud. Your primary focus will be on building high-performance data processing engines using Spark and Python, ensuring that the data infrastructure is robust and efficient. This role is well-suited for someone who thrives in a collaborative environment and is passionate about data engineering.
In your day-to-day work, you will engage with various technologies and frameworks, particularly focusing on Azure Data Engineering tools like Synapse and Data Factory. You will be responsible for designing and implementing data pipelines, as well as working with Data Lakehouse and Delta Lake architectures. Your expertise in PySpark will be crucial in optimizing data workflows and ensuring data quality across the system.
Key responsibilities include: • Developing and maintaining scalable data processing solutions • Collaborating with data scientists and analysts to understand data needs • Implementing best practices for data management and governance • Troubleshooting and optimizing existing data pipelines
To excel in this role, you should have at least five years of experience in data engineering, with a strong background in Spark and Python. Familiarity with Delta Lake, Parquet, and Medallion Architecture will be advantageous. If you are looking to make a significant impact in a forward-thinking company, this position could be a great fit for you.
You'll be taken to the original listing on PNet to apply.