As a Lead AI Engineer, you will take charge of developing and refining AI systems. Your role will involve rigorous testing and evaluation to ensure high-quality deployments.
In this role, you will be the technical owner of an internally built AI system, responsible for its development and performance. Your main task will be to run historical evaluation test suites against all updates, including prompts, code, and models, ensuring they meet the required standards before deployment. This position is crucial for maintaining the integrity and effectiveness of the AI solutions the company offers.
You will work closely with a team of engineers and data scientists, collaborating to enhance the capabilities of the AI system. Your day-to-day responsibilities will include overseeing the testing processes, implementing improvements, and guiding the team in best practices for AI development. You will also be involved in strategizing staged releases to ensure smooth transitions and updates.
This role is ideal for someone with a strong background in AI and machine learning, particularly in system development and evaluation. You should have at least five years of experience in the field, with a proven track record of managing complex AI projects. Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment are essential.
Key requirements include expertise in AI system development, model evaluation, and prompt engineering. Familiarity with deployment strategies and experience with agentic systems will be advantageous. If you are passionate about pushing the boundaries of AI technology and ensuring high-quality outputs, this position is for you.
You'll be taken to the original listing on CareerJet to apply.