Home·Find Jobs·AI Evaluation Engineer
V

AI Evaluation Engineer

VettedBench
Posted yesterday · Apply by 6 Nov 2026
India3+ years

About this role

We are looking for an AI Evaluation Engineer to evaluate, test, and improve the quality, reliability, and performance of large language models (LLMs) and generative AI applications. You will design evaluation datasets, develop automated testing pipelines, analyze model outputs, and build metrics and tools to measure AI system performance across real-world use cases. The ideal candidate has strong Python programming skills, an analytical mindset, and an interest in LLM evaluation, AI training, a…

Applications are read by our talent team, usually within two working days. If you look like a fit we will call you, and you will hear from us either way.

More open roles

View all roles →
Apply for this role →