GenAI Evaluation: One Model, Three Goals - Deepshikha, Anamika Mukhopadhyay
Software Testing Unleashed - QA, DevEx & Quality Engineering

GenAI Evaluation: One Model, Three Goals - Deepshikha, Anamika Mukhopadhyay

Nov 19, 2026
27:58
E80
-(0)

About this episode

GenAI evaluation turns into a question of better or worse once every answer a model gives could be correct, and that is where Deepshikha and Anamika Mukhopadhyay begin. We talk about why one model needs three different definitions of good as a customer bot, a clinical summarizer and a coding agent, and why most teams they meet in workshops measure whatever their tools give them by default. A faithfulness score like 0.87279 left a room of CXOs asking whether it was a rounding problem; a 12 percent drop in issue resolution and 200 extra tickets did not. And a prepared Reddit post shows how an indirect prompt injection slips past an agent that had blocked every direct one.

Comments

Rate this episode

Episode Details

Author
Richard Seidl | Software Development & Testing Expert
Show Type
full
Audio Format
audio/mpeg

We use analytics

We use Umami, a privacy-friendly analytics tool, to understand how visitors use this site. No personal data is collected and no data leaves our EU servers. You can accept or decline below. Privacy Policy