The Crucial Role of AI Evaluations

Building applications with AI and large language models (LLMs) adds a new layer of variability that makes testing difficult. Since interactions can be subtly different each time but still correct, traditional testing tools often fail. In this talk, we'll share our journey using the open-source tool deepeval to evaluate multi-turn conversations, tune prompts, and ensure our AI applications are reliable so that we could sleep at night.