From Vibes to Metrics with DeepEval and MLflow

Building applications with AI and large language models (LLMs) adds a new layer of variability that makes testing difficult. Since interactions can be subtly different each time but still correct, traditional testing tools often fail. In this talk, we'll share our journey using the open-source tools DeepEval and MLflow to evaluate multi-turn conversations, tune prompts, and ensure our AI applications are reliable so that we can sleep at night.