Michael Dawson
Michael Dawson is a Senior Principal Software Engineer at Red Hat, with a focus on building AI and LLM applications as part of the ecosystem engineeing team. Before moving into the AI space, he was a key contributor to Node.js as the technical lead for IBM and Red Hat's team and a member of the Node.js Technical Steering Committee.
Sessions Montréal 2027
From Vibes to Metrics with DeepEval and MLflow
Session en Anglais - Intermédiaire
Building applications with AI and large language models (LLMs) adds a new layer of variability that makes testing difficult. Since interactions can be subtly different each time but still correct, traditional testing tools often fail. In this talk, we'll share our journey using the open-source tools DeepEval and MLflow to evaluate multi-turn conversations, tune prompts, and ensure our AI applications are reliable so that we can sleep at night.
Speeding Up Ticket Resolution with AI Agents
Session en Anglais - Débutant
IT tickets pile up because rule-based automation can't gather missing info or use judgment. This talk shows how AI agents embedded in a ticketing system triage requests, ask questions, and resolve common cases end-to-end, cutting response time and backlog. We'll cover specialist vs. general agents, knowledge-base grounding, guardrails against prompt injection, evaluating non-deterministic agents, and tracing conversations for full observability.
