24 au 26 février, 2027
Montréal, Canada
GPU-maxxing: Deployment Strategies for Self-Hosting AI
You've likely heard how rising AI bills have made teams start thinking about running their own open-weight models. The good news? You can achieve near-frontier capabilities, but the hard part is figuring out the optimizations that are right for your hardware, from Mac's to NVIDIA GPU's. I'll walk you through what works best, from quantization to speculative decording, through live demos that balance throughput, latency, and accuracy.
Cedric Clyburn
Red Hat
Cedric Clyburn (@cedricclyburn), Senior Developer Advocate at Red Hat, is an enthusiastic software developer with a background in Kubernetes, DevOps, and container tools. Focused on open-source software, he both contributes (e.g., Podman, vLLM) and enjoys speaking, with prior experience at Devoxx, WeAreDevelopers, The Linux Foundation, and more. Cedric also spends (too much) time creating video and written content helping developers learn new topics in emerging technologies, with over 2M+ views
