Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
January 13, 2025
·
Seattle
Evals & Observability Workshop
Hands-on workshop teaching design of robust evaluation pipelines, real-time observability, user-feedback collection, and performance optimization using case studies and troubleshooting exercises.
Overview
This is a hands-on workshop focused on building and evaluating AI applications in production. The 4-hour session covers logging and analyzing system behavior, collecting user feedback, designing evaluations, and optimizing performance. Participants will work through practical exercises to build evaluation pipelines and implement observability tools, with real-world case studies and troubleshooting examples.
Links
Tech stack