AI Engineer Summit 2026

Oct 12–13, 2026Moscone West, San Francisco

Back to speakers
TB

Tom Beaumont

Developer Advocate

Ridgeline

Their schedule1 session

Monday, October 12, 2026

AI EngineeringTalk

Evaluation harnesses for production LLMs

A working tour of a real evaluation harness: dataset curation, judge prompts you can defend, statistical significance on small samples, and wiring the whole thing into CI so a regression blocks a deploy rather than surprising a customer.

10:00 AM - 10:45 AMWorkshop Room

Speakers

Format: TalkTrack: AI Engineering