Builders
Builders
To Build Reliable AI, Start with Evaluations: How to Ship Enterprise AI
Most AI projects stall because leaders can’t confidently answer whether a model is safe and reliable enough to ship. The longer that question goes unresolved, the wider the technology gap grows in your organization as the frontier of AI progresses.
In this masterclass, we’ll introduce a practical Evaluation-Driven Development framework, informed by our work deploying AI at large-scale enterprises like Mayo Clinic, Pfizer, and T-Mobile. You’ll learn how to define clear quality standards, measure performance in a structured way, and reduce risk before launch.
You’ll leave with a straightforward approach to building custom rubrics, aligning stakeholders, and moving from experimentation to production with confidence.
In this masterclass, we’ll introduce a practical Evaluation-Driven Development framework, informed by our work deploying AI at large-scale enterprises like Mayo Clinic, Pfizer, and T-Mobile. You’ll learn how to define clear quality standards, measure performance in a structured way, and reduce risk before launch.
You’ll leave with a straightforward approach to building custom rubrics, aligning stakeholders, and moving from experimentation to production with confidence.
Best for:
Technology
Sponsored by Scale AI
Presented by
Mihir Pandya
Director, Engineering
Scale AI
Concurrent Sessions
You may enjoy these other sessions happening at the same time.
Speaking Session10:55 AM - 11:15 AM
How AI Is Rewriting the Rules of Finance
Roy LuoICONIQ
Eric GlymanRamp
Kate ClarkThe Wall Street Journal
Speaking Session11:15 AM - 11:35 AM
The Future of Enterprise AI with Cohere
Aidan GomezCohere
Rachel MetzBloomberg
Speaking Session11:35 AM - 11:55 AM
What It Takes to Build a Durable AI Application
Tuhin SrivastavaBaseten
Sarah GuoConviction
Tom GilesBloomberg
Speaking Session10:50 AM - 11:15 AM
Decisions Humans Can’t Make
Linda TongWebflow
Ted BaileyDataminr
Ksenia SeTuring Post
Speaking Session11:15 AM - 11:40 AM
AI That Acts Not Just Answers
Devi ParikhYutori
Guy Gur-AriAugment
Nasrin MostafazadehVerneek AI
Jennifer StrongPRX
Speaking Session11:40 AM - 12:00 PM
Open or Closed Models What AI Natives & Enterprises Need to Know
Vipul Ved PrakashTogether AI
Mark SurmanMozilla
Rolfe WinklerWSJ
AI Collective Living Room11:00 AM - 11:45 AM
What Can You Do TODAY to Future-Proof Yourself?
LEARN MORESpeaking Session11:00 AM - 11:20 AM
Why the future will be built by design
Loredana CrisanFigma
Speaking Session11:20 AM - 11:45 AM
What It Takes to Build AI Agents People Actually Use
Edo SegalNapster Corporation
Nancy Wang1Password
Ashwin SreenivasDecagon
Michael NunezVentureBeat
Q&A10:35 AM - 11:15 AM
Q&A with Victor Riparbelli, Co-founder & CEO at Synthesia
Victor RiparbelliSynthesia
Q&A11:20 AM - 12:00 PM
Q&A with Jarek Kutylowski, Founder and CEO at DeepL
Jarek KutylowskiDeepL
Roundtable10:45 AM - 11:25 AM
Roundtable | Deploying Humanoids in the Real World
Andrea ThomazDiligent Robotics
Roundtable11:00 AM - 11:45 AM
Technology Peer [X]Change: Implementing Production-Ready AI in Critical Environments
Sponsored by Thread AI
LEARN MORERoundtable11:30 AM - 12:10 PM
Roundtable | Why Your AI Bill is Too High (And Your Model is Too Dumb)
Jared Quincy DavisMithril
Roundtable10:45 AM - 11:25 AM
Roundtable | Designing Machines That Live Alongside Us
Daniela RusMIT
Masterclass11:00 AM - 11:45 AM
Beyond Simple Automation: Building Loyal Customers with Smarter AI Conversations
Sponsored by Twilio
LEARN MOREMasterclass11:00 AM - 11:45 AM
Prompting Techniques and Use Cases for Optimal AI-Assisted Engineering
Sponsored by DX
LEARN MOREREADY TO BE PART OF IT?
Don't miss out on the premier AI event of the year! Get your tickets now and be part of the future of technology!




