How OpenAI Customers Use Evals To Build Better AI Products
Hosted by Jim Blomo and Hamel Husain
What you'll learn
Case studies from OpenAI customers
Get a sneak peek of OpenAI's integrated eval products
The hidden risks of skipping evals
Design patterns for eval-driven development
Why this topic matters
You'll learn from
Jim Blomo
Engineering Leader at OpenAI, working on Evals
Jim Blomo is an engineering leader at OpenAI, working on model customization with evals and fine-tuning. His experience ranges from teaching at UC Berkeley to leading engineering teams at Yelp and Outschool. Jim enjoys exploring the food and outdoors of the Bay Area with his family.
Hamel Husain
ML Engineer with 20 years of experience
Hamel is a machine learning engineer with over 20 years of experience. He has worked with innovative companies such as Airbnb and GitHub, which included early LLM research used by OpenAI, for code understanding. He has also led and contributed to numerous popular open-source machine-learning tools. Hamel is currently an independent consultant helping companies build AI products.
Go deeper with a course

