All Segments
The OEC is the Overall Evaluation Criterion for experiments
1 segment available
You can listen to the full pod with Ronny Kohavi here: https://www.youtube.com/watch?v=hEzpiDuYFoE #startup #founder #productmanager #productmanagement #softwareengineer ab test tips, how to pick metrics, north star metric, metrics for startups, how to run ab tests
Segments Timeline
The Confusion of Metrics
Ronny Kohavi shares a humorous anecdote about the challenges of defining success metrics for the Microsoft.com support site. He highlights the confusion among team members regarding the Overall Evaluation Criterion (OEC) and whether increasing time on site is beneficial or detrimental. This segment underscores the importance of having a clear and agreed-upon metric when running experiments, especially in product management and A/B testing.
"remember one funny example was the microsoft.com website this is a support site the ability to sell software and warn you about safety and updates it has so many goals I remember when the team said we..."