
36 segments available
Suhail Doshi, founder of YC alumnus Mixpanel and a world-class expert on measurement, details how startups should think about discovering the important facts about how their product is used. You can find the lecture transcript and slides here: https://www.startupschool.org/videos/39 Learn more at https://www.startupschool.org/
Suhail Doshi introduces himself and Mixpanel, emphasizing the importance of measuring product usage for growth. He highlights that understanding user engagement is crucial for building something that people want and will use.
"we are very grateful to have sueldo she from Mixpanel who co-founded Mixpanel almost 10 years ago now and is going to talk about how to measure your product which as you heard from Gustav is really th..."
Doshi engages the audience with a quick survey about their user base, gauging how many have zero, few, or many users. This interaction sets the stage for discussing measurement strategies tailored to different stages of product development.
"hello everyone happy to be here awesome I thought I would start off by just kind of like I sometimes try to gate try to change my presentation a little bit on the fly depending on the audience and so ..."
Suhail shares the origin story of Mixpanel, detailing its growth from a bedroom project to a company with 300 employees and significant revenue. He emphasizes the evolution of the product and its focus on helping users measure engagement effectively.
"off with just a quick about me for those who don't haven't heard of Mixpanel um I started this company called Mixpanel I think the first line of code was written in like October 2008 technically I was..."
Doshi explains the core functionalities of Mixpanel, such as measuring user actions and retention. He stresses that the insights gained from these measurements are applicable across various analytics tools, not just Mixpanel.
"yeah 2008 to now cool awesome um if you don't know what mix phenol is we make pretty graphs like this we help you measure what people are doing inside the product so this is like you know someone invi..."
Suhail proposes a top-down approach to analytics, focusing on the problems startups need to solve rather than getting bogged down by complex metrics. He identifies three key questions that founders should consider regarding user understanding, ease of use, and retention.
"feel free to do that awesome great so today what I wanted to dive into was I thought I would take a top-down approach to thinking about analytics and metrics instead of kind of coming at you with char..."
Doshi introduces a simple formula for growth, outlining the essential metrics that startups should track. He emphasizes the importance of focusing on a few key metrics to avoid overwhelming complexity and decision paralysis.
"make a mistake with yeah so from there I thought that I would try to also I thought that it'd also be helpful for you to see it kind of broken down in a formula and so this is the formula and I think ..."
Suhail discusses the pitfalls of overcomplicating metrics and the importance of simplicity in measurement. He shares personal experiences and stresses that even larger companies often struggle with this issue, leading to ineffective decision-making.
"person companies that get it wrong they tend to overcomplicate the number of things that they should actually measure and track and it's really easy to make twenty five metrics conceive of them align ..."
Doshi explains how to use the growth formula to identify issues with user engagement. He emphasizes the need to assess various aspects of the product, such as landing page effectiveness and user retention, to drive improvements.
"wrong and today we're gonna talk about things that guide the team okay cool great so with this formula you should be able to assess anything going wrong in the company right if you're if you have a re..."
Suhail shares a memorable quote about the 'back button' as a metaphor for user disengagement. He illustrates the importance of creating a compelling landing page to prevent users from leaving without engaging with the product.
"awesome and then once you are able to measure those five things and assess what's wrong you have your levers and you should be able to take action and fix any of those things put a team on it maybe yo..."
Doshi reflects on the evolution of Mixpanel's landing page, showcasing the changes made over time to improve user understanding and engagement. He highlights the significance of clear messaging and differentiation from competitors.
"enemy is the back button so this is what mixed panels first front page look like in 2009 that's not what our logo looks like anymore this is a design by me original design by me and and and in all of ..."
Suhail discusses effective methods for measuring user interest, such as tracking sign-up rates and user interactions. He emphasizes that these metrics provide valuable insights into whether the product resonates with potential users.
"and and because it like very much differentiated us as something where we would measure engagement we did something different like Google was about pageviews we were about like what people did in your..."
Suhail Doshi emphasizes the necessity of making the onboarding process easy for users. He shares anecdotes about companies that prioritized user experience and how a complicated signup process can deter potential customers from engaging with the product.
"of valuable okay how much and so even something like that I think can tell you a lot and then if you're in consumer the benefit of being in consumer is that you generally have usually will have like h..."
Doshi discusses the significance of streamlining the user experience, using examples from companies like Airbnb. He explains how simplifying the initial user interaction can lead to higher engagement and retention rates, stressing the need for continuous optimization.
"steps so when we think about like is it easy to get started with my product you know forgot about password is kind of a useless feature if you have like a very small percentage of people that are basi..."
In this segment, Doshi introduces the concept of funnels as a method to measure user engagement. He explains how tracking the journey from landing page to valuable actions can provide insights into user behavior and highlight areas for improvement.
"important and here's an example of like easy to use something you use every single day that is literally one-step you just go to google you type it in and you immediately get to use the product there'..."
Doshi highlights the importance of speed in the user experience, discussing how quickly users can start using a product impacts their overall satisfaction. He shares insights on how to measure and optimize this aspect to enhance user retention.
"process so they're actually many steps to booking something online but Airbnb had to kind of figure out like how do we a describe what we're doing what we offer what's useful for the world and be how ..."
Suhail Doshi warns startups against common pitfalls, such as over-optimizing for fraud prevention at early stages. He discusses the negative impact of email confirmations on user retention and emphasizes the need for a focus on initial user experience.
"they probably change that you know 50 times before they figure it out like this is the right current optimal thing at this stage for the company and so it takes a lot of work in and you have to grind ..."
In this segment, Doshi stresses the importance of continuously iterating on the user experience. He explains that this process is never-ending and requires dedicated attention to ensure that the product remains valuable and user-friendly.
"first two are like actually the ones that have the greatest drop-off and then the last thing is just like actually speed this is one that I think a lot of people don't actually do they're just like ho..."
Doshi introduces the 'Shark Fin Effect,' illustrating how companies can experience rapid user growth followed by a steep decline if retention is not prioritized. He shares examples of companies that faced this issue and emphasizes the need for a balanced approach to growth and retention.
"initial user experience that will be a never-ending process you will do this forever even as the press especially as the product it becomes really critical to like have someone on it so at least one r..."
In the final segment, Doshi discusses the critical importance of tracking user retention metrics. He explains how understanding new user engagement and retention can prevent startups from experiencing the pitfalls of rapid growth without sustainable user engagement.
"least are people coming back to me this is probably one of the metrics that is greatly ignored by most startups and it's often the reason why I've seen companies even with millions of users actually d..."
Suhail Doshi emphasizes the significance of tracking revenue churn, particularly for subscription-based businesses. He explains how even a seemingly low monthly churn rate can lead to substantial revenue loss over time, stressing the need for startups to focus on retention strategies to sustain growth and avoid financial pitfalls.
"then the second one is is just daily active users there might be people that disagree with this I don't think they're too many but I now think that monthly active users has become like the new BS metr..."
Doshi shares insights on the long-term effects of churn on startups, illustrating how losing a small percentage of revenue monthly can compound into significant losses. He encourages founders to visualize their churn rates and understand the implications for their business's future, highlighting the critical need for effective retention strategies.
"10 percent is incredible and so I really stress measuring a da you and then the last thing is a b2b slant again is something that I think a lot of b2b companies make an early mistake with it's actuall..."
In this segment, Doshi recounts his experience with early users at Mixpanel, emphasizing the value of direct communication for gathering feedback. He shares a story about redesigning their user interface based on user preferences, illustrating how qualitative insights can be more impactful than quantitative data in shaping product development.
"dollars and we're starting the year like that you now you have to do that and grow on top of that and once your base of revenue gets really high it becomes really hard to keep up and you kind of have ..."
Suhail Doshi advises startups to avoid overcomplicating their analytics. He suggests focusing on a single North Star metric that reflects the company's health and growth potential. This segment underscores the importance of simplicity in tracking metrics to ensure clarity and alignment within the team.
"really important cool I wanted to go over two things one I recognize that there a lot of people here that have zero users so they're like what the hell do I measure so what if I have less than 50 user..."
Doshi warns against the 'next feature fallacy,' where founders believe that upcoming features will dramatically change their product's trajectory. He encourages a focus on existing metrics and user feedback rather than chasing after new features, promoting a more grounded approach to product development and growth.
"back and it was totally the right decision in retrospect so I don't think there's any way that you can kind of skirt by talking to customers but here's the bet here's the benefit of talking to custome..."
Suhail Doshi emphasizes the importance of selecting a key metric for your startup and committing to it for a period of six months. He discusses how focusing on one number can drive team alignment and accountability, and how to adapt if the chosen metric proves ineffective.
"universe like what is that what is that metric and I'm not saying you need to choose that metric forever but choose it for six months choose it commit some time to it if you find out that it's actuall..."
Doshi introduces the concept of the 'Next Feature Fallacy' by Andrew Chen, explaining how startups often believe that their next product feature will be the breakthrough that changes everything. He encourages founders to read about this fallacy to gain insights into product development.
"to have numbers that you wish to monitor but don't focus on them awesome I think that's it and then for the people that were like slightly bored because I went over the basics I thought I would help y..."
In this segment, Doshi discusses the variability of conversion rates across different businesses, sharing benchmarks from his experience at Mixpanel. He highlights the importance of context when evaluating conversion metrics and suggests resources for finding relevant benchmarks.
"Jeff Kuhn a cool all right yeah I want to be fair I don't be like if like every speaker like choose them in the front yeah yeah so that's the problem with that is that um it's soo it's so yeah oh yes ..."
Suhail Doshi explores the effectiveness of different signup processes, comparing traditional methods with social login options. He emphasizes the need for experimentation and gathering data to understand what works best for user conversion.
"like that so I think that you could probably go there and find various benchmarks reports but it's really depending on the business yeah [Music] so when you're going through the signup process how do ..."
Doshi discusses how companies like Airbnb and Craigslist manage the balance between simplicity and complexity on their landing pages. He stresses the importance of having a guiding principle for what to optimize and the need for continuous experimentation.
"sometimes they're willing to share it yeah so question is Airbnb ease landing page was super simple and how do you balance like I mean what if a lot of people just know about Airbnb and then just know..."
In this segment, Doshi shares insights from Mixpanel's experience with video tutorials. He discusses the impact of video content on user engagement and conversion rates, highlighting the importance of testing and measuring effectiveness.
"right YouTube could just like be like Google they just like what do you want to look what do you want to watch right they could do that but they don't and so I think that the question really is is lik..."
Suhail Doshi elaborates on the interplay between art and science in user engagement strategies. He shares anecdotes from Mixpanel's product development, emphasizing the need for both creative hypotheses and data-driven measurement to optimize user experiences.
"know the first three steps but what we did find was this interesting thing that occurred as a result of looking and measuring things which was that um well we have a feature in mix panel where you can..."
Doshi differentiates between user retention and dollar churn, explaining how a company can maintain revenue despite low user engagement. He provides benchmarks for retention rates across different types of applications, illustrating the complexities of measuring success.
"thought of was in fact right the a percent loss in revenue over a year yeah so what these are slightly two different things one is one is like user retention and then one is like dollar churn and so i..."
In this segment, Doshi addresses the applicability of product metrics to hardware startups. He reassures that even hardware products with subscription models can effectively track user engagement and performance metrics, drawing on examples from companies like Jawbone and Fitbit.
"are not exactly linked they're not directly linked yeah yeah yeah like to give you to give you kind of a benchmark like a chat app that's like often used a lot we'll have like 60 70 percent retention ..."
Suhail Doshi shares insights on how to identify and understand your customer base over time. He reflects on Mixpanel's journey in recognizing its target audience and the importance of user feedback in shaping product development.
"were and then after like a few years you just you talk to users you ask them like what size of company they are if they sign up if you want to we didn't do that but we just spent a lot of time we just..."
In this segment, Doshi outlines methods for gauging product-market fit, contrasting qualitative and quantitative approaches. He emphasizes the significance of retention rates and user engagement metrics, suggesting benchmarks for startups to assess their success in achieving product-market fit.
"we weren't necessarily building things to bring new users on oh sorry the question is you guys built forgot about you didn't you just you decided to not build forgot about password how do you know whe..."
Doshi reflects on common misconceptions in the startup world, particularly the tendency for founders to complicate their products and metrics. He stresses the importance of maintaining focus on core metrics and user retention, warning against distractions that can derail a startup's success.
"there's a lot of people that probably have already will talk about or have already talked about like you know people will say very and I think they're there all right so I'll give you a kind of I'll g..."