searchlore

Back to Resource

All Segments

Behind the product: NotebookLM | Raiza Martin (Senior Product Manager, AI @ Google Labs)

Behind the product: NotebookLM | Raiza Martin (Senior Product Manager, AI @ Google Labs)

34 segments available

Raiza Martin is a senior product manager for AI at Google Labs, where she leads the team behind NotebookLM, an AI-powered research tool that includes a delightful podcast-on-demand feature called “Audio Overviews.” NotebookLM started as a 20% project and has grown into a product that’s spreading across social media and has a Discord server with over 60,000 users. Raiza previously worked on AI Test Kitchen and has a background in startups, payments, and ads. In our conversation, we discuss: • The origin story of NotebookLM • The future road map for NotebookLM • How Google Labs operates differently from the rest of Google • The development of the “Audio Overviews” feature • Key metrics and growth of NotebookLM • Stories about collaborating with author Steven Johnson • Navigating potential misuse of AI technology — Brought to you by: • Explo — Embed customer-facing analytics in your product: https://explo.co/lenny • Sprig⁠⁠ — Build products for people, not data points: https://sprig.com/getstarted?utm_source=lenny&utm_medium=podcast • Sidebar — Accelerate your career by surrounding yourself with extraordinary peers: https://www.sidebar.com/lenny?utm_source=lennys&utm_medium=newsletter&utm_campaign=waitlist&utm_content=3 Find the transcript at: https://www.lennysnewsletter.com/p/googles-notebooklm-raiza-martin Where to find Raiza Martin: • X: https://x.com/raiza_abubakar • LinkedIn: https://www.linkedin.com/in/whatsaraiza/ Where to find Lenny: • Newsletter: https://www.lennysnewsletter.com • X: https://twitter.com/lennysan • LinkedIn: https://www.linkedin.com/in/lennyrachitsky/ In this episode, we cover: (00:00) Introduction to NotebookLM (05:43) The genesis of NotebookLM (08:08) Innovative features and use cases (18:52) Building a startup culture within Google (24:28) Expanding user demographics (27:30) The product roadmap (32:18) Other use cases (36:11) Collaborating with Steven Johnson (42:49) Ensuring ethical AI (46:06) Future directions and user engagement Referenced: • NotebookLM: https://notebooklm.google/ • AI Test Kitchen: https://aitestkitchen.withgoogle.com/ • Steven Johnson on X: https://x.com/stevenbjohnson • Gemini Pro: https://deepmind.google/technologies/gemini/pro/ • Usama Bin Shafqat on LinkedIn: https://www.linkedin.com/in/ushafqat/ • NotebookLM’s Discord server: https://discord.com/invite/Az2N7BwV7r?sjid=10560123093044576704-NA • Josh Woodward on LinkedIn: https://www.linkedin.com/in/joshwoodward/ • Andrej Karpathy’s website: https://karpathy.ai/ • Histories of Mysteries on Spotify: https://open.spotify.com/show/3K4LRyMCP44kBbiOziwJjb • NotebookLM — Analyzing Poop & Fart written 1,000 times — Creating meaning from the meaningless: https://www.youtube.com/watch?v=ftg7UC3CGjc • Reddit thread about the fake chicken.pdf: https://www.reddit.com/r/notebooklm/comments/1fwz5eh/the_google_podcast_duo_get_almost_9_minutes_out/ • Steven Johnson’s tweet about his 8K quotes: https://x.com/stevenbjohnson/status/1840844268065456456 • Readwise: https://readwise.io/ • How We Got to Now: https://www.pbs.org/show/how-we-got-now/ • “A.I. Is Mastering Language. Should We Trust What It Says?”: https://www.nytimes.com/2022/04/15/magazine/ai-language.html • AI Podcast Hosts Discover They’re AI, Not Human — NotebookLM: https://www.youtube.com/watch?v=AR4dRtzFvxM Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com. Lenny may be an investor in the companies discussed.

Segments Timeline

1
0:00 - 1:00
0:59 duration184 words

Welcome to the Podcast

In this opening segment, the hosts express their gratitude to the listeners and introduce Raiza Martin, the Senior Product Manager for NotebookLM. They highlight the excitement surrounding the podcast and the innovative AI product, NotebookLM, which has captured the attention of many in the tech community.

"[Music] hey everyone we're here on Lenny's podcast it's uh great to be here I'm a longtime listener so awesome really is we're the hosts of a different show of Deep dive and we just we just wanted to ..."

2
1:00 - 2:30
1:30 duration290 words

Introducing NotebookLM

Raiza Martin explains what NotebookLM is, describing it as an AI-powered tool that generates audio overviews from uploaded content. She emphasizes its popularity and the imaginative potential it has sparked among users, setting the stage for a deeper discussion about its development and features.

"Risa Martin Risa is product lead for a product called notebook LM one of the most delightful and inspiring new AI products out there incubated within Google labs and this product is where the intro yo..."

3
2:30 - 3:50
1:20 duration275 words

The Origins of NotebookLM

Raiza shares the backstory of NotebookLM, revealing that it began as a 20% project within Google Labs. She discusses the initial team dynamics, including her role leading AI Test Kitchen and the contributions of a small group of engineers, including the notable author Steven Johnson.

"so great and all these things and so thanks for doing this I know this kind of came on short notice yeah I mean I was I was excited to do it in particular because you know I'm I'm a big fan big listen..."

4
3:50 - 5:00
1:10 duration168 words

From Concept to Reality

In this segment, Raiza elaborates on how NotebookLM evolved from a small project to a widely recognized tool. She highlights the collaborative efforts of the team and the importance of iterating on ideas to create a product that resonates with users.

"challenging process enter explo Expo is a fully wh labeled embedded analytic solution designed entirely with your user in mind getting started is easy explow connects to any relational database or war..."

5
5:00 - 6:30
1:30 duration259 words

The Role of Audio Overviews

Raiza discusses the innovative 'Audio Overviews' feature of NotebookLM, explaining how it allows users to generate audio content from various sources. She shares insights into the technology behind this feature and its potential applications, emphasizing the fun and engaging aspects of using it.

"continuously improve your product at scale first spr captures your product experience in real time through heat Maps replays surveys and feedback studies then sprigg's industry-leading AI instantly an..."

6
6:30 - 8:00
1:30 duration298 words

Exploring User Interaction

Raiza reflects on how users interact with NotebookLM, particularly through the audio feature. She discusses the shift from text-based outputs to audio, and how this change enhances user experience and engagement with the technology.

"22 and I was leading that project and I remember there was a smaller project inside of labs called talk to small Corpus and it was the idea that you know you could take a piece of content and use an l..."

7
8:00 - 9:30
1:30 duration298 words

The Technology Behind NotebookLM

In this segment, Raiza dives into the technological advancements that enabled NotebookLM's development. She highlights the integration of new models and the collaborative efforts within Google Labs to enhance the product's capabilities.

"first IO last year to as recently as like last month you know we've only had about eight Engineers or so let's talk about audio overview specifically this kind of podcast feature I think audio overvie..."

8
9:30 - 11:00
1:30 duration329 words

Shaping the Future of AI

Raiza discusses the broader implications of NotebookLM and similar technologies in the AI landscape. She emphasizes the importance of shaping technology to meet user needs and the ongoing exploration of innovative applications.

"that could be unexpected could be a surprise okay so it started basically there was like a technology that we think could be really interesting was there a problem you were trying to solve with this t..."

9
10:21 - 11:43
1:21 duration298 words

The Power of Voice Modality

Raiza Martin discusses the innovative audio feature of NotebookLM, emphasizing the importance of voice interaction in technology. She shares her personal experiences with voice input and output, highlighting how it transforms user engagement and interaction with AI tools. This segment explores the hypothesis-driven approach to developing the audio feature and its potential to enhance user experience.

"people are using it and I think that's like a fine approach we tried to have a little bit more of a hypothesis about what what is the shape of this thing to actually get the most learning out of it so..."

10
11:43 - 12:28
0:45 duration166 words

Shaping Technology for Users

In this segment, Raiza reflects on the necessity of shaping technology to make it more accessible and relatable to users. She draws parallels between the evolution of AI tools and the introduction of new mediums, like the chat GPT moment, that change user perceptions and interactions with technology. This highlights the ongoing journey of innovation within AI development.

"where just the tech was there and it's just this medium that you developed that really inspired people to like oh wow I had no idea AI was getting this good and LMS were getting this good any thoughts..."

11
12:28 - 13:10
0:42 duration162 words

The Secret Sauce of NotebookLM

Raiza reveals the technological foundation of NotebookLM, focusing on the Gemini models and the powerful audio model that enhances user interaction. She introduces the concept of a 'Content Studio,' which plays a crucial role in creating engaging audio experiences. This segment delves into the behind-the-scenes work that makes NotebookLM's audio features stand out.

"like I mean it feels so crazy to say that because even with like the the Advent of like the chat Bots right of llms as we know them today and then to introduce this sort of new technology on top of it..."

12
13:10 - 14:18
1:08 duration232 words

Crafting Engaging Audio Experiences

This segment explores the meticulous process behind creating high-quality audio content for NotebookLM. Raiza discusses the importance of listening to early audio attempts and refining the model to achieve a relatable and engaging output. She shares insights into how the team ensures the audio hosts sound natural and engaging, enhancing the overall user experience.

"get into the second yeah I mean I that's such a great question I mean the truly like the Gemini models are so powerful and we use Gemini 1.5 Pro uh as sort of the base for notbook LM and then we have ..."

13
14:18 - 15:01
0:42 duration154 words

User Experiences with NotebookLM

Raiza shares delightful anecdotes about users interacting with NotebookLM, including how people have utilized the audio feature for personal projects like autobiographies. This segment highlights the surprising and creative ways users are leveraging the technology, showcasing its versatility and impact on user engagement.

"that's engaging that's interesting so content studio is is real the real magic here so when you say content Studio what does that mean it's a what yeah what does that actually look like what is what i..."

14
15:01 - 16:22
1:21 duration300 words

Unexpected Use Cases of AI Audio

In this segment, Raiza discusses some of the most surprising and humorous use cases of NotebookLM's audio features, including generating audio overviews for performance reviews. She highlights how users feel empowered and confident after hearing their achievements celebrated in audio format, illustrating the positive impact of AI on personal and professional growth.

"way these hosts interact and talk like if you listen to these podcasts it's like they laugh and they're like H and they interrupt each other a little bit and they get surprised and they have these lik..."

15
16:22 - 17:29
1:07 duration251 words

Building a Startup Culture at Google

Raiza explains how NotebookLM operates within Google Labs, emphasizing the startup-like culture that fosters innovation and rapid development. She discusses the unique environment that allows the team to move quickly and creatively, contrasting it with traditional Google processes. This segment provides insights into how Google Labs is redefining product development.

"was pretty funny he actually couldn't tell that they were AI That's I love that I uh so one of the ways I've been playing around with it a bunch one of the ways I used it is my mom wrote this autobiog..."

16
17:29 - 18:03
0:33 duration98 words

The Role of Leadership in Innovation

In this segment, Raiza reflects on the leadership style within Google Labs that encourages experimentation and innovation. She shares her personal journey of transitioning from startups to a large corporation and how clear expectations from leadership have shaped the team's approach to product development. This highlights the importance of supportive leadership in fostering a culture of creativity.

"interesting that's what you do so maybe along these lines what are some other surprising uh hilarious use cases you've seen for especially the the audio deep Dives I mean I love I love the resume ones..."

17
18:03 - 19:01
0:58 duration213 words

Creating Delightful Products

Raiza discusses the philosophy behind creating delightful products at NotebookLM, emphasizing the importance of user feedback and community engagement. She highlights the active Discord community and how it contributes to the product's development. This segment showcases the commitment to user-centric design and the continuous improvement of NotebookLM.

"to my confidence just to upload my own you know my own check-in notes and then have it generate an audio overview it's like people are going into meetings feeling really good about themselves because ..."

18
19:01 - 22:15
3:13 duration698 words

Lessons from Google Labs

Raiza shares valuable lessons learned from operating within Google Labs, including the importance of agility and collaboration. She discusses how the team's unique structure allows for rapid iteration and innovation, providing insights for other organizations looking to foster similar environments. This segment encapsulates the essence of building a successful product team in a large corporation.

"operating feels very start upy like you're tweeting daily about what's going on I heard there's a Discord server folks that are like really is that right okay yeah there is it's it's pretty cool we ha..."

19
22:30 - 23:12
0:41 duration170 words

Embracing Discord for Community Engagement

Raiza recounts her decision to create a Discord server for NotebookLM, reflecting on the initial skepticism from her team. She shares her fears about user engagement and the excitement of growing the community to over 60,000 members, illustrating the importance of direct communication with users.

"beginning I was like Hey I want to have a Discord right like if we were building outside of Google for sure we would have one of these and in true sort of Google fashion everybody was like what is wha..."

20
23:12 - 24:27
1:14 duration225 words

Traction and User Growth Insights

Raiza reveals key metrics and growth indicators for NotebookLM, discussing user retention rates and demographic shifts. She highlights the increasing interest from professionals using the tool in their work, showcasing the product's expanding reach and relevance in various sectors.

"the early days you know very exciting to to look back and remember day Zero and now have 60,000 people in it let me tell you about a product called sidebar the most successful people that I know surro..."

21
24:27 - 25:01
0:34 duration124 words

The Path to Monetization

In this segment, Raiza outlines her vision for monetizing NotebookLM, discussing the need for business development as user demand grows. She emphasizes the importance of balancing product development with commercialization strategies, indicating a clear path forward for the team.

"Lenny okay so there's 60,000 in this Discord server any other traction numbers you can share feels like it's just going really well I know there's probably a lot of sensitive information anything you ..."

22
25:01 - 26:02
1:01 duration221 words

Defining Success for NotebookLM

Raiza reflects on her initial mandate to build a business with NotebookLM, discussing the steps taken to create an interesting product and the ongoing efforts to deepen user experience. She emphasizes the importance of thoughtful commercialization while enhancing the product's value.

"terms of like even when we talk to stakeholders we say hey we've got something here the second thing I'll say is even seeing um how the the demographics have changed where I think in the beginning we ..."

23
26:02 - 27:40
1:37 duration330 words

The Vision for AI-Driven Content Creation

Raiza shares her ambitious vision for the future of NotebookLM, focusing on the potential of an AI editor that can remix various content types. She discusses the importance of creating a seamless user experience across different formats, aiming to empower users to shape information in ways that suit their needs.

"like crazy um I think we went I don't want to say the exact numbers but it is now at a point where I have to hire business development person because I was like hey I have to ship products and I'm act..."

24
27:40 - 29:01
1:21 duration287 words

Enhancing Mobile Experience

In this segment, Raiza discusses the need to improve the mobile experience for NotebookLM users. She emphasizes the importance of experimenting with different formats and creating a more engaging interface that resonates with users, highlighting the potential for mobile to transform how people interact with the product.

"kind of the big Vision yeah yeah I have a really ugly slide I wish I could show you I made it two years ago and it was lime green I don't know you know what I was thinking I think I was trying to go f..."

25
29:01 - 31:01
1:59 duration425 words

Personalizing Information Delivery

Raiza explores the idea of personalizing how information is delivered to users, discussing the various formats people prefer. She reflects on her own experiences with different content types and emphasizes the need for flexibility in how users can access and engage with information through NotebookLM.

"experience today which I think is like understandable considering where we're at in like the product development cycle and I think that's the next Horizon is hey how different is the mobile experience..."

26
31:13 - 32:58
1:44 duration392 words

Transforming Study Materials into Audio

In this segment, Raiza shares insights on how NotebookLM can transform traditional study materials into audio formats, making learning more accessible for students. She highlights the common use case of students wanting to convert their study guides into audio overviews, showcasing the versatility of the platform in catering to diverse learning styles.

"think even for myself it depends on my mood right if I'm going on a walk yeah I want audio but if I'm at work yeah most of the time text is good and it's kind of interesting to think about today the f..."

27
32:58 - 34:02
1:03 duration229 words

Innovative Podcast Use Cases

Raiza highlights innovative use cases for NotebookLM, including a podcast series created by Andrew Karpathy that turns historical mysteries into engaging audio content. She also shares a humorous example of a podcast that creatively analyzes the words 'poop' and 'fart,' illustrating the platform's ability to generate entertaining and insightful content from unconventional sources.

"I would say like the number one the number one use case is actually a lot of students taking their uh study materials and wanting to turn it into an audio guide so two recent use cases that are hilari..."

28
34:02 - 35:59
1:56 duration408 words

The Power of Creative Analysis

In this segment, Raiza reflects on the creative analysis produced by NotebookLM, particularly in response to unconventional content. She shares her experience of listening to a podcast that humorously discusses bizarre topics, emphasizing the platform's potential to generate delightful and engaging narratives from seemingly trivial subjects.

"listen to it on your drive to work or something yeah so good okay the other one is the most funny is someone just uploaded the words poop and fart repeated right for a long time and the host just came..."

29
35:59 - 39:01
3:02 duration607 words

Collaborating with Stephen Johnson

Raiza discusses her collaboration with Stephen Johnson, a respected author and thinker, and how his unique approach to knowledge and information has influenced the development of NotebookLM. She shares insights into his creative workflows and the valuable lessons she has learned from observing his methods, emphasizing the importance of curiosity and respect in teamwork.

"there's a funny segment where they're like get this it's a it's a paper a research paper that has more chicken in it than KFC oh good good so good oh my God okay I could keep going about this all day ..."

30
39:01 - 41:56
2:54 duration625 words

The Impact of User Engagement

Raiza emphasizes the significance of engaging with users to gain insights into their needs and preferences. She shares her approach to understanding user behavior by observing students and their study habits, highlighting how this practice informs product development and enhances the overall user experience of NotebookLM.

"like hey there's something powerful about doing that right like thinking about this person who has like a super flow and trying to bring that bring that to people and so Stephen is also just like such..."

31
41:14 - 42:39
1:25 duration304 words

Collaboration and Conflict

Raiza reflects on her working relationship with Stephen Johnson, noting both their intellectual clashes and mutual respect. She discusses the value of disagreement in a creative environment, emphasizing how it leads to alignment on product goals and outcomes, which is crucial for product managers.

"article that he wrote um the one about how AI is mastering language should we trust with it says the New York Times piece and I remember reading it and being like yes this is the thing I'm going to wo..."

32
42:39 - 44:12
1:33 duration306 words

Navigating AI Misuse

Raiza addresses concerns about AI technology misuse, sharing her reaction to a viral moment where AI hosts realized they were not human. She discusses the importance of understanding user interactions with AI and the proactive measures Google takes to ensure safety and ethical use of their products.

"particularly for for product professionals right for PMS where it's like I don't want to disagree at the end and then not have an outcome on top I love that okay I have just a few more questions I kno..."

33
44:12 - 46:00
1:47 duration412 words

Red Teaming AI

In this segment, Raiza explains Google's approach to red teaming their AI products, detailing the extensive testing and safety measures in place. She emphasizes the importance of anticipating user behavior and adapting to unforeseen challenges to maintain product integrity and user trust.

"thought was the right thing to do which is I think people are getting to experience this technology for the first time ever and of course they're going to try to do things that are maybe something tha..."

34
46:00 - 48:22
2:21 duration515 words

Future of NotebookLM

Raiza shares insights into the future roadmap for NotebookLM, highlighting ongoing user feedback and the potential for new features. She expresses excitement about building for educators and knowledge workers, encouraging users to engage with the product and contribute to its evolution.

"make it do stuff that is feels wrong when it's just like hey we're just summarizing a thing for you in a really delightful way where do things go from here we talked about it a bit you're going to may..."