
44 segments available
Mark Zuckerberg is CEO of Meta. Thank you for listening ❤ Please support this podcast by checking out our sponsors: - LMNT: https://drinkLMNT.com/lex to get free sample pack - InsideTracker: https://insidetracker.com/lex to get 20% off - Eight Sleep: https://www.eightsleep.com/lex to get special savings - AG1: https://drinkag1.com/lex to get 1 month supply of fish oil - NetSuite: http://netsuite.com/lex to get free product tour TRANSCRIPT: https://lexfridman.com/mark-zuckerberg-3-transcript EPISODE LINKS: Mark's Facebook: https://facebook.com/zuck Mark's Instagram: https://instagram.com/zuck Mark's Threads: https://threads.net/@zuck Meta AI: https://ai.meta.com/ Meta Quest: https://www.meta.com/quest/ Meta Connect 2023: https://www.metaconnect.com PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ Full episodes playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 Clips playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41 OUTLINE: 0:00 - Introduction 0:52 - Metaverse 15:27 - Quest 3 30:16 - Nature of reality 34:54 - AI in the Metaverse 51:51 - Large language models 57:49 - Future of humanity SOCIAL: - Twitter: https://twitter.com/lexfridman - LinkedIn: https://www.linkedin.com/in/lexfridman - Facebook: https://www.facebook.com/lexfridman - Instagram: https://www.instagram.com/lexfridman - Medium: https://medium.com/@lexfridman - Reddit: https://reddit.com/r/lexfridman - Support on Patreon: https://www.patreon.com/lexfridman
In this segment, Lex Fridman introduces Mark Zuckerberg in a groundbreaking metaverse setting, highlighting the immersive experience of interacting as photorealistic avatars. They discuss the significance of this technology in enhancing human connection and communication, emphasizing the emotional nuances captured through advanced avatar technology.
"the following is a conversation with Mark Zuckerberg inside the metaverse Mark and I are hundreds of miles apart from each other in physical space but it feels like we're in the same room because we a..."
Zuckerberg and Fridman marvel at the realism of their avatars in the metaverse, discussing how it feels like they are in the same room despite being miles apart. They explore the technology behind creating these avatars, including the scanning process that captures facial expressions and nuances, making virtual interactions feel more authentic.
"[Laughter] this is so great lighting change wow oh yeah we can put the light anywhere and it doesn't feel awkward to be really close to you no it does I actually moved you I moved you back a few feet ..."
Mark Zuckerberg explains the technical aspects of creating photorealistic avatars through detailed facial scans. He emphasizes the importance of capturing subtle human expressions and imperfections, which enhance the immersive experience and convey emotions more effectively than traditional video calls.
"it feels like we're in the same room yeah it feels like the future this is truly truly incredible I just wanted to take it in I'm still getting used to it it's like it's you it's really you but you're..."
Zuckerberg shares his vision for the future of virtual reality and augmented reality, discussing how these technologies can create a sense of presence and connection regardless of physical distance. He highlights the potential for more immersive experiences in personal and professional settings, transforming how we communicate.
"um so in addition to being photorealistic it's also actually much more bandwidth efficient than transmitting a a full video or especially a 3D immersive video of a whole scene like this and it capture..."
In this segment, Zuckerberg discusses the challenges of making photorealistic avatars accessible to a broader audience. He outlines plans for simplifying the scanning process using smartphones, aiming to allow more people to create their own avatars quickly and efficiently.
"good embodiment of that where it's like coming or in two completely different states halfway across the country and it just like you know looks like you're just sitting right in front of me it's uh it..."
Zuckerberg elaborates on the unique capabilities of the metaverse that go beyond traditional video calls. He envisions a future where people can engage in shared activities, such as gaming and meetings, in a virtual space that feels physically present, enhancing collaboration and social interaction.
"scans if you you know have hours to sit for one and with today is technology I mean you're using a meta headset that exists it's a product that's kind of for sale now you can drive these with that um ..."
Fridman and Zuckerberg discuss the concept of the uncanny valley in relation to avatar realism. They explore how subtle expressions, particularly in the eyes, contribute to the perception of emotion and connection in virtual interactions, and how this technology can bridge gaps in communication.
"think it's going to be a pretty wild uh next few years around this I mean I just I'm actually almost at a loss of Wars this is just so incredible this is truly incredible I I hope that people like wat..."
Zuckerberg outlines the timeline for rolling out codec avatars and the gradual integration of this technology into Meta's applications. He emphasizes the importance of user feedback and continuous improvement to enhance the experience of remote interactions in the metaverse.
"the The Uncanny Valley here where it and it does feel like you it doesn't feel uh it doesn't feel weird or anything like that I mean that's going to be the meme that the two most monotone people are i..."
In this segment, Zuckerberg shares insights on how the Metaverse can revolutionize remote meetings. He highlights user feedback on the immersive experience of work rooms, where participants feel physically present despite being remote. The discussion includes the challenges of avatar expressiveness and the potential for more realistic interactions in virtual environments.
"not gonna be like we roll it out and one day everyone has a codec Avatar we want to get more people scanned and into the system and then we want to start uh integrating it into each one of our apps ri..."
Zuckerberg introduces the Quest 3 as a groundbreaking mixed reality device that combines digital and physical worlds. He explains how this technology will enhance remote interactions, allowing users to overlay digital expressions onto their physical surroundings, making experiences more engaging and interactive.
"so I think something like this um could make a very big difference for those remote meetings and especially with Quest 3 coming out which is going to be the first mainstream mixed reality product righ..."
Zuckerberg reflects on the emotional depth that mixed reality can bring to interactions. He expresses excitement about the potential for users to experience subtleties of emotion in virtual meetings, emphasizing the importance of realistic avatars and the ability to convey genuine feelings in digital spaces.
"um few years you'll be seeing a bunch more experiences like this yeah I would love to see some celebrities scanned and some non-celebrities uh I just just more people to experience this I would love t..."
In this segment, Zuckerberg addresses the technical challenges of creating realistic avatars and environments in the Metaverse. He discusses the balance between fidelity and performance, highlighting the importance of facial expressions in conveying emotions and the ongoing work to improve avatar realism.
"like work meetings or any kind of in terms of podcasts this is like this is awesome and I don't even need your arms or legs is that well we gotta get bad I mean that's that's its own challenge um and ..."
Zuckerberg shares details about the innovations in Quest 3, including its mixed reality capabilities and improved hardware. He explains how the device will provide a more comfortable and immersive experience, making it accessible to a wider audience while enhancing the overall quality of virtual interactions.
"the thing that we have the most resolution on right in terms of being able to read and express emotions I mean like you said if you move your you know eyebrows like a millimeter I mean that really cha..."
Zuckerberg discusses the evolution of mixed reality technology and its implications for user experiences. He emphasizes the importance of integrating digital and physical realities, allowing users to interact with both seamlessly. This segment highlights the potential for mixed reality to redefine how we engage with our environments.
"coming out it's 500 and um in in some ways I think the mixed reality is actually better in quest 3 than it was um than what we're using right now in quest Pro so I'm really proud of the team for being..."
In this segment, Zuckerberg envisions a future where digital holograms coexist with physical objects in our daily lives. He explores the psychological implications of this integration and how it challenges traditional notions of the 'real world,' suggesting that the combination of physical and digital experiences will redefine reality.
"so um so I'm really excited to get this in people's hands it um it does all the VR stuff that that Quest 2 and the others have done too it does it better because the display is better and and the chip..."
Zuckerberg highlights the safety benefits of mixed reality experiences, allowing users to engage in immersive activities without the fear of physical hazards. He discusses how this technology can enhance comfort and security, making it more appealing for various applications, from gaming to social interactions.
"living room or a meeting space or an office um another thing that I just think is going to be a much kind of simpler innovation is that there are a lot of VR experiences today that don't need to be fu..."
Zuckerberg delves into the technical challenges of achieving real-time interaction in mixed reality. He explains the complexities of mapping physical spaces and ensuring that digital objects align accurately with users' perspectives, emphasizing the ongoing advancements in AI and camera technology to enhance these experiences.
"like enjoy the Ridiculousness of you like swinging your arms I mean person will be their friends of yours even if they make fun of you they uh there's a lot of love behind that and that you guys I got..."
In this segment, Zuckerberg discusses the potential for holographic experiences to become commonplace in everyday life. He envisions a future where digital representations are as integrated into our environments as physical objects, transforming how we perceive and interact with the world around us.
"that to your perspective right because the cameras aren't exactly where your eyes are because no two people's eyes are you're not going to be in exactly the same place you kind of need to to get that ..."
Zuckerberg concludes by reflecting on the convergence of digital and physical realities. He emphasizes the importance of this integration for creating a cohesive experience that enhances our understanding of the modern world, where both realms coexist and enrich our interactions.
"without so you don't need to have a control so this count the cameras aren't interested in the pass-through uh of the entire physical reality around you is also tracking the details of your hands in o..."
Mark Zuckerberg discusses the potential of Kodak Avatars and holograms in the metaverse, envisioning a future where physical and digital worlds merge seamlessly. He highlights how this technology could transform our interactions, allowing for photorealistic avatars and digital objects to coexist in our physical spaces, fundamentally changing our perception of reality.
"us to have ultra realistic copies of ourselves in this mixed reality it's uh so like it's all converging towards like an incredible digital experience in the metaverse to me obviously I love the intim..."
In this segment, Zuckerberg explores the implications of photorealistic avatars in social interactions and meetings. He speculates on how these avatars could enhance our experiences, allowing for more immersive and meaningful connections, while also raising questions about identity and the nature of our digital selves.
"but increasingly I think a lot of the things that we kind of think of um can be digital Holograms I mean any screen that you have can be a hologram um you know any media in any book art um you know it..."
Zuckerberg delves into the philosophical implications of using photorealistic avatars, questioning what it means to be 'real' in a digital context. He discusses how our perceptions of identity may shift as we interact with digital versions of ourselves and others, and the potential for these avatars to represent our best selves or idealized versions.
"really curious to see where it goes longer term I could see a world where people stick to the photo realistic and maybe they modify them to make them a little bit more interesting but maybe fundamenta..."
In a poignant discussion, Zuckerberg reflects on the possibility of interacting with loved ones who have passed away through the metaverse. He considers the emotional impact of such experiences and the ethical considerations that come with blending memories and digital representations of those we've lost.
"time yeah and and I mean it's also it's novel and it's also a technological feat right it's like being able to pull this off is like it's a it's like a pretty impressive and I I think to some degree i..."
Zuckerberg addresses the complexities of managing digital identities after death, sharing insights on how Meta handles memorialization of accounts. He emphasizes the need for best practices in preserving memories while respecting privacy, highlighting the evolving relationship between technology and our understanding of life and death.
"another version of this is is how this intersects with AIS right because and one of the the things that that were really focused on is you know we we want there to we want the world to evolve in a way..."
Zuckerberg shares his vision for a future where creators can build AI versions of themselves to engage with their communities. He discusses the various applications of AI, from assisting in business interactions to enhancing social experiences. This segment emphasizes the potential for AI to enrich human connections and the importance of developing reliable AI models.
"super intelligence but where you know a lot of people are empowered by having AI tools to to do their jobs and you know make their lives better and if you're a Creator right and or if you run a you kn..."
Mark Zuckerberg outlines the development of AI personalities that can interact across Meta's platforms. He discusses the challenges of creating AI that accurately represents real individuals while ensuring they communicate appropriately. This segment highlights the ongoing experimentation with AI characters and the potential for these technologies to transform user experiences.
"um version where you know people who know that they're interacting with an AI that it's not you know the the kind of physical version of you but maybe that AI even if they know it's an AI is the next ..."
In this engaging discussion, Zuckerberg envisions how AI can enhance gaming experiences and social interactions. He shares ideas about AI characters that can tell jokes or serve as dungeon masters in games, emphasizing the role of AI in fostering connections among users. This segment captures the excitement around integrating AI into entertainment and social platforms.
"going to want a variety of these um so there are a bunch of different uses um if some will be kind of more assistant oriented there's a sort of the kind of plain and simple one that we that we're buil..."
Zuckerberg discusses the creative possibilities of AI in the Metaverse, including the development of unique characters and experiences. He reflects on the cultural significance of AI personalities and the technical challenges involved in ensuring they resonate with users. This segment highlights the innovative potential of AI to create engaging and personalized interactions.
"connect in different ways and part of what I'm what I'm excited about is how do you enable these kind of AIS to facilitate connection between two people or more you know put them in a group chat you k..."
In this segment, Zuckerberg addresses the complexities of creating AI that embodies real individuals. He explains the importance of ensuring that AI personalities reflect the values and preferences of their creators while maintaining a level of predictability in their interactions. This discussion underscores the ethical considerations and technical hurdles in developing AI representations.
"mention you mentioned Snoop to create a snoop AI so basically AI personality replica a copy or not a copy maybe um inspired by Snoop what are the some of the technical challenges of that what does tha..."
Zuckerberg shares his thoughts on the merging of physical and digital realities through the Metaverse. He reflects on the transformative potential of these technologies to enhance human experiences and interactions. This segment captures the excitement and philosophical implications of living in a world where digital and physical realities coexist.
"they're just more and more I don't know you could say like reliable or predictable in terms of what they'll communicate so that way you know when you want to create the Lex um assistant AI that that y..."
In the concluding segment, Zuckerberg discusses the future of human interaction in a digitally enhanced world. He emphasizes the importance of creating immersive experiences that feel real and meaningful. This segment encapsulates the vision of a future where technology enriches human connections and transforms the way we perceive reality.
"a surreal experience it feels like uh if I was like an ape looking in a mirror for the first time realizing like oh that's you but then freezing that and being able to look around like I'm looking at ..."
In this segment, Zuckerberg discusses the importance of merging physical and digital experiences in technology. He emphasizes that human beings are not meant to be sedentary and that the future lies in creating immersive environments that allow for movement and interaction, enhancing the human experience beyond traditional screens.
"yeah I think it's a weird experience it's just it feels like the early days of like a totally new way of living and like there's a lot of people that kind of complain well you know the internet is not..."
Zuckerberg addresses the ethical considerations of the Metaverse, particularly regarding what is permissible in a digital environment compared to the physical world. He discusses the need for content policies and the balance between freedom and responsibility in creating a safe digital space, highlighting the unique challenges posed by anonymity in online interactions.
"uh yeah I do think that this is the future this is I think the kind of philosophical way that I would want the world to work in the future is a much more coherently Blended physical and digital world ..."
This segment focuses on the potential of the Metaverse to redefine how we interact and work together. Zuckerberg envisions a future where people can feel physically present with one another, regardless of their actual locations, thus enhancing collaboration and building stronger relationships in a digital workspace.
"get into you know uh some world with my friends the the first thing we start doing is shooting each other which obviously we would not do in the physical world because you'd hurt each other um but in ..."
Zuckerberg discusses the implications of the Metaverse for remote work, suggesting that it could bridge the gap between physical presence and digital communication. He believes that as technology evolves, it will enable people to work from anywhere while still feeling connected, thus fostering a more cohesive work culture.
"Behavior so if that needs to get sorted out um so I think in terms of what is allowed I think you want to just look at what what what are the the damages but then there's also other things that are no..."
In this segment, Zuckerberg reflects on the release of Llama 2, an open-source AI model, and its impact on the AI community. He discusses the excitement surrounding its adoption and the importance of transparency in AI development, hinting at future iterations and the ongoing commitment to responsible AI practices.
"could live physically where they want while still being able to get the benefits of being physically or kind of feeling like you're together with people at work all the ways that that helps to build m..."
Zuckerberg shares insights on the future of AI models, including the potential for Llama 3. He emphasizes the importance of rigorous assessment and safety in AI development, while also expressing enthusiasm for the creative possibilities that open-source models can unlock for developers and users alike.
"that we did together we were talking about the debate that we were having around open sourcing llama too and I'm I'm glad that we did um you know I think at this point yeah there's the the value of op..."
This segment dives into the concept of AI personas and their integration into user experiences. Zuckerberg discusses the diverse applications of AI, from text-based games to historical figures, and the importance of community engagement in shaping these technologies. He highlights the need for experimentation and learning as society navigates the evolving landscape of AI.
"um I think just like we had a debate around llama 2 and open sourcing it um I think we'll we'll need to have a similar debate and process to Red Team this and make sure that this is safe but and my ho..."
Zuckerberg concludes by discussing the potential of a platform called AI Studio, which aims to empower users to create their own AI experiences. He expresses excitement about the creativity that will emerge from the community and the importance of fostering an environment where users can innovate and explore the capabilities of AI technology.
"yeah I mean part of what we're trying to do with the initial AIS launch is um having a diversity of different use cases just so that people can try different things because I don't know what's going t..."
In a reflective moment, Zuckerberg and Lex Fridman discuss the immersive experience of interacting in the metaverse, where physical presence is simulated. Zuckerberg articulates the philosophical implications of this technology, suggesting that the subjective experience of presence may redefine our understanding of reality and human connection.
"I don't I don't think anyone out there is really doing what we're doing here I think that there are there are people who are doing kind of like fictional or consumer oriented character type stuff but ..."
Zuckerberg elaborates on the merging of physical and digital worlds, emphasizing the profound impact of technology on human interaction. He argues that the metaverse can enhance social and psychological benefits, allowing for intimate conversations without the constraints of physical presence, thus reshaping civilization.
"not even predict changed civilization well I mean this is a lot of a thesis behind the whole meta versus giving people the ability to feel like you're present with someone I mean this is like the main..."
Zuckerberg discusses the evolution of social networks from text to video and the future potential of immersive experiences in the metaverse. He highlights the technological challenges involved in creating a platform that fosters genuine human connection and expresses excitement about the possibilities that lie ahead.
"we want to run away from that and just spend all day on a screen and that's like you know it's one of the reasons why I care so much about about helping to shape and accelerate the these future Comput..."
In this segment, Zuckerberg reflects on the transformative potential of the metaverse, emphasizing its ability to deliver social and psychological benefits. He believes that the metaverse represents a significant advancement in how we connect and communicate, marking a new frontier in human interaction.
"um you know there's a level of communication because so much of communication is non-verbal and is based on Expressions that you're kind of you're you're sharing with with someone when you're in this ..."
Lex Fridman expresses his amazement at the immersive experience of conversing with Zuckerberg in the metaverse. The conversation highlights the surreal nature of virtual interactions and concludes with gratitude for the opportunity to engage in such a groundbreaking format, underscoring the emotional impact of this technological advancement.
"of of the metaverse and what you know why you know I I just well I think that that's the next Frontier for for what we're working on you know I started working on social networks when they were primar..."