
18 segments available
Sergey Levine, co-founder of Physical Intelligence, joins the show to discuss the frontier of general-purpose robotics. Unlike traditional robots designed for specific tasks, Levine is building foundation models that enable robots to understand and interact with the physical world generally. They explore the shift from specialized bots to "physical intelligence," the parallels between LLMs and robotic learning, and how end-to-end AI models are solving complex motor control problems. Levine also covers the challenges of data collection, the "Robot Olympics" benchmarks, and realistic timelines for when robots might actually fold our laundry. This is a deep dive into the technology that could spark a Cambrian explosion in hardware and automation. #robotics #AI #machinelearning #physicalintelligence #automation #futuretech #deeplearning #techinvesting #investlikethebest #sergeylevine Timestamps: 0:00 Intro 2:39 Defining Physical Intelligence 5:19 The Challenge of Building General Models 6:34 The Stakes and Future of General Purpose Robotics 8:15 Pros and Cons of Humanoid Robots 10:12 Historical Milestones in Robotics Research 15:31 Combining Generative AI and Deep RL 21:24 Moravec's Paradox 25:33 Kitchen Robots 29:30 Simulation vs. Real-World Data 30:48 The Robot Olympics 36:31 The Physiological Reality of Embodiment 38:56 Controversies in the Robotics Community 44:18 What Makes a Great Researcher 48:27 How Businesses Should Prepare for Robotics 54:09 Tracking Progress Through Research Papers 57:02 The Next Step: Mid-Level Reasoning 1:02:00 The Kindest Thing Presented by Ramp: https://ramp.com/invest Sponsored by Vanta, WorkOS, Rogo, and Ridgeline: https://www.vanta.com/invest https://workos.com/ https://rogo.ai/invest https://www.ridgelineapps.com/ ****** Patrick O'Shaughnessy is the CEO of Positive Sum. All opinions expressed by Patrick and podcast guests are solely their own and do not reflect the opinion of Positive Sum. This podcast is for informational purposes only and should not be relied upon as a basis for investment decisions. Clients of Positive Sum may maintain positions in the securities discussed in this podcast. To learn more, visit psum.vc
"My guest today is Sergey Lavine, one of the co-founders and researchers at physical intelligence. As a disclaimer, I'm an investor in physical intelligence because I believe it's one of the most impor..."
"uh took over for all of those different application domains is because they can leverage much broader sources of data. And it's not even as simple as saying like, oh, we had this data for this applica..."
"setting. So obviously you kind of have to like understand what's going on to appreciate why this is actually pushing the frontier. >> What is your model for the stakes of what you're doing? Like if yo..."
"it a lot more attractable for lots of people, lots of companies, lots of individuals to try out all sorts of different things. >> And I think, you know, we sometimes we think that like robots are goin..."
"Uh, and I think that in the future we'll have a robotic foundation model which can then be adapted to all sorts of applications and and it might really r run the gamut from like, you know, like bulldo..."
"think that there are some very venerable concepts but historically what has been really difficult in robotic learning is that you need a system that that handles the application you want to address th..."
"robots in a room and have them all learn together and that works um and it generalizes but it's very hard for that to handle these like tail cases these edge cases right because now it becomes this ki..."
"basic AI to the lesson that scale is all you need and the sort of counterintuitive nature of that that you're not teaching it any specific thing just like blasting it with data and there's this reserv..."
"is um a shift where domains where collecting data is straightforward. They actually end up falling into the easy bucket over time, even if they are physically intricate. But there will be domains wher..."
"like are people comfortable with this level of imperfection. So probably there are some tasks for robots uh where people will be comfortable with something that's not perfect something that needs to l..."
"a robot going into a home, you know, one place where I can anticipate a challenge is that there are a lot of other unexpected things that can happen and you need a system that's very good at inferring..."
"plastic bag to pick up dog poop, right? That's like things that people don't find particularly challenging, but that like no current robotic system can do. And he listed, you know, maybe a dozen of th..."
"Uh, and you can speed things up further. So you can get to a task where a person demonstrates what it means to succeed and then you can have the robot practice the task and succeed in the same way but..."
"applications of LLMs is that they are like really accessible and uh somebody could put together a really cool new prototype that under the hood is just like prompting like you know chat GPT or somethi..."
"behaviors that interact with other people uh where you have to like uh you know actually help somebody like you have to help somebody get out of bed or something like that. I think that's a lot harder..."
"passionate about that but even that passion can come from many different places like I've worked with people that were remarkably effective that are just driven purely by like the desire for novelty l..."
"So that's kind of a case a case study of how changes in technology will dramatically alter this >> from a business standpoint. Is the right way to think about it just like get really clear on the econ..."
"wide range of different advance a cluster a constellation as you said uh that have pushed down the price point of these things and I think that does make it a lot more practical to think about general..."