All Segments
Noam Chomsky: Language, Cognition, and Deep Learning | Lex Fridman Podcast #53
19 segments available
Segments Timeline
Meeting a Legend
Lex Fridman shares a personal anecdote about his first encounter with Noam Chomsky at MIT, reflecting on the significance of that moment. He describes Chomsky as a seminal figure in linguistics and cognitive science, emphasizing the impact Chomsky has had on him and many others. This segment sets the stage for the deep conversation that follows, highlighting the honor Lex feels in engaging with such an influential mind.
"- The following is a conversation with Noam Chomsky. He's truly one of the great minds of our time and is one of the most cited scholars in the history of our civilization. He has spent over 60 years ..."
The Heartbreak of Technical Failures
Lex discusses the technical difficulties encountered during the recording of his conversation with Chomsky, specifically the accidental stopping of the video recording. He expresses his disappointment but also his hope that listeners will still enjoy the audio version of the podcast. This segment illustrates the challenges of podcasting while underscoring Lex's dedication to the project.
"Noam has been an inspiration to me and millions of others. It was truly an honor for me to sit down with him in Arizona. I traveled there just for this conversation, and in a rare, heartbreaking momen..."
The Purpose Behind the Podcast
In this segment, Lex explains the dual nature of his work, balancing his passion for building AI systems with his commitment to the podcast. He shares his vision for the podcast as a heartfelt side project and discusses the introduction of ads, aiming to maintain a seamless listening experience. This segment provides insight into Lex's motivations and the importance he places on the quality of his content.
"even when I screw things up. I recently started doing ads at the end of the introduction. I'll do one or two minutes after introducing the episode and never any ads in the middle that break the flow o..."
A Philosophical Inquiry
Lex poses a thought-provoking question to Chomsky about the possibility of finding a common language with an alien species. This segment introduces a philosophical exploration of language and communication, setting the stage for Chomsky's insights into the nature of language and cognition.
"And now here's my conversation with Noam Chomsky. I apologize for the absurd philosophical question, but if an alien species were to visit Earth, do you think we would be able to find a common languag..."
Language and Arithmetic: A Universal Connection
Chomsky discusses the potential for establishing communication with an alien species based on shared principles of arithmetic and language. He references Marv Minsky's experiments and concludes that higher intelligence would likely possess a form of arithmetic, suggesting a universal foundation for communication. This segment delves into the intersection of language, cognition, and the essence of intelligence.
"- [Noam] There are arguments to the effect that we could. In fact, one of them was Marv Minsky's. Back about 20 or 30 years ago he performed a brief experiment with a student of his, Daniel Bobrow the..."
The Dual Nature of Language
Chomsky elaborates on the distinction between internal and external systems of language. He explains how our internal language system determines our ability to express thoughts, while the externalization of language manifests as sounds in the environment. This segment highlights the complexity of language as both a cognitive and communicative tool.
"- [Lex] What is the structure of that language, of language as an internal system inside our mind versus an external system as it's expressed? - [Noam] It's not an alternative. It's two different conc..."
Language as the Core of Cognition
In this segment, Chomsky argues that language is fundamental to human cognitive nature, serving as the basis for thought construction and expression. He draws parallels between language and vision, asserting that our genetic endowment shapes our unique language faculty. This discussion emphasizes the creative capacities inherent in language and its role in human achievement.
"These are just different concepts. - [Lex] So how deep do the roots of language go in our brain? - Well-- - Our mind, is it yet another feature like vision? Or is it something more fundamental from wh..."
Limits and Scope of Human Cognition
Lex and Chomsky explore the concepts of limits and scope in human cognition. Chomsky challenges the belief that human intelligence can answer any question, suggesting that our biological nature imposes inherent limits. This segment invites reflection on the boundaries of human understanding and the relationship between our cognitive capacities and our biological endowment.
"- [Lex] The capacity to think and reason. Do you think that's deeply linked with language? Do you think the internal language system is essentially the mechanism by which we also reason internally? - ..."
The Interrelation of Richness and Boundaries
Chomsky illustrates how our genetic endowment allows for complexity while simultaneously imposing limits. He uses the example of visual systems to explain that the very traits that enable rich cognitive experiences also restrict the directions in which we can develop, suggesting that cognitive capacities share similar properties.
"- [Lex] Can you define those two terms? - [Noam] Well, let's take a concrete example. Your genetic endowment, it determines that you can have a mammalian visual system and arms and legs and so on and ..."
The Evolution of Scientific Understanding
Chomsky reflects on a pivotal moment in the history of science, where Newton's discoveries challenged the mechanical philosophy that dominated prior thought. He discusses how this shift led to an acceptance of mysteries in nature that science could not explain, highlighting the evolving goals of scientific inquiry.
"So for example there's a classic moment in the history of science at the time of Newton. There was from Galileo to Newton modern science developed on a fundamental assumption which Newton also accepte..."
Intuition and the Limits of Cognition
In this segment, Chomsky discusses how our intuitive understanding of the world may impose limits on cognition. He references experiments with infants to illustrate how humans naturally seek to impose order and intelligibility on their experiences, hinting at the cognitive boundaries we may face.
"We cannot attain the goal of understanding the world, of finding an intelligible world. This mechanical philosophy, Galileo to Newton, there's a good case that can be made that that's our instinctive ..."
Enhancing Cognition with Technology
Lex Fridman introduces the concept of brain-machine interfaces, questioning whether technology like Neuralink could expand human cognitive capacities. Chomsky responds by suggesting that while technology can enhance our cognitive abilities, it cannot fundamentally change the limits of our native capacities.
"We all know that from a television set basically. - [Lex] So that gives us hints of potential limits to our cognition? - I think it does, but it's a very contested view. If you do a poll among scienti..."
Understanding Quantum Mechanics and Its Limits
Chomsky and Fridman discuss the challenges of understanding quantum mechanics, emphasizing that while we can grasp the theories, the underlying reality remains unintelligible. Chomsky points out that this reflects a potential limit to human cognition, echoing Einstein's skepticism about quantum theory.
"- [Lex] Well, I mean the thought is perhaps you can't directly but you can map. - [Noam] You could be we know that without this experiment you could map what a bee sees and present it in a form so tha..."
The Beauty of Language Structure
Chomsky concludes by highlighting the fascinating aspects of language, particularly the concept of structure dependence. He provides examples of linguistic ambiguity to illustrate how language operates, showcasing the intricate relationship between language and cognitive processes.
"but it was puzzling for a long time. I'll give you a concrete example. So suppose you say, the guy who fixed the car carefully packed his tools. That's ambiguous, he could fix the car carefully or car..."
Deep Learning vs. Human Language
In this segment, Chomsky critiques the effectiveness of deep learning in understanding human language. He distinguishes between engineering applications and scientific understanding, arguing that while deep learning can be useful, it does not provide insights into the nature of language. Chomsky emphasizes the importance of critical experiments in science, contrasting them with the random data-driven approach of current machine learning models.
"of language with many consequences. - [Lex] Let me ask you about a field of machine learning and deep learning, there's been a lot of progress in neural network-based machine learning in the recent de..."
Learning from Data: A Linguistic Perspective
Chomsky explores the potential of learning from large datasets in linguistics, comparing it to anthropology where critical experiments are often impossible. He acknowledges that while data analysis can yield insights, it lacks the depth of understanding that comes from direct interaction with living language speakers. This segment highlights the challenges and limitations of studying language through historical data alone.
"- [Lex] So yes, neural networks are kind of approximators that look, there's echoes of the behavioral debates right, behavioralism. - More than echoes. Many of the people in deep learning say they vin..."
Human Nature and Institutional Evil
In a philosophical discussion, Chomsky reflects on the origins of evil in society, attributing it to institutions rather than human nature itself. He argues that human nature can manifest in various institutional forms, shaped by historical contingencies. This segment invites contemplation on the interplay between human intent and the societal structures that influence behavior.
"- [Lex] So let me venture into another whole body of work and philosophical question. You've said that evil in society arises from institutions, not inherently from our nature. Do you think most human..."
The Joy of Intellectual Discovery
Reflecting on his life, Chomsky shares moments of happiness tied to love and family, as well as the excitement of intellectual discoveries in linguistics. He emphasizes that significant insights often feel like common sense, illustrating how questioning seemingly obvious ideas can lead to profound understanding, akin to the scientific inquiries of the past.
"- [Lex] If you look back at your life, is there a moment in your intellectual life or life in general that jumps from memory that brought you happiness that you would love to relive again? - [Noam] Su..."
Creating Meaning in Our Existence
In a philosophical discussion, Chomsky addresses the meaning of life, asserting that individuals create significance through their actions rather than relying on a universal answer. He emphasizes that the meaning of existence is shaped by personal contributions and experiences, encouraging a proactive approach to finding purpose in life.
"So it seems obvious that a heavy ball of lead'll fall faster than a light ball of lead, but Galileo was not impressed by the fact that it seemed obvious. so he wanted to know if it's true He carried o..."