searchlore

Back to Resource

All Segments

Jensen Huang: NVIDIA - The $4 Trillion Company & the AI Revolution | Lex Fridman Podcast #494

Jensen Huang: NVIDIA - The $4 Trillion Company & the AI Revolution | Lex Fridman Podcast #494

21 segments available

Jensen Huang is the co-founder and CEO of NVIDIA, the world's most valuable company and the engine powering the AI computing revolution. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep494-sb See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc. *Transcript:* https://lexfridman.com/jensen-huang-transcript *CONTACT LEX:* *Feedback* - give feedback to Lex: https://lexfridman.com/survey *AMA* - submit questions, videos or call-in: https://lexfridman.com/ama *Hiring* - join our team: https://lexfridman.com/hiring *Other* - other ways to get in touch: https://lexfridman.com/contact *EPISODE LINKS:* NVIDIA: https://nvidia.com NVIDIA on X: https://x.com/nvidia NVIDIA AI on X: https://x.com/NVIDIAAI NVIDIA on YouTube: https://youtube.com/@NVIDIA NVIDIA on Instagram: https://www.instagram.com/nvidia/ NVIDIA on LinkedIn: https://www.linkedin.com/company/nvidia/ NVIDIA on Facebook: https://www.facebook.com/NVIDIA/ NVIDIA on GitHub: https://github.com/NVIDIA Nemotron: https://developer.nvidia.com/nemotron *SPONSORS:* To support this podcast, check out our sponsors & get discounts: *Perplexity:* AI-powered answer engine. Go to https://lexfridman.com/s/perplexity-ep494-sb *Shopify:* Sell stuff online. Go to https://lexfridman.com/s/shopify-ep494-sb *LMNT:* Zero-sugar electrolyte drink mix. Go to https://lexfridman.com/s/lmnt-ep494-sb *Fin:* AI agent for customer service. Go to https://lexfridman.com/s/fin-ep494-sb *Quo:* Phone system (calls, texts, contacts) for businesses. Go to https://lexfridman.com/s/quo-ep494-sb *OUTLINE:* 0:00 - Introduction 0:33 - Extreme co-design and rack-scale engineering 3:18 - How Jensen runs NVIDIA 22:40 - AI scaling laws 37:40 - Biggest blockers to AI scaling laws 39:23 - Supply chain 41:18 - Memory 47:24 - Power 52:43 - Elon and Colossus 56:11 - Jensen's approach to engineering and leadership 1:01:37 - China 1:09:50 - TSMC and Taiwan 1:15:04 - NVIDIA's moat 1:20:41 - AI data centers in space 1:24:30 - Will NVIDIA be worth $10 trillion? 1:34:39 - Leadership under pressure 1:48:25 - Video games 1:55:16 - AGI timeline 1:57:29 - Future of programming 2:11:01 - Consciousness 2:17:22 - Mortality *PODCAST LINKS:* - Podcast Website: https://lexfridman.com/podcast - Apple Podcasts: https://apple.co/2lwqZIr - Spotify: https://spoti.fi/2nEwCF8 - RSS: https://lexfridman.com/feed/podcast/ - Podcast Playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 - Clips Channel: https://www.youtube.com/lexclips *SOCIAL LINKS:* - X: https://x.com/lexfridman - Instagram: https://instagram.com/lexfridman - TikTok: https://tiktok.com/@lexfridman - LinkedIn: https://linkedin.com/in/lexfridman - Facebook: https://facebook.com/lexfridman - Patreon: https://patreon.com/lexfridman - Telegram: https://t.me/lexfridman - Reddit: https://reddit.com/r/lexfridman

Segments Timeline

1
0:00 - 0:33
0:33 duration75 words

Introduction

"- The following is a conversation with Jensen Huang, CEO of NVIDIA, one of the most important and influential companies in the history of human civilization. NVIDIA is the engine powering the AI revol..."

2
0:33 - 3:20
2:46 duration442 words

Extreme co-design and rack-scale engineering

"You've propelled NVIDIA into a new era in AI, moving beyond its focus on chip scale design to now rack scale design. And I think it's fair to say that winning for NVIDIA for a long time used to be abo..."

3
3:20 - 22:43
19:22 duration3201 words

How Jensen runs NVIDIA

"disciplines here. I'm sure you have specialists in each one of these high bandwidth memory, the network and the NVLink, the NICs, the optics and the copper that you're doing, the power delivery, the c..."

4
22:43 - 37:40
14:57 duration2445 words

AI scaling laws

"time is scaling laws, broadly defined. So are you still a believer in the scaling laws? - Yeah, yeah. Yeah, we have more scaling laws now. - So I think you've outlined four of them with pre-training, ..."

5
37:40 - 39:25
1:44 duration317 words

Biggest blockers to AI scaling laws

"- So you eloquently explained how we have a long history of blockers that we thought were going to be blockers, and we overcame them. But now looking into the future, what do you think might be the bl..."

6
39:25 - 41:21
1:56 duration297 words

Supply chain

"up at night? The bottlenecks in the supply chain of AI, like ASML with EUV lithography machines, TSMC with advanced packaging like CoWoS, and SK Hynix with the high bandwidth memory? - All the time, a..."

7
41:21 - 47:26
6:04 duration1017 words

Memory

"The number one DRAM in the world was DDR memory for CPUs in data centers. About three years ago, I was able to convince several of the CEOs that even though at the time HBM memory was used quite scarc..."

8
47:26 - 52:44
5:17 duration875 words

Power

"bit. What are your hopes for how to solve the energy problem? - One of the areas, Lex, that I'm that I would love, I would love us to talk about and just get the message out, you know our power grid i..."

9
52:44 - 56:11
3:27 duration584 words

Elon and Colossus

"- Uh, you've highly lauded Elon and xAI's accomplishment in Memphis, in building Colossus supercomputer, probably in record time in just four months. It's now at 200,000 GPUs and growing very quickly...."

10
56:11 - 1:01:41
5:30 duration886 words

Jensen's approach to engineering and leadership

"- Is there parallels in the NVIDIA Extreme Systems co-design approach that you see in the way Elon approaches systems engineering? - Well, first of all, co-design is an ultimate systems engineering pr..."

11
1:01:41 - 1:09:51
8:09 duration1147 words

China

"so it's interesting to ask you China's been incredibly successful in building up its technology sector. What do you understand about how China's able to, over the past 10 years, build so many incredib..."

12
1:09:51 - 1:15:08
5:17 duration776 words

TSMC and Taiwan

"You're originally from Taiwan and have a close relationship with TSMC. So I have to ask, TSMC I think also is a legendary company in terms of the engineering teams, in terms of the incredible engineer..."

13
1:15:08 - 1:20:42
5:33 duration851 words

NVIDIA's moat

"I have to ask, what is the NVIDIA's biggest moat, as the folks in the tech sector say? The edge you have that protects you from the competition. - Our single most important property as a company is th..."

14
1:20:42 - 1:24:30
3:48 duration595 words

AI data centers in space

"- Well, what do you think about the space angle that Elon has talked about, doing compute in space for solving some of the... It makes some of the energy issues in terms of scaling energy easier. - Co..."

15
1:24:30 - 1:34:39
10:09 duration1551 words

Will NVIDIA be worth $10 trillion?

"Do you think NVIDIA may be worth 10 trillion at some point? Let's ask it this way. What does the future of the world look like where that's true? - I think that NVIDIA's growth is Extremely likely, an..."

16
1:34:39 - 1:48:25
13:45 duration2194 words

Leadership under pressure

"Uh, I read that you attribute a lot of your success to your ability to work harder than anyone and withstand more suffering than anyone. So we can list many of the things that entails. I mean, dealing..."

17
1:48:25 - 1:55:22
6:57 duration1114 words

Video games

"- I'm glad you maintained that same spirit of Denny's the, the work. I mean, that, that was beautiful. Your whole journey from, starting from Denny's is a beautiful one. Let me ask you about video gam..."

18
1:55:22 - 1:57:30
2:07 duration312 words

AGI timeline

"question rests on your definition of AGI. So, let me ask you about possible timelines here. Let's, this ridiculous definition perhaps of what AGI is, but an AI system that's able to essentially do you..."

19
1:57:30 - 2:11:01
13:31 duration2174 words

Future of programming

"- You're gonna get a lot of people excited with that statement. It's like, what do you mean? I can- I can just, uh - ... launch an agent and make a lot of money. - Well, by the way, it's happening rig..."

20
2:11:01 - 2:17:25
6:23 duration924 words

Consciousness

"- Uh, do you think there's some things about human nature, about human consciousness that is fundamentally non-computational? Maybe something a chip, no matter how powerful, can never replicate? - I d..."

21
2:17:25 - 2:25:54
8:29 duration1321 words

Mortality

"and the lives of millions of people that I mentioned depend on you. But you're just one human, like we mentioned, a mortal like all of us. Do you think about your mortality? Are you afraid of death? -..."