Dylan Patel, AI and semiconductor expert, joins Patrick O'Shaughnessy to dive deep into the past, present, and future of compute. They explore the massive capital requirements driving AI development, from OpenAI's $300B Oracle deal to NVIDIA's strategic partnerships. The conversation covers power infrastructure challenges, US-China competition in AI, talent wars reaching unprecedented levels, and why the current AI boom differs from previous tech bubbles. Dylan shares insights on which companies will capture value in the AI stack, from hardware makers like NVIDIA to application companies like Meta and Google, while examining the geopolitical implications of the global AI race.

Timestamps:
00:00 Intro
00:39 The OpenAI and Nvidia Deal: The Infinite Money Glitch
03:04 OpenAI's Compute Challenge and Capital Requirements
04:42 Oracle's $300 Billion Bet on OpenAI
06:06 Nvidia's Strategic Investment and Deal Mechanics
06:53 Understanding the Demand Dynamics
07:41 Scaling Laws and Diminishing Returns Debate
09:17 Why Bigger Models Aren't Always Better
10:51 The Economics of Tokens and Serving Capacity
15:07 Rate Limits and the Adoption Curve Problem
19:01 The Tokenomics of AI
22:02 Inference Latency vs Cost Trade-offs
23:59 Over-Parameterization and Model Learning
28:10 Building Environments for AI Training
32:16 AI in Everyday Life
34:46 The Future of Reasoning and Compute Scaling
38:45 Memory and Context in AI: Short-term vs Long-term
44:34 The Spectrum of AI Optimism
46:29 Timeline to AGI
47:56 Physical Intelligence and Embodiment
49:25 Talent Wars
58:37 Power Dynamics in the AI Ecosystem
01:00:51 Microsoft and OpenAI: A Shifting Power Balance
01:03:23 Nvidia's Dominance and Balance Sheet Strategy
01:12:32 The Middle Layer
01:14:47 The Risk Spectrum
01:18:42 AI for Material Science and Hard Tech
01:22:21 Building Infrastructure
01:27:11 Grid Regulations and Backup Power Challenges
01:29:55 US vs China: Who Really Needs AI to Win?
01:37:42 Favorite AI Bears
01:43:57 Hardware Innovation Beyond Accelerators
01:48:08 Speed Round: Company Impressions
01:55:11 The Death of Traditional SaaS Business Models
02:00:24 The Kindest Thing

#AI #Semiconductors #OpenAI #NVIDIA #ComputeInfrastructure #TechInvesting #ArtificialIntelligence #MachineLearning #DataCenters #TechStrategy #claude #podcast

Presented by Ramp:
https://ramp.com/business-cards?utm_s

Sponsored by AlphaSense and Ridgeline:
https://www.alpha-sense.com/invest/
https://www.ridgelineapps.com/

******
Patrick O'Shaughnessy is the CEO of Positive Sum. All opinions expressed by Patrick and podcast guests are solely their own and do not reflect the opinion of Positive Sum. This podcast is for informational purposes only and should not be relied upon as a basis for investment decisions. Clients of Positive Sum may maintain positions in the securities discussed in this podcast. To learn more, visit psum.vc