All Segments
The Supply and Demand of AI Tokens | Dylan Patel Interview
11 segments available
Patrick O'Shaughnessy sits down with Dylan Patel, founder of SemiAnalysis, to explore the explosive supply and demand dynamics of the AI revolution. Dylan shares how his firm's token spend skyrocketed to $7 million a year, completely transforming their productivity and highlighting a new era where execution is cheap, but high-quality ideas are at a premium. They dive into the implications of Anthropic’s frontier models like Opus 4.7 and "Mythos," the hidden bottlenecks in the semiconductor supply chain (including memory, TSMC, and CPUs), and the economic phenomenon of "phantom GDP." Finally, Dylan shares his bold prediction on the societal impact of rapid AI scaling, including why large-scale anti-AI protests might be just around the corner. Timestamps: 0:00 Intro 1:00 Surging AI Spend 10:27 Token Demand 16:21 When Ideas Are Cheap and Execution is Easy 20:46 Model Hoarding 22:34 Robotics 27:03 The Compute Bottleneck 30:26 The AI Permanent Underclass 31:39 Supply Chain Reality 37:47 CPUs 42:54 Predictions: Public Backlash #AI #Investing #Semiconductors #Anthropic #OpenAI #GPUs #TechTrends #FutureOfWork #MachineLearning #SemiAnalysis Presented by Ramp: https://ramp.com/invest Sponsored by Vanta, WorkOS, Rogo, and Ridgeline: https://www.vanta.com/invest https://workos.com/ https://rogo.ai/invest https://www.ridgelineapps.com/ ****** Patrick O'Shaughnessy is the CEO of Positive Sum. All opinions expressed by Patrick and podcast guests are solely their own and do not reflect the opinion of Positive Sum. This podcast is for informational purposes only and should not be relied upon as a basis for investment decisions. Clients of Positive Sum may maintain positions in the securities discussed in this podcast. To learn more, visit psum.vc
Segments Timeline
Intro
"What used to matter a lot was execution was very very [ __ ] difficult and ideas were cheap. Now ideas are cheap and plentiful but execution is very easy. So really only the good ideas are the ones th..."
Surging AI Spend
"uh Doug Olaflin. He's very much like leading the charge in the sense of like non-technical people using uh AI for coding. Um and so he's basically pled the whole firm slowly over time. I think he's be..."
Token Demand
"it factor, right? We move faster, we're more nimble, we're a smaller team that's focused on just one specific thing. uh AI infrastructure and and the huge revolution that causes in AI um and tokconomi..."
When Ideas Are Cheap and Execution is Easy
"do the thing and therefore it is actually cheaper in most tasks than 46 opus because it's just way more efficient even though each individual token is smarter. >> When I last saw you Methos had just c..."
Model Hoarding
"usage and therefore the benefits of those tokens the additional value generated on top of those tokens aggregates among fewer and fewer and fewer companies. I don't have mythos. You know who has mytho..."
Robotics
"is physical. You can see the world orient around hardware, not software. That's actually why I think software only singularity is like just a blip and not like a you know we we do get everything else ..."
The Compute Bottleneck
"In fact, they've raised a ton of money to get incremental compute in addition to the irresponsible levels of compute that they were buying from Oracle and Core and SoftBank and all these people and Mi..."
The AI Permanent Underclass
"potentially happens. >> Okay, let's talk about supply. what is going on like how would you describe the frontier of what's changing or what is changing at the frontier of supplying the the entire stac..."
Supply Chain Reality
"there. Places like optics and logic there are large prepayments um and margins are growing slowly um more so the companies that are making chips like Nvidia are paying huge prepayments. So in effect t..."
CPUs
"is skyrocketing there >> help people understand the role that CPU plays and everything. >> Yeah. So there's two there's two main reasons why you need tons of CPUs. One is when you're doing reinforceme..."
Predictions: Public Backlash
"like two weeks. They're like, people are cheering it on. Uh, and this is just the beginning. So, I think I think we'll see large scale protests against AI in three months. >> What is the counterwe to ..."