"If the models don't improve, we're absolutely screwed. And in fact, the US economy will go into a recession. >> It's about the highest stakes like capitalism game of all time. >> Godsend in terms of l..."

"I was going to lay out this idea of going through the past, present, and future of compute as like the big big idea for our conversation, but since it just happened, I don't think you've heard you tal..."

"slow to wake up and then you know they were slow to pivot their data center operations. They were slow to do everything and so there while they could have way more compute than anyone by a humongous d..."

"at the end of the day. OpenAI is committing to fiveyear deals. These five-year deals cost X amount of money. It's 10 to 15 billion dollars per gigawatt of data center capacity that you pay a year. And..."

"and more debt so this this game now now Nvidia's kind of got the same conundrum right it's like well Google and Amazon are doing these these deals whether it's uh to two other vendors for TPUs or for ..."

"from >> I want to dig into the underlying assumptions driving this on the training and inference side because obviously there's the willingness like Zuckerberg just needs to go down the hall to a CFO ..."

">> given it's a log log chart right uh scaling laws are right given there's no model architecture improvements you just throw more compute data model size at it it gets better at this pace >> but you'..."

"right? Um, and so I'm I'm holding those sort of off to the side for now. But that that iterative like performance improvement in the model is is like I like I mentioned earlier, right? It's like a six..."

"know already in it's the fastest revenue ramp we've ever seen for anything of this >> and it's basically all code related >> right I mean like you know some of it's their own cloud code product some o..."

"model for thinking about that today? What most interests you in the in the growth of just broad? >> So so the thing I like to call it is tokconomics and I I stumbled upon the word actually it's like a..."

"also like how can Can I get people to adopt it if I don't let people use it? And so, so open had this tremendous problem with GPD 40, right? 4 and then 4 turbo was smaller than 4 and 4 was smaller tha..."

">> Inference is like always it's it's it's a curve again, right? Like all of these things are curves and it's a trade-off, right? Everything in engineering is a trade-off. So So you have inference lat..."

">> Yeah. And as a result, we're just going to probably have to wait a little bit longer to see what the bigger models are in practice in a way that to to see what consumers actually do with them becau..."

"here's a medical case, what's wrong with it? And then you have another model say, well, here's here's your instructions on how you would grade the result of a case. What looks like they didn't even tr..."

"learners >> and and the so what of let's say we fast forwarded we're in the seventh inning of that or something like this. What do you think the way that the average person will most feel that differe..."

">> before asking even more holistically kind of your view on where we're going there there's a third category which is the reasoning part of the equation so we've got pre-training we've got RL and env..."

"smart. >> On the topic of like embodiment, uh, and continuing with the human analogy, how do you think about things like short and long-term memory in a human versus just like raw model capacity or so..."

"I add all of this up and you know hold the mirror up, it's it seems like I would put you in the category of like unbelievably bullish on what these things are going to be able to do in 10 years time o..."

"cloud the world is how much more efficient? Hey, making making all these random applications and like automated reports and like stop using Excel as a database, but instead like you can make a real da..."

"intelligence is doing? attacking the whatever you want to call it large movement model or large robot model or something. >> What are they actually doing today is like holy [ __ ] it's so simple in te..."

"we're squeezing down the fewer and fewer number of people that really matter that will have all the impact on where we go uh in terms of like net new research and that means that all this crazy spendi..."

"structural stuff like just the scale the industrial scale of some of these things which just takes forever to build or whatever. How do you think about um even smaller zoomed in examples like okay cur..."

"Microsoft, the most crazy power dynamic that's going on in the world. um where they signed aou that said they had an understanding of like what the deal would actually be for them converting to for-pr..."

"one around Nvidia and the hyperscalers, right? Nvidia is the king. All of the gross profit is going to them today, right? Pretty much all of it. Sure, TSMC makes some, sure, SKH makes some, but they h..."

"companies in the middle? We've talked a lot about Nvidia and then like people at the end serving applications. What about these companies like together and base 10 and fireworks and you mentioned Nebi..."

"amazing margins when I sell to OpenAI, but they don't have a balance sheet. So how can I be sure that they're actually going to pay the thing that they've signed up to? Right? So, so you know, I know ..."

"than the revenues go up, >> right? But the revenues still go up. That's sort of like the fundamental basis of semiconductors, of tech, everything, right? Are we doing things that we can't do before wi..."

"beginning and power. What are your thoughts on like what is going on here and how like humanity is responding to this crazy new demand for just raw power? The first approximation is that like we're be..."

"Daario and then you take a few steps and it's like it's like ML researchers, the average ML researcher, then it's like me and then it's like you in terms of how bullish we are on AI and the guy at the..."

"of this between the US and China so you know power semis models applications etc where do you think the most interesting differences are like what are the what are the story lines between us and China..."

"and import doing the same thing they've done forever, which is like prepare at the base level and be behind at the customer side and the value the value happens close to the customer. But then like yo..."

"but it would take hell of a badass thing. But I think there's a lot of individual parts of the supply chain which are not spaceaged, right? Um, Nvidia space age, yes, it's the biggest value value owne..."

"you just give me like you know a sentence or two on like your impression of them just like just like how how you feel about them in this moment. Yeah, >> start with Open AI. >> Oh, yeah. Super awesome..."

"constantly get asked is like, okay, Dylan, you know, you're lucky your obsession is that you loved hardware and you like followed it and you followed the supply chain and and you built this business o..."

">> Done for me? H I mean, it have to be my brother. Everything he's done in my life. Um I've been a [ __ ] my whole life and I still am a [ __ ] Um, and so like every time he like pulls me back on pat..."