"the following is a conversation with Jim Keller legendary microprocessor engineer who has worked at AMD Apple Tesla and now Intel he's known for his work on AMD K 7 K 8 K 12 and Xen microarchitectures..."

"artificial intelligence podcast if you enjoy it subscribe on YouTube give it five stars an apple podcast follow on Spotify supported on patreon or simply connect with me on Twitter Alex Friedman spell..."

"in similarities between the human brain and a computer with the microprocessors core let's start with a philosophical question perhaps well since people don't actually understand how human brains work..."

"let's get into the basics before we zoom back out how do you build a computer from scratch what is a microprocessor what is it microarchitecture what's an instruction set architecture maybe even as fa..."

"so when you when you build a computer you know first there's a target like what's it for look how fast does it have to be which you know today there's a whole bunch of metrics about what that is and t..."

"for relatively long periods of time instruction sets are stable so the x86 instruction said the arm instruction set what's an instruction set so it says how do you encode the basic operations load sto..."

"the the computer sort of has a bunch of bookkeeping tables it says what order CDs operations finishing or appear to finish him but to go fast you have to fetch a lot of instructions and find all the p..."

"is it to discuss well how hard is it that's just transistor count right so once you crack the problem you say here's how you fetch ten instructions at a time here's how you calculated the dependencies..."

"effective okay so parallelism you can't paralyze branches or you can looking pretty you can what is predict a branch mean or what open take so imagine you do a computation over and over you're in a lo..."

"cool but that's not how anything works today they use something that looks a little like a neural network so modern you take all the execution flows and then you do basically deep pattern recognition ..."

"says so executed down this path and then you had two ways to go but far far away there's something that doesn't matter which path you went so you miss you took the wrong path you executed a bunch of s..."

"because some people are very good at making those intuitive leaps it seems like the combinations of things some people are less good at it but they're really good at evaluating your alternatives right..."

"problem so if you run a correct C program the definition is every time you run it you get the same answer yeah that well that's a math statement but that's a that's a language definitional statement s..."

"have experimented with algorithms that say can get faster answers by being noisy like as the network starts to converge if you look at the computation graph it starts out really wide and it gets narro..."

"because almost everything going into monetary calculations is noisy so why the answers have to be so clear it's right so where do you stand by design computers for people who run programs so somebody ..."

"set of brilliant ideas that that were involved in well I find that description odd and I has two small children and I promise you they think it's hilarious this question yeah so I dude so I I'm I'm re..."

"after a lot of years of building computers where you sort of build them out of the transistors logic gates functional units come computational elements that you could think of people the same way so p..."

"right so do you know the difference between a recipe and understanding there's probably a philosophical description of this so imagine you can make a loaf of bread yeah the recipe says get some flour ..."

"there's there's a different you know way of viewing everything and most people when you get to be an expert at something you know you're you're hoping to achieve deeper understanding not just a large ..."

"everything for deeper understanding you never get anything done right and if you don't unpack understanding when you need to you'll do the wrong thing and then at every juncture like human beings are ..."

"like going towards the fundamental limits of physics sort of really getting into the core of the sighs well in terms of building the computer thinks simple think a little simpler so common practice is..."

"think people think Moore's law is one thing transistors get smaller but actually under the sheets ours literally thousands of innovations and almost all those innovations have their own diminishing re..."

"competent transistor designer could count both atoms in every single direction like there's techniques now to already put down atoms in a single atomic layer and you can place atoms if you want to it'..."

"to another two weeks well here's the thing about Moore's law right so I believe that the next 10 or 20 years of shrinking is going to happen right now as a computer designer there's you have two stanc..."

"of it and also to cope with it like that's the thing people to understand it's like if I didn't believe in Moore's law and Moore's law transistors showed up my design teams were all drowned so what's ..."

"abstraction layers is really high we used to build computers out of transistors now we have a team that turns transistors and logic cells and our team that turns them into functional you know it's ano..."

"you know from simple equation to linear equations to matrix equations to it's a deeper kind of computation and the data sets are getting so big that people are thinking of data as a topology problem y..."

"of search for the I don't know if you looked at the inner layers of finding a cat it's not a search it's it's a set of endless projection so you know projection and here's a shadow of this phone yeah ..."

"kind of thing and okay in that sense you can say yeah yeah you know I could see how you you might say if if you the funny thing is it's the difference between given search space and found search space..."

"continues shrinking the transistor or is it another s-curve that steps in and it totally so dope shrinking the transistor is literally thousands of innovations right so there's so this they're all ans..."

"lot yes this innovation from just that shrinking yeah like a factor of a hundred salade yeah I would say that's incredible and it's totally it's only 10 or 15 years now you're smarter you might know b..."

"that you're one of the key architects of this kind of futures you're not we're not talking about the architects of the high-level people who build the Angry Bird apps and flapping Angry Bird of who kn..."

"unpredictable if I wasn't here somebody else are doing the the vectors of all these different things are happening all the time you know there's a I'm sure some philosopher or meta philosophers you kn..."

"yeah I guess I guess I do tend to are significantly increases in complexity and I'm curious about how computation like like our world our physical world inherently generates mathematics it's kind of o..."

"interesting compared to a POV plus see there's something reminiscent of that step from the basic operations of addition to taking a step towards new all networks that's reminiscent of what life on Ear..."

"the C++ program the Python Perl Network like somebody's you know people have calculated like how many operations does the brain do and something you know I've seen the number 10 to the 18th about bunc..."

"nobody really knows can you summarize it in a couple of couple of words many people have observed that organisms run at lots of different levels right if you got two neurons somebody said you'd have o..."

"I don't think so do you think the universe is a computer I think he seems to be it's a weird kind of computer because if it was a computer right like when they do calculations on what it how much calc..."

"interesting that's for sure that's right so what are your thoughts on Ray Kurzweil sense that exponential improvement and technology will continue indefinitely that is that how you see Moore's law do ..."

"space of vehicle autonomy and you're a part of it and Elon Musk's and Tesla's vision well the computer you need to build was straightforward and you can argue well doesn't need to be 2 times faster or..."

"is we were able to fill in the gaps it's not just about perfectly detecting cars it's inferring the occluded cars it's trying to it's it's understanding the I think it's mostly a bigger problem you so..."

"somebody changes a given like that Akita robots and stuff somebody said is to maximize two Givens okay right so though having a robot pick up this bottle cap is ways you put a red dot on the top becau..."

"you know what yeah I'll just say where I stand I would be very surprised but I think it's you might be surprised how complicated it is that I'd say that I tell people's like progress disappoints in th..."

"into people and lane-keeping there are so many features that you just look at the pareto of accidents and knocking off like 80% of them you know super doable just a wing guard on the autopilot team an..."

"people and for the most part those conversations were like what's the right thing to do to take the next step now elan is very interested also in the benefits of autonomous driving or freeing people's..."

"you say I know the math is always 8-bit integers and two 32-bit accumulators and the operations are the subsets of mathematical possibilities so although you know AI accelerators have a claimed perfor..."

"that's craftsmen's work right you may be a genius craftsman because you have the best techniques and you discover a new one but most engineers craftsmen's work and humans really like to do that you kn..."

"they're all networked which has a new mathematics and a new computer at work do you know that that's like there's a there's more invention than that but the rejection to practice once you picked the a..."

"car is not easy ok ok driving a car is easy for humans because we've been evolving for billions of years drive cars yeah no juice the pail if the cars are super cool no now you join the rest of the in..."

"yeah I imagine 99% of your thought process is protecting your self conception and 98% of that's wrong yeah now you got there math right no you think your feeling when you get back into that one bit th..."

"like I talk like like I read books and people think oh you read books well no I brought a couple books awake for 55 years well maybe 50 cuz I didn't read learned read tall as H or something and and it..."

"mean yes so I would say my brain has this idea that you can question first assumptions and but I can go days at a time and forget that and you have to kind of like circle back data observation because..."

"mean and you can see this you know like like speech recognition for a long time people are doing you know frequency and domain analysis and and all kinds of stuff and that didn't work for at all right..."

"speaking of unpleasant surprises many people have worries about a singularity in the development of AI forgive me for such questions you know what when AI improves exponentially and reaches a point of..."

"really big and you know super intelligence seems likely although we still don't know if we're magical but I suspect we're not and it seems likely that'll create possibilities that are interesting for ..."