"what possible ideas do you have for the how human species ends sure so I think the most obvious way to me is wireheading we end up amusing ourselves to death we end up all staring at that infinite Tic..."

"you mentioned something in a stream about the philosophical nature of time so uh let's start with the wild question do you think time is an illusion you know I sell phone calls uh to comma for a thous..."

"real yeah it should be a T-shirt and I think hard things are actually hard I don't think P equals NP ooh strong words well I think that's the majority I do think factoring is in P but I don't think yo..."

"or like significant others would rather sext with the uh with the large language model version of you especially when it's fine-tuned to their preferences yeah well that's what we're doing in a relati..."

"difficulty okay what's the difference in real and artificial artificial difficulty is difficulty that's like constructed or could be turned off with a knob real difficulty is like you're in the woods ..."

"that maybe is even scarier right like we already exist in a world of Nature and nature has been fine-tuned over billions of years yeah um to uh have uh humans build something and then throw the knob a..."

"that information permeates Through Time and stays with you there's like memory it's like sticky okay to be fair like a lot of the models we're building today are very even rlhf is nowhere near as comp..."

"it's like mid it's like every time I talk to you I learn new words yeah I was like uh is it is it like basic is that what mid means kind of it's like it's like middle of the curve right yeah so there'..."

"the humor the idea the absurdity encapsulated in a single image and it just kind of propagates virally between all of our brains I didn't get much sleep last night so I'm very uh I sound like I'm high..."

"so Tick Tock is already pretty close there but the generation is done by humans the algorithm is just doing their recommendation but if this do if the algorithm is also able to do the generation well ..."

"because the machine is not interested in hurting humans it's just the machine is a machine yeah but the human gets the machine and there's a lot of humans out there very interested in manipulating you..."

"okay so you can't use this strategically tactically in a war yeah to help you to help uh gain a military Advantage it's all complete destruction all right yeah but there's egos involved it's still sur..."

"not helping us go eat McDonald's in China yeah yeah no it's the interconnectedness that's that's that's that's doing it oh that's interesting so everybody starts relying on the connectivity of the int..."

"fire sure I mean they'll be a they'll be it'll be like you know some kind of Amish looking kind of thing I think I think they're going to have very strong taboos against technology like technology is ..."

"you just have a 3D printer that can always help you well that'd be very interesting I'm interested in building that of course you are you think how difficult is that problem to have a robot that uh ba..."

"structural type of robots that are dumb yeah but structural type of robots aren't going to have the intelligence required to survive in any complex environment what about like ants type of systems we ..."

"yeah you're interested in this world even if you did put a Fab on the machine right let's say okay and we can build apps we know how to do this Humanity we can probably put all the precursors that bui..."

"like we live in one globalized world no but you're not interested in running Twitter you're interested in seeding like um you want to see the civilization and then because humans can like oh okay you'..."

"always one asshole in the room who murders everybody and usually makes tattoos and nice branding do you need that asshole that's a question right Humanity works really hard today to get rid of that as..."

"biostack either the biostack the biostack just seemed to move slower um you have Moore's Law uh which is not dead despite many proclamations uh into house stack or the silver in the Silicon stack and ..."

"on their face in order to escape reality that's the thing in order to be live inside the computer put a screen right here I don't have to see the rest of you assholes I've been ready for a long time y..."

"that kind of stuff sure I don't know I the the power of imagination or the power of the the mechanism in the human mind that fills the gaps that kind of reaches and wants to make the thing you see in ..."

"think much about this kind of subjective feeling that it it feels like something to exist and then as an observer you can have a sense that an entity is not only intelligent but has a kind of subjecti..."

"Consciousness what do people mean when they say Consciousness and there's definitely like meanings to it what's your favorite thing to eat pizza cheese pizza what are the toppings I like cheese pizza ..."

"why does it feel like something that's Consciousness isn't it if that's the word you want to use to describe it sure I'm not going to deny that that feeling exists I'm not going to deny that I experie..."

"from our kind of living organism our kind of Stack but it feels like AI can start maybe mimicking the biological stack better but about it because it's trained we trained it yeah and so in that maybe ..."

"and part of being human is being conscious is being having the capacity to suffer having the capacity to experience this leveragely in such a way that you can empathize the AIS is going to empathize w..."

"the AI system says hi my name is Samantha has a backstory yeah I went to college here and there yeah maybe it'll integrate this in AI system I made some chat Bots I give them backstories it was lots o..."

"Banning you know what shadow Banning yeah right Shadow Banning okay you post no one can see it Heaven Banning you post no one can see it but a whole lot of AIS are spot up to interact with you well ma..."

"doesn't make sense for me for you but you're just a biological organism it was born before like read the internet really took off the crazy thing is like culture is whatever we Define it as right thes..."

"possibly one of the greatest names of all time for a company uh you've launched a new company called tiny Corp that leads the development of tiny grad what's the origin story of tiny Corp and Tiny gra..."

"yes no but there's so much uh you know there's AMD so we have Nvidia and AMD great all right but you know you don't think there's like a push towards like selling like Google selling tpus or something..."

"horrendously slow but gpus can do arbitrary load in store right gpus can do things like X dereference Y so they can fetch from arbitrary pieces of memory they can fetch from a memory that is defined b..."

"need to do Branch prediction in a CPU and the reason it's prediction and the branch predictors are I think they're like 99 on CPUs why do they get one percent of them wrong well they get one percent w..."

"okay so what what is the minimum number of operations that can accomplish that if you don't have mapmall as a primitive so tiny grad has about 20. and you can compare tiny grad's uh opsat or IR to thi..."

"everything in 1995. and here we are with arm and the phones an arm everywhere wow I love it when movies actually have real things in them right okay interesting and see this is like uh so you're think..."

"and convolutions and every convolution you can imagine dilated convolution striated convolutions transposed convolutions you write on GitHub about laziness uh showing a map Mall matrix multiplication ..."

"what about like the developer experience of tiny grad um what it feels like what are the um versus pytorch by the way I really like pie torch I I think that it's actually a very good piece of software..."

"he's uh you know he's he was involved he's involved with that story what's his uh praise and what's his criticism of what you're doing with your life look my prediction for tense torrent is that they'..."

"so my Approach with tinygrad is first write a performant Nvidia stack we're targeting AMD um so you did say a few to Nvidia a little bit with love with love yeah so with the Yankees you know I'm a Met..."

"so you're kind of spearheading the diversification of uh gpus yeah and I'd like to extend that diversification to everything I'd like to diversify the right the more my central thesis about the world ..."

"all right and right now the only way to do that is with Nvidia gpus if you want performance and stability interesting it's uh it's a costly investment emotionally to go with amd's uh well let me add s..."

"garage interesting the car charger a wall outlet is about 1500 watts a car charger is about 10 000 Watts what is the most amount of power you can get your hands on without a rousing suspicion that's r..."

"probably 7900 xdx is but maybe 30 90s maybe a 770s those are in towels you're flexible or still exploring I'm still exploring I wanna I wanna deliver a really good experience to people and yeah what g..."

"not all one-year-old stale issues open source means developing in public if you guys can commit to that I see a real future for AMD as a competitor doing video well I'd love to get a tiny box to MIT s..."

"yeah from from a wall plug from a wall plug yeah actually for inference it's not like even more power would help you get more the biggest model released is is 65 billion parameter llama as far as I kn..."

"mostly uh to to communicate Youth and beauty and power and status but status fundamentally is a zerosome game all right where's Youth and beauty or not no I think status is a narrative you can constru..."

"yeah uh so AMD epic processors have 128 Lanes of pcie um I want to leave enough lanes for some uh drives and I want to leave enough lanes for some networking how do you do cooling for something like t..."

"yeah but if I can make it big a lot of that noise is generated because of high pressure air if you look at like a 1u server a 1u server has these super high pressure fans they're like super deep and t..."

"uh Linux with the full software engineering environment it's just not pie torch but tiny grad yeah we did a poll if people want Ubuntu or Arch we're going to stick with Ubuntu oh interesting what's yo..."

"less lines there's just a few things about the way tiny grid writes things here's here's a complaint I have about pytorch nn.relu is a class right so when you create it when you create an end module y..."

"first we're gonna go so wide that we're gonna make all of python fast and Tiny grads in the middle we are going to make neural networks fast yeah but they uh they try to really get it to be fast compi..."

"so I'm much more of a like build it the right way and worry about performance later um there's a bunch of things where I haven't even like really dove into performance the only place where tiny grad i..."

"and a mobile GPU image textures okay and so you want to be able to leverage that I want to be able to leverage it in a way that it's completely generic right so there's a lot of this xiaomi has a pret..."

"means how do you build a model that outputs a human policy for driving how do you build a model that given a you know reasonable set of sensors outputs a human policy for driving uh so you have you kn..."

"today we have vqvae and Transformers we're building Drive GPT basically Drive GPT okay uh so and that's trained on what is it trained in a self-supervised way it's trained on all the driving data to p..."

"it doesn't just say what would a human do it says what would a good human driver do and such that the experience is comfortable but also not annoying in that like the thing is very cautious so it's fi..."

"we haven't completely closed the loop yet so we don't have anything built that truly looks like that architecture yet we have prototypes and there's bugs um so we are a couple bug fixes away might tak..."

"they're doing way more useful things than others yeah yep tell me about it okay so more data scale means more scaling computer or scale and scale of data both diversity of data diversity is very impor..."

"as possible across the whole thing the the training the data collection everything they also have a very fancy simulator they're probably saying all the same things we are they're probably saying we j..."

"legal distinction sure yeah we have a compute cluster you said that you don't think llms have Consciousness or at least not more than a chicken do you think they can reason is there something interest..."

"listen there's something different between chess and and uh language chess is a game that a subset of population plays language is something we use non-stop for all of our human interaction and human ..."

"so reproduction yeah we might redefine what it means to to be uh what is it a high performance living organism on Earth humans are always going to define a niche for themselves like well you know we'r..."

"boy but no no no you don't understand humans are created by God and machines are created by humans therefore right like that'll be the last Niche we have so what do you think about this the rapid deve..."

"technologies have as well so maybe calculator is not the best example that because that just seems like um well no maybe calculator the poor Milkman the day he learned about refrigerators he's like I'..."

"a feeling we dramatize everything I think we dramatize everything I think that that that you ask the Milkman when he saw refrigerators and they're gonna have one of these in every home yeah yeah yeah ..."

"two uh uh driving similar kind of thing yeah it's you still should be a good programmer in order to modify I wouldn't even say debugging it's just modifying the code reading it don't think it's like l..."

"if if if codex or or co-pilot are helping you that actually probably means that your framework or library is bad and there's too much boilerplate in it yeah but don't you think so much programming has..."

"models yeah I guess if I was really writing like maybe today if I wrote like a lot of like data parsing stuff yeah I mean I don't play ctfs anymore but if I still play ctfs a lot of like it's just lik..."

"in in the edge cases yes if your engineering code it's actually pretty good yes if you are writing an absolute basic like react app with a button it's not gonna hallucinate sure no there's kind of way..."

"of that's going to kill Google wait which part when someone makes an llm that's capable of citing its sources it will kill Google LM that's citing a sources because that's basically a search engine th..."

"it it feels I mean one of the things that charging PT kind of shows that there could be a few interesting tricks that really have that create a really compelling product some startups gonna figure it ..."

"what does that mean exactly the company or their end of the search engine so we shot the search engine down who shot the company down either can you elaborate on the value of that question does Sundar..."

"oh my God uh but the the positive side of the button is that you can innovate aggressively is what you're saying is which is what's required with uh turning llm into a search engine I would bet on a s..."

"with the answer the guy's like well it's what people click on when they search Apple oh my God yeah yeah yeah that data is really really powerful it's the human supervision uh what do you think are th..."

"control it so the criticism you have for the AI safety folks is that there's a belief and a desire for control yeah and that belief and desire for centralized control of dangerous AI systems is not go..."

"there's so much I at least on Twitter I don't know maybe Twitter's not realized but it's not real life come on in terms of hype I mean I don't I think open AI has been finding an interesting balance b..."

"I know but half of these AI alignment problems are just human alignment problems and that's what's also so scary about The Language they use it's like it's not the machines you want to align it's me b..."

"want to find out how to uh I don't know blow up something no there's not a lot of friction that's so easy no like what do I search today's Bing or do I which search engine I use no there's like lots o..."

"makes it more accessible for that person who's not smart enough to do they're not gonna they're not gonna build a bomb trust me the the the the people the people who are incapable of figuring out how ..."

"hire people to build up you know what I was asking this question on my stream like can Jeff Bezos hire a hitman probably not but a language model can probably help you out yeah and you'll still go to ..."

"is out there on the internet I mean yeah and I think that if someone is actually serious enough to hire a hitman or build a bomb they'd also be serious enough to find the information I don't think so ..."

"mean harm was actual violence what you're basically saying is like okay what's gonna happen is these people who are not intelligent are going to use machines to augment their intelligence and now inte..."

"the thing that that worries me I mean we have a real danger to discuss and that is bad humans using the thing to do whatever bad unaligned AI thing you want but this goes to the uh your previous conce..."

"you have I don't know I don't think everyone I don't think everyone I just think that like here here's a the saying that I put in one of my blog posts it's when I was in the hacking world I found 95 o..."

"right yeah so you know I can certainly uh recognize that but you know in general I mean this is a like with common sense Maxim which is the people who end up getting power are never the ones you want ..."

"mind right you're constantly under you know such an interesting it is Infowars man like I don't know if you're being sarcastic no I'm dead serious but I think there's power to that it's like how do I ..."

"they have a good point behind it when they're like mocking and derisive and just aggressive you're with us or against us this this fucking this is why I delete my tweets yeah why'd you do that I was y..."

"it's not censorship right like all moderation you want to put on Twitter right like you could totally make this moderation like just a you don't have to block it for everybody you can just have like a..."

"uh yeah well so speaking of which uh he worked at Twitter for a bit I did as an intern the world's greatest intern all right there's been better that's been better uh tell me about your time at Twitte..."

"understanding of so many different topics okay so I try to follow people I try to consume stuff that's Technical Machine learning content there's probably a few of those people and the problem is inhe..."

"what is an ad blocker it's individualized transparent censorship right yeah but censorship is a strong word and people are very sensitive too I know but you know I just use words to describe what they..."

"for features far into the future and planning poorly and all this kind of stuff and then there's this like code base that follows you along and puts pressure on you and nobody knows what like Parts di..."

"faster you can make progress CEO is programming with tests of mine developing tests with that in mind that if it passes it should be good and Twitter not that so it was impossible to make progress in ..."

"because like from an individual perspective how do you incentivize how do you create the kind of incentives that will reach or lead to a great code base what's okay what's the answer to that so what I..."

"don't necessarily need the manager to be the absolute best I shouldn't say that but like they need to be able to recognize skill yeah they have good intuition intuition that's Laden with wisdom from a..."

"right that's a beauty of companies if you don't like the dictatorship you quit so you mentioned rewrite before or refactor before features if you were to refactor the Twitter code base what would that..."

"like a cool like point in history and like I hope I was useful I probably kind of wasn't but like maybe I mean you also were one of the people that kind of made a strong case to refactor yeah and that..."

"this is like what any how to approach a legacy code base book will tell you so and then you hope that there's modules that can live on for a while and then you add new ones maybe in a different langua..."

"doesn't have many of them so I'll tell you what my plan was at Twitter it's actually similar to something we use at comma so a common we have this thing called process replay and we have a bunch of ro..."

"like George you don't understand this is modern software development no this is bullshit like why can't it run on my laptop yeah okay well I'm not saying you're gonna download the whole database to yo..."

"yeah if uh the flip side is to simplify simplify simplify I mean you know what this is something that I do differently from from from Elon with with comma about self-driving cars but you know I hear t..."

"be good at it I don't think I'd really be good at running an engineering organization at scale I think I could lead a very good refactor of Twitter and it would take like six months to a year and the ..."

"Scala looks more like well like a functional part of my language more like like an old camel or a Haskell let's actually just explore we touched it a little bit but just on the art the science and the..."

"bad stuff I mean I tried the same thing with rap right I tried the same thing with rap and I actually think of a much better programmer than rapper but like I even tried I was like okay can we get som..."

"freeze there and like I get it Fiverr whenever I've used Fiverr for certain things like design or whatever yeah it's always you come back I think that's probably closer my experience with Fiverr is cl..."

"I feel like help you so marginally that like and now okay now vs codes autocomplete has gotten good enough that like okay I don't have to set it up I can just go into any code base and auto includes r..."

"tools to become ai-powered like I want AIS reading my code and giving me feedback I don't want AIS writing half-assed autocomplete stuff for me I wonder if you can now take GPT and give it a code that..."

"human that it converges to as a programmer nothing do you think it's all generated our Niche becomes I think it's over for humans in general it's not just programming it's everything well varnish beco..."

"is a GitHub repo is like showing me kind of what the future of okay so a lot of times I'll go on a Discord or kind of grad Discord and I'll throw out some random like hey you know can you change inste..."

"I mean machine AI is not the like the computer is so pedantic it does what you say so but you want to do what I mean machine yeah right you want the machine where you say you know get my grandmother o..."

"I do not think Anarchy in the physical world is very good because I exist in the physical world but I think we can construct this virtual world where Anarchy it can't hurt you right I love that Tyler ..."

"didn't believe in God he'd be as you know silly as the atheists here uh what do you think is the greatest uh computer game of all time do you do you have any time to play games anymore have you played..."

"it'll come back I belief but MMO like really really pull you in games do a good job I mean okay are there like two other games that I think are you know very noteworthy from your Skyrim and GTA 5. Sky..."

"one person's up it's like a horsepower like what's a horsepower it's how powerful a horse is what's a person of compute well you know I got it that's interesting uh VR also adds uh I mean in terms of ..."

"switch like I'm gonna go today and buy a switch you should well the new one came I haven't played that yet but uh Diablo 4 or something I mean there's sentimentality also but something about VR really..."

"running on those systems are aligned with you oh yeah they're gonna augment your entire world oh yeah and that those AIS have a I mean you think about all the dark stuff like like sexual stuff like if..."

"showed a picture on stream of a man in a chicken farm have you seen one of those like factory farm chicken farms why does he dominate all the chickens why does he smarter he's smarter right some peopl..."

"in Miami he was having a good life man I'm sure he was I'm sure he was what have you learned from launching and running Kamai and Tiny Corp so this starting a company from an idea and scaling it and b..."

"with Karma it really started as an ego battle with Elon ah I wanted to beat him I like I saw a worthy adversary you know here's a worthy adversary who I can beat at self-driving cars and like I think ..."

"you know how hard it is to ship reliable consumer electronics that go on your windshield we're doing more than like most cell phone companies how'd you pull that off by the way shipping a product that..."

"and like not just wanted to I don't believe what anyone says I believe in Santos if a company wanted to buy comma with their incentives or to keep it open source but comma doesn't stop at the cars the..."

"talked to Elon about time he went to work at open AI what do you love about Andre capati he and to me he's one of the truly special humans we got oh man like you know his streams are just a level of q..."

"going there is a good sign for open AI maybe I think I think you know I I like Alias discover a lot I like those those guys are really good at what they do I know they are and that's kind of what's ev..."

"have a return on right yeah but you can also think of Charity as like um is you would like to see uh so allocate resources in an optimal way to uh to make a better world and probably almost always tha..."

"part of me wishes that um Elon went into nuclear fusion versus Twitter part of me or somebody somebody like Eli you know we need to I wish there were more more elons in the world and yeah I I think El..."

"is giving power it gives power to the ultra powerful I think the rich get richer you have love in your life has love made you a better or a worse programmer do you keep productivity metrics no no no I..."

"discriminate biostack life and silicon stack life like so the moment the computer starts to say like I miss you I started to have some of the basics of uh human intimacy it's over for you the moment v..."

"you're older you're wiser what's the meaning of life George hotz to win it's still to win of course always of course what's winning look like for you oh no I haven't figured out what the game is yet b..."