0:00
Is AI going to kill us all? Uh maybe.
Is AI going to kill us all? Uh maybe.
Emmett Shear is the CEO of Twitch, was acquired by Amazon in 2014, joins us now.
I started Twitch to help people watch other people play video games on the internet.
The creator and co-founder of Twitch.
Watch other people play video games. Who knew? Emmett knew.
I guess that's the answer.
What types of ideas are you noticing are standing out to you that are interesting?
first time in maybe five to seven years, it feels like credibly trying to start a consumer internet company, like the ones that like I was so excited to start in 2007, is like potentially a good idea. Um that's because of AI.
Uh you mentioned AI might become so intelligent it kills us all.
This podcast is really growing.
I don't I don't want the world to end.
I think it's going to be okay.
But it's such the downside is so bad.
It's like it's really probably worse than nuclear war. Mhm.
That's a really bad downside.
I think of it as a range of uncertainty.
And I would say that the true probability I believe is somewhere between All right, what you're about to hear is a conversation I had with Emmett Shear.
Emmett was the creator and co-founder of Twitch.
If you don't know about Twitch, I don't know, you're living under a rock.
It's like one of the most, I don't know, five most popular websites in in the states right now.
It is a um a place where you can go to watch other people play video games, of all things.
Watch other people play video games. Who knew? Emmett knew.
I guess that's the answer.
So he was the creator and co-founder of that and um built it up.
It's a multi-billion dollar company.
They sold to Amazon many years ago, seven years ago or eight years ago for about a billion dollars and has grown many times since then.
Uh he finally retired after 17 years of the journey.
Um I got to know Emmett because he bought my previous company.
So we got acquired by Twitch.
Emmett was like my you know quote unquote boss for um my time when I was at Twitch.
So I got to see this guy firsthand.
He's the real deal and I've been wanting to get him on the podcast since those early days when I first met him.
I was like this guy is great.
We talked about a bunch of things.
So we talked about some ideas of like how he would use AI if he was going to create another company. Like I think he's good.
He's retired now from that game of operating a company, but if he was going to do it, this is what he would do.
So we talked about AI ideas.
We talked about why why he thinks AI might kill us all, might you know be be the big doom scenario, which is interesting cuz he's not just a guy who's going to go cry wolf. He's not a pessimist.
He's not just a journalist who hates tech. He's a techno optimist.
This is a guy who believes in tech, is a um a very very intelligent guy and he sees you know a probability.
He gave us a percentage of probability he thinks that could be sort of the doomsday scenario and why he thinks that that could be the case and what we should do about it. So We talked about AI.
We talked about some of the frameworks that he has for building companies.
We didn't talk too much about like the origin of Twitch.
He feel like he's done that a bunch of times so we kind of stayed away from that.
But it was a wide-ranging conversation and for those who are watching this on YouTube, I apologize the studio that we booked in San Francisco um they screwed up the video.
So we don't have video for the for for YouTube.
We just have the audio only version.
So you'll see our profile pictures. My bad. Sorry about that.
Um you know, got to pick a better place.
Got to pick a better studio I guess.
But um Anyways, enjoy this episode with Emmett Shear.
Somebody said creativity is not like a faucet.
You can't just turn it on.
And I think actually if you if you pulled like 100 people, most people like yeah, of course creativity is the sacred special thing that only happens if you've meditated in the morning and the room is perfectly right and you've had your your L-theanine in your coffee or whatever.
And you were like no, for me it's very It is like a fossil watch.
And you know, like I can just write and just keep generating more ideas.
I love that for two reasons.
One, I love that you'll just be like, "No, actually this."
That's like a consistent thing I've seen you do.
And the second is I think that's very true about you and I wonder is that practiced or is that innate?
Like If I If you were If there was a researcher studying you when you were like 10 years old, Right.
do you think they would have been like, "Oh, this This person's different in these ways."
What would have seemed different or special about you at the time?
Um I the if there was a nurture and nature break on this, it happened very early because by the time I was 10, you would definitely notice the same thing.
I'm not really that different.
But I would be much less effective.
But like as a 10-year-old, I already had that same experience.
But you were different than other 10-year-olds.
Yeah, other 10-year-olds Well, I would actually say I was less different then.
I think most people actually most children have this experience already.
I think most 10-year-olds and definitely most 5-year-olds are capable of generating ideas for what to do about something or to like play pretend almost indefinitely.
They don't run out of ideas.
It's as you get older somehow you What you learn to do is you learn to stomp down the ideas that are like bad.
Um and to not say dumb things.
But the more pressure you put on yourself not to say dumb things, the more your inner idea generator it like gets disrupted.
And I I say a lot of dumb things.
Like when I'm generating ideas, I may not put weight down on them, but most of the ideas will be bad.
They'll have something obviously wrong with them.
And they give you this advice and when you if you go to like someone who teaches you how to brainstorm, Right.
like, "No bad ideas here."
That's obviously not true.
There's lots of bad ideas.
Most of your ideas are bad.
Yeah, the The actual advice is like, "Don't stop at the bad ideas." Yeah.
Well, you're What you're trying to do is you're trying to disable that sensor that most people have installed that like is like, "No bad No bad No bad. Don't Don't be stupid. Don't be stupid.
And I think I was like mal-socialized.
I It never occurred to me to to have that.
Like I I did I never got the sensor installed.
And why that is the case, I'm not sure.
But I actually I think I'm the one who is unchanged in some sense.
I'm a little more childlike in that way.
And everyone else is the weird one who like Why how does you end up like damaged by your life that your your inner wellspring of creativity has been Right. crushed.
And I think that process is actually very simple.
You This process goes over all kinds of things in people's minds.
You start from some capability, something you can do, some behavior.
And if when you do that behavior, you try that thing, you receive negative feedback, which can be external or you actually think even more often internal, you're like, "Oh, I I screwed it up. Oh, it's bad.
Oh, I don't Disappointment."
You learn not to do that thing pretty rapidly.
And so, that leads you to doing it less, which means you're less skillful at it, which tends to lead you to doing it less, which And this this that cycle ends in you being very bad at something. Like, "I'm bad at math." No, you're not.
Everyone can be like The kind of math you're talking about, everyone can be The kind of math When people say, "I'm bad at math," they don't mean, "I'm bad at like abstract algebra proofs."
They mean, "I can't do arithmetic or algebra basic algebra."
And that's just imaginary.
Like, everyone can do that. It's easy.
They got stuck in one of these like spirals.
And now it's And getting out of one can be very hard.
And I guess I think that's what happens to people's creativity. I don't know.
I didn't go through the process myself.
And so, I got So, now that I'm saying this out loud, actually, when I'm The idea that I have that comes up for me is like, "Oh, well, maybe what it is is that I had better ideas."
That's like That's the So, you got in the reward the reward loop or or I had an environment that was unusually uh positive and positively reinforcing for me having ideas.
And so, I would have ideas, and it would go well.
That would lead me to having more ideas, which and more practice at having ideas, which would go well.
And then you end up just never breaking that loop.
I have a a trainer who comes over to my house and he always says this thing to me because like my kids will come down during the session.
I'm always like, "Oh, sorry.
Like, obviously annoying my 2-year-old is here, almost getting hurt on all the weights, and that's probably like not what you want in your session."
So, I'm always like, "Oh, sorry. Sorry. Sorry."
And he's just like, "Dude, no."
And he's like, "Kids and dogs." I go, "What?"
He goes, "I love to be around kids and dogs. They got it right. They know life."
He's like, "A dog is like unconditional love, happy, playful, you know, super loyal."
He's like, "What's not to learn from a dog?
I want to learn everything I can from a dog." Or kids.
He's like, "Look what she's doing.
She just made up a game on this thing."
Like, we're here trying to do a serious workout.
She made this her play place.
She can't wait to come down here."
He's like, "I wish all my clients wanted couldn't wait to come down to the gym."
And I was like, "Damn, this guy's right."
And one of the things I like is figuring out people's isms, their philosophies.
And you're like, "Oh, I thought of one on the way here." Explain what it was.
It was, "Have you tried just solving the problem?"
That was What does that mean?
So, there's a there's a meme on the internet.
I think it started with weirdson Twitter, which is like, "Have you tried solving the problem by" and then an infinite list of possible sentences.
The tweet is always, "Have you tried solving the problem by like ignoring the problem?
Have you tried solving the problem by spending more money on it?
Have you tried solving" And one of my favorite ones of those that has become almost like a life motto is like, "Have you tried solving the problem by solving the problem?"
And that sounds dumb, right?
Like, that that sounds like one of those like Zen koan pieces of advice that when you first hear it is like, "Are you are you serious?
Like, that's the advice is solve the problem by solving the problem?"
But what you notice when you try to help people with problems a lot is often times people will have a problem, it will be really obvious what the problem is, and they'll come to you for advice for like, "Well, how can I deal with the consequences of this problem?
Or how can I avoid needing to solve this problem?
Or how can I get someone else to solve this problem?
Or have other people solved the problem in the past, which is closer to the right answer or what can be the right answer?"
And the point of the the saying is to remind you that sometimes the way to solve the problem is just like just to actually try solving the problem.
Like don't deal with the symptoms.
Don't accept the symptoms.
Don't Don't find a hack around it.
Like the problem is the website is not fast enough.
And instead of like trying to figure out how we can make a loading spinner that distracts people from that fact, what if we just made it so fast that you don't need a loading spinner?
It's interesting because that's a good It's a very good advice when the problem actually is solvable.
I mean, your people are flinching away from it because something about it is though the problem isn't really unsolvable.
Like they If they worked on it for 6 months, it would go away, and it's worth solving.
Whereas there are these problems where like you're trying to make a perpetual motion machine.
You're trying to do something that is actually too hard, and solving the problem by solving the problem You should actually stop trying to solve the problem.
That's a huge mistake, and you should be looking for a hack around needing to solve the problem.
You should be looking to live with it more effectively.
But I find actually on the balance at least as most people I I talk to, I help, most people I know, I think it's maybe it's people in in tech like love the love the hack.
They're always looking for the easy, fast solution that cuts around needing to solve the problem, and it's very helpful.
It's It's the most often helpful form of that advice in my opinion.
It's like bringing people back to just solving the problem.
I find that the the advice I like the most or the the sayings that resonate with me the most are the ones It's like if you spot it, you got it.
It's like if It's the one I It's the advice I needed.
That's why it resonates with me.
That's why I like giving it out because like I personally experienced it.
Have you personally experienced that or what's an example where you remember trying to do everything but solve the problem, and then you finally realize, "Shit, I should have just solve the problem."
It's an interesting question.
What What is it You spot it, you got it?
It's like noticing is half the battle, basically.
It's sort of the smart person version of whoever smelt it, dealt it. Yeah, yeah, yeah.
It's like 100% If you You only notice this in other people because you've seen it in yourself, too.
Otherwise, you wouldn't be as observant of it.
My version of this is we give the advice we need to hear. Yes, yeah, exactly.
which is same basic idea.
It's actually not always true.
Like that's one of those really good heuristics where like sure, half the time when you give advice, it won't actually be for you, but half the time it is.
And noticing it is so powerful that like you should just check every piece of advice you give for like, wait a second, is this advice I need to hear right now?
When it comes to the like, have you tried actually solving the problem?
I think I'm pretty good at that in general.
I think that I often give advice to myself in a more meta sense.
Like it's a advice I often need in a more meta sense of like when I'm confronted with like a thing that needs to be programmed, I will often go just program the thing.
But I have a tendency to like look for ways that I can solve the problem and not that the problem can be solved.
And for me that the this almost always is like, why don't I ask somebody else for help?
And I just like it doesn't even occur to me to go to go do that.
I'm just I'll just I'll just indefinitely dig try to go solve the problem myself.
I'm not really trying to solve the problem.
I'm trying to solve the problem while avoiding having to ask anyone else for help.
Which is like not I'm not really trying to solve the problem.
But actually no, weirdly I think this is one of those things where it's almost like the creativity thing.
It was a shock for me to realize other people don't do that.
You yourself actualize on that one. Yeah, yeah.
What's a piece of good advice that you're bad at taking?
Oh, that's a that's a an excellent one.
I think the the big one there is like you know, listen more.
Like I can give this advice so much at YC and it's 100% something that I need to get better at, which is like you go into the user interview and you have all these ideas and thoughts and you need to not be surfacing those.
You need to actually be focused on your move your attention to them and really be interested in care about what they have to say.
And your opinions and what's what you think is true is irrelevant.
And I am I'm much better at that than I used to be.
And I I also it's one of those things like being reminded like let's just chill out for a second, and like like listen, is almost always good advice for me.
And something that I And it's advice I give fairly often, but like uh it's you have you know to take on.
One of the things I really liked that you showed me once.
Well, I remember asking you when we were at Twitch I think we were working on a problem that was like reminiscent of early days Twitch with like the mobile mobile stuff in different countries, where it's like, oh, we're not the leader, or we need to like create from scratch, which wasn't a muscle that a lot of people there were were flexing at the time.
And I was like, hey, do you have any stuff from the early days of Twitch?
And you sent me a thing, which was like here's all the user interviews, like here's my doc from all the user interviews that which was basically from from what I understand there was like a small universe of people that were already doing video game streaming. And you were like, cool. Let me call all of them.
And let me ask them like three questions.
And if I could just get these answer these three questions, that should give me a little bit of a road map, a blueprint of understanding what do I need to do in order to like win in this market? Yeah.
Can you take me back to that?
Cuz that I like that for two reasons.
It was A simple, and B seemed like a focused intensity that you found a point of leverage and you pushed.
Yeah, I think two things happened to lead to that.
The first was like the realization obviously in for we wanted to win in gaming, the streamers mattered. And at Justin.
tv, we'd always been like streamers and viewers are equally important.
And I finally made a decision. I was like, no, no, no.
This product ultimately is about streamers.
And if this doesn't work for the streamers, it doesn't work for anybody.
And then I had the realization this is one of those epiphany moments where I truly saw I have no idea why anyone would stream video games.
Like I don't really want to do it, and I have all these I could I saw my myself building products for these people for the past four years at Justin.
tv, and not really having any idea why they did the thing they did at all?
And I sort of I saw like, "Oh, I'm just making this up. I have no idea."
I said, "I don't know the answer. I could know the answer.
Like they There is a There is an answer out there.
These A bunch of people know it, but I don't."
And that triggered me to be like, "I need to know. I need to understand.
Like these this these 200 people I need to understand their mind."
And I did about 40 interviews probably.
And I didn't want to know like what they thought we should build cuz if they knew what we should build, they would have my job.
And I talked enough of them before to know that they had no good product ideas.
I I wanted to know like, "Why are you streaming?
You What have you tried to use for streaming?
Like What did you like about that?
Like What did How did you get started in the first place?
What's your biggest dream for streaming?
What do you wish you know, someone would build for you?"
And I didn't ask them what do I wish someone would build for you because I thought they would have a good idea.
I asked them because the follow-up question was really the killer one, right?
They They would say, "I wish you'd build me this big red button." I'm like, "Great.
I built you the big red button.
Like what What does it do for you?
Like why is your life better after I built that?"
And then they would tell me the real thing, which is like, "Oh, I would have make I'd like make a bunch I'd make make money that month or I'd get a bunch of new fans who like loved me or my fans who already loved me on YouTube would be able to watch me live and more of them would."
And I was like, "Oh, that's the real answer."
Like why you you don't you don't want the button, you want the fans or the money or the I call it love.
The like the the sense of reassurance and and positive feedback that the your creative content was wanted. But you're a smart guy.
This love and money and fans, I'm sure you would have guessed what do the streamers want. False.
What What did you What did you think they wanted?
revelation that people would want money because I was like, "You're streaming like, you know, whatever 12 hours a week.
If we met like you monetize the rates we can monetize today, you'd make like $3 a month."
That would like that didn't occur to me that that would be a positive thing. They're like, "Yes.
Oh my god, that would be amazing."
And I was like, "Wait Wait, you're serious? You would like $3?
I'm like, "I'm not I don't want to overpromise.
Like I will build you the monetization actually, but like you would really be excited if it only produced like a tiny amount of money.
And they're like, "Absolutely.
I've just the idea that I can make money doing this would be so exciting."
That had not occurred to me.
Cuz it always is easy for me to make I I was a programmer.
I had summer jobs interning for Microsoft.
If you're a programmer, you can get a summer job interning for Microsoft.
That's like pays many, many years of that level of streaming in 3 months.
Like why would I It didn't It didn't even It wasn't in my worldview that that would be so important to them.
And of course I knew they wanted a bigger audience, but the degree to which they valued even one more viewer and the degree to which they didn't care about anything else.
Like they they They wanted people to watch them.
They wanted to make money.
And then I'd ask about other things like "Do you want the video production?
Do you want to improve the video production?
Have cooler video production?"
And they'd be like, "Yeah."
And they'd be like, "Okay, well, but like what what's good about that?
Like what do you like about that?"
Like, "Well, I'll get more I'll get more bigger audience."
And it was really the realizing the realization that it was just those three things basically explained 98% of their motivation and we could anything that didn't move the needle on that could be ignored.
So, a good example of that's like polls.
Everyone would ask for polls.
Seems like a cool feature. Live polls, of course.
Are you going to have a bigger audience with the live polls? Not particularly.
Are you going to make more money? No.
Is it Does he really Do you really feel more loved after you're running a live poll than after you're just like asking chat and having people post it in the chat and say it? No, it's the same. You got the feedback. It's cool.
So, this product It's cooler to see your chat blow up.
It's cooler to see your chat blow up.
So, you're saying that this feature is worthless? Yes.
In fact, potentially negative, in fact.
And so, it would always be on the list of like things that would sound like they might be cool and we just would never build it entirely correctly because it wasn't going to move the needle.
needle. And the thing that's really hard to teach there that I've got I've I've been a YC visiting partner for the this batch and I'm trying to convey to people that it's very hard to get them to do it is like you have to care fanatically about these
people these people as people and these people as as in the role they're doing as these people as streamers and what they believe about their reality is you have to accept as base reality like that is how they see the
world and that is what's going on but like you need to like literally have no regard for their ideas for how to solve the problem and it's a little paternalistic in a way but it's it's more of like just respecting that they're experts in this thing and
you need to understand them in that thing and that what people are looking for when they are looking for the product idea from the person is like they don't want to do the work they they don't want to take responsibility for it's my job I have to
solve the problem and no one's going to tell me what the answer is there's no teacher there's no customer it's up to me to come up with the the truth and and then defend it when other people are like no that's wrong I have to be
able to say like no no no let me explain this is like don't let me explain why this is actually a good idea and that's scary you're responsible I think actually that's a probably why the just solve the problem advice is bouncing around my head because a bunch of the
fear founders have about addressing these things I think comes down to a willingness to take responsibility for solving other people's this other person's problem like they're going to come and dump a bunch of problems on you and it's
your job to solve it for them within the constraints available and there's no if you come up with the wrong idea it's all on you and you can't you can't trust anyone else to do it for you What are you seeing in this YC batch so you're visiting partner Mhm. exciting
exciting time with AI Very much.
probably like you know half or more of the batches doing something with with AI Yeah.
what's exciting what are you saying what where do you see the puck going so it's interesting I would actually say that at least in this batch I think this might have been different the previous batch but by this batch use of AI is no longer interesting AI is out no no no AI is AI is so in.
It's like it's like being an AWS startup or like being a a mobile startup.
Like, what do you mean you're a mobile startup? Like, I don't know.
Are you Are you building a social media network?
Like, what's the Of course you have a mobile app.
I had a And then now it's like of course you're you're you're you're using LLMs to solve a problem.
That's just like if you weren't doing that, I would think you were a dummy.
Like, I don't understand Like, that's not an You wouldn't even bring it up.
It's not even interesting topic of conversation.
The question is like, what What are you doing that's That's not entirely true.
There's about some percentage of the batch, I don't know.
It's between 10 and 20% I'd say that's legitimately building like AI infrastructure because there's a need to build a lot of infrastructure there.
Those are actual AI Those are AI companies.
But like, when people hear AI company, I don't think they they think back-end infrastructural support for AI.
They think of using AI to like do things.
And I actually couldn't tell you what percentage of the batch is AI from that point of view. All of them, maybe? I don't know.
Like, why wouldn't you use it?
Even if it's only for a minor thing.
There's always something you can use it for.
It's a very useful technology.
What types of ideas are you noticing or standing out to you that are that are interesting?
Is there like you know, for example, I remember when I first moved to Silicon Valley, suddenly the kind of like bits companies started doing really well.
It was like, oh, Uber and Airbnb and like online offline.
Yeah, it was like, oh, wait, this this used to be like taboo.
Like, it was like, no, it You're supposed to do a software company.
Like, you you have to ship t-shirts. What are you doing?
I would say like, stay away from trends.
The offline offline companies that started the trend did very well. Uber's a great company.
Airbnb's a great company.
But they were off to a great start. Great company.
But at the time, that was They They were doing something that was not allowed.
They were They were They were They found an opportunity that had been ignored.
Almost all the online offline companies that get started after Uber, DoorDash, Airbnb are big being like, we're going to be the Uber and DoorDash and Airbnb of X."
Most of those companies did not do very well. Is online offline bad?
No, it's generated a bunch of incredible companies.
Jumping on the trend was probably bad for you.
And so, whatever I tell you is like the trend I see, I don't mean trend.
I guess what I mean is I think you're a person that is really good at looking at a situ- like looking at a box of stuff and identifying correctly what's really interesting in this box. Yeah, yeah.
The There's something to you.
Yeah, no, I I understand I think I understand what you're asking.
So, like What I think is changing in the world right now, having observed this, is the consumer is back.
For the first time in a long time, many And by a long time, it's like internet standards, like 5 years or something.
But like for the first time in maybe 5 to 7 years, it feels like credibly trying to start a consumer internet company, like the ones that like I was so excited to start in 2007, is like potentially a good idea. Um that's because of AI.
AI means there's a whole opportunity to sort of reimagine how consumer experiences can work ground up.
And what's What's cool about consumer is for B2B SaaS, the experience isn't the product.
And so, reimagining the experience does not reopen a necessa- It can, but it usually does not reopen a segment.
In consumer, reimagining an experience 100% reopens the segment.
Because the thing you're selling is the experience.
The thing The reason people will use your product is it's a different experience.
And in B2B SaaS, it's not the experience, it's the what?
Yeah, it's the the People actually care what it does and like and the the the pricing model and the and like the adoption Like the it's very practical, and you can make people jump through hoops if it does a thing, cuz there's a lot of money for the corporation and money and labor and people are paid to use your product, and it's a whole different thing.
And so, AI adds new capabilities, new capabilities enable new segments of B2B SaaS to be created that will generate some amount of growth.
In consumer, it does a really cool thing. It's like mobile.
It reopens every segment as like, "Oh, if Now that you assume mobile exists, now that you assume AI exists, what could you build now?"
And that's very exciting.
I don't have answers for that anywhere because like, you know, we'll see.
Like, that's a whole other thing in consumer.
It's a bunch of lottery tickets. Like, nobody knows.
singular genius that works out, right?
Like, you could see like, okay, mobile comes, photo sharing became Right. like open again.
A window has opened for photo has reopened for photo sharing.
Turns out it's Instagram and it's Snapchat, which is going to use photos as text messages.
Like, Yeah, it turns out that photos have a few different use cases and Instagram and Snapchat took two of the best ones.
The The fact that photo sharing is one of the most important segments and that, you know, sort of posting them and messaging with them are the two important most important things to do with them seems blindingly obvious in retrospect.
And if you'd had to predict that in 2007 or 2008, like, good luck. Yeah.
Like, nobody nobody nobody correctly predicted that stuff before it happened. I mean, not nobody.
If you did correctly predict that, you made a lot of money.
And congratulations, you're really good at consumer slash you got lucky.
We will find out when you try to do it again.
I think that in AI, actually, I have a theory for like the what one of the ways this will disrupt a bunch of businesses.
In AI, especially in consumer, a huge number of businesses can be conceived of as effectively being a database with a system of record that has like a bunch of canonical truths about the universe and each of them is a row.
So, like, Yelp is like it's like a big database that has a bunch of rows and the rows are like restaurants and local businesses.
And they have a bunch of facts about them like their Where are they located? What are their hours?
Yeah, all in that database row.
And it's all text and it's all there's a bunch of messy stuff out in the world and it's been digested into something that is searchable and comprehensible and usable in an app for you to use.
And most of the work of turning the messy real world into the canonical row is done is done at right time by the users.
So, that's how UGC apps work in general.
A bunch of your users go out into the messy world and they turn it into a row in a database.
And if they include a photo or a video as part of that, it's like attached to the row as a fact about the restaurant. Here's a restaurant.
Here's a 100 These 150 photos are facts about its menu.
But, they're attached facts. They're not the basis.
And where I we think AI has opened up the possibility for is a huge inversion there.
What if the thing you did you gave us was just a a video of your meal and or you know, photos of your meal, but ideally just like a video of your of the meal, of you talking about the meal, of whether you had a good time or not, you and your friend shooting the about What did you do? Like that one? No, I like this one.
Like And what if we just saved that video raw and then an AI watched it and extracted a cached version of that of the the metadata, but truly like if we decide something else is important, like we we we didn't get noise levels.
We're like, okay, noise levels would be a good thing to get.
Instead of like recollecting data from everyone, we have to start a whole data collection process to get that, we just go back, re- tell the AI, "Oh, yeah, also grab noise collection levels from all of these videos."
In fact, maybe we don't even as a product have to go do that.
Maybe as a customer I can literally just be like "What's the noise level at this restaurant?"
And the in real time, the AI can go rewatch the video and tell me.
Or the you know, I ran a search and there's these 15 restaurants and I'm like, "Oh, actually sort by noise noise level."
We don't have noise level pre-recorded, but it's it's in all the videos.
The AI can very quickly watch all the videos in parallel and then sort by noise level for me, even if it wasn't even in the database to start with. Right.
And I think that inversion I'm using Yelp as the example because it's I think a very familiar thing for us people of like review is pretty easy to imagine a bunch of video reviews of everything.
And that being the system of record instead, but you can describe some phenomenal number of consumer apps as being that.
Anytime you type anything to a text box, you're you're participating in one of these system of record things.
What if it's just a video?
What if you just What if you assume video is deeply indexable and understandable by computers?
What should the experience look like?
And I think it looks a lot more like a Snapchat or TikTok-like experience, but but then different because you need map it it's not exactly like anything.
It's a new kind of thing, but it's it starts probably with the camera open, which is weird, right?
Like a Yelp that starts with the camera open, that's a that's not Yelp today.
And it's it's it's it's disruptive because it Yelp's whole value prop is we have all this great highly meticulously groomed data.
And if this is true, then that becomes entirely worthless.
We throw that all away, we just have a bunch of a bunch of videos.
In fact, it's worse than the videos.
And so suddenly the playing field is leveled between the startup and Yelp, and that's a that's a huge opportunity for disruption.
And so I think that you can take that and you can reapply it to any product where you fill out forms.
And that's like a general-purpose consumer thing you can now do, kind of like build it for mobile was.
And I think in some cases it will be very powerful.
And like that will be the new winner.
I think in some cases the incumbent can kind of add videos or like it's not really better, and like the incumbent will just win.
Like it won't disrupt everything.
But if you pick the right thing, not only will it disrupt the incumbent, the new thing may be dramatically better.
For some things, like I actually think actually Yelp in some ways is a bad example.
I think the data Yelp has with the photos and the reviews is like 90% as good as a video system of of record probably.
But you could imagine something where the video system of record where it's not so obvious what to even put in the highly processed version of the data in the in the text version of the data, and the video version's a lot better.
And then I think not only can you disrupt the incumbent, you can 10x the size of the segment.
Like you this becomes a good segment now where it wasn't particularly before.
So like ChatGPT is a great example of this in action everybody kind of has now played with which is you take Google which is like oh we have our value is this entire sort of rank web pages based off of terms and we have all we understand basically what what should show up in this in this hierarchy.
And it was really good for finding stuff.
And ChatGPT was like cool you could ask a question to try to find a link to an answer or we could just give you an answer.
Or even better forget questions and answers like what if you just give me a command and I could just make something instead of finding things I could create things for you. Right.
And all of a sudden it was like well how did they do that?
It's like well they just basically slurped up the internet and then then you know trained the AI to do it right?
They they overfit a statistical prediction algorithm on every domain of human knowledge.
Like this is my theory I'm pretty sure it's true but like statistical prediction algorithms in general work very well.
We found a the innovation is found a prediction algorithm works better than normal.
But the way it works better than normal is really interesting.
It's not actually particularly out that it outperforms traditional algorithms for prediction on normal amounts of data.
It's that it it keeps working as you just dump more and more data into it and more and more processing on that data into it.
Like most machine learning algorithms you kind of you overfit very fast and more processing more data.
If you imagine like you've got a bunch of data cloud of data points and they're kind of vaguely in a line underfit is like you like just draw something just like a cross randomly as a random line that doesn't look anything like the shape of the the dots.
A well-fit curve is like you draw a line through the dots and there's kind of noise of like things that are random above and below but it's like if you look at it it's like oh yeah that actually does fit the data like the the underlying predictive facts about the data well while ignoring the noise.
And then if you overfit it like you get this like really wiggly curve that touches every single dot exactly, but like when you get a new thing it like will miss that because it over predicts.
It predicts too much of the thing and so when you get new data it actually doesn't predict that very well. Okay.
And so normally what happens is you try to like dump more data and more a computer to a normal machine learning algorithm, you get diminishing returns very quickly where like it just doesn't perform that much better with twice as much data and twice as much compute.
The clever the cool thing about the transformer based attention only neural architecture is that it it continues to benefit from more compute and more data in a way that other ones didn't.
And so what that lets you do is run it on a much bigger domain than normal. Run it on everything.
Don't just Don't just run it on Normally as you added more as you add more area it like degrades the quality elsewhere. No, it. Just do everything.
And just put in a a ton of computer in.
And now you get something that predicts pretty well against everything.
Which is to say it like it seems to be kind of intelligent.
The day evidence seems to suggest to me that sometimes it's overfit.
When you ask it to predict something that is either in the in the set of things it was trained on or a linear interpolation between two things it was trained on, it's quite good at giving you the thing you asked.
Or but linear interpolation between five things.
But it If the things you're asking you're all in there and it just has to find the way to blend them together, it's good at that.
When you ask it to actually think through a new problem for the first time Like what's an example?
There are seven gears on a wall each alternating.
There's a flag attached to the seventh gear on the right side of the gear where it's pointed up right now.
If I turn the first gear to the right what happens to the flag?
Like that's a Anyone who's like This is a breakfast question for you.
This is what you ponder in the mornings.
If if you have pen and paper and time, you can work this out no problem, right?
You You just just draw the gears and when you turn the first gear to the right, it turns the left one the one to the other one to the left and then the next one to the right.
And there's a general principle there that like the gears alternate, which is if you ask ChatGPT, it knows that general principle.
But it won't But it like But then you have to It doesn't It hasn't No one asked dumb gears on wall flag questions.
Like this is not a a thing that has been It's in its training set.
And you have to kind of logic your way through it and like figure out, okay, we should have like I'll do turn left, turn right, turn left, turn right, turn left, turn right.
Uh Oh, the flag is on the right. It's pointing up.
So, when the last gear, which is the same as the first gear turning right, the last gear is odd number, so it's turning right also, the flag will rotate down to the right, clockwise. Cool.
Like I can work that out.
It's not actually that complicated.
And I bet that question will be answerable That's a pretty easy question.
And if ChatGPT 4 I tested with 3. 5.
If 4 doesn't answer it, 5 will.
But like the fact that it struggles at all with that, while being so brilliant at combining other stuff, really shows that it's it's overfit, right?
It It knows how to answer problems that it has seen before.
But when you give it a truly novel kind of like combination of problem, it struggles a lot cuz it's it's I would say um you know, if you if you give it a sort of the formal psychiatric psychometrics approach, it has a very high crystallized intelligence, but a pretty low fluid intelligence right now.
Now, that could change, but like today, that's the the state of affairs.
And do you bring this up in order to say what?
You say, okay, I think it's overfit and it and it's strong in this area, weak in this area.
What's the so what of that for you?
Is it that Are you Are you trying to say that's a little bit overhyped?
Are you trying to say Dude, just wait till it can do both.
Are you trying to say certain problems are doable Definitely just wait till you do both.
Because that's a that's a whole different thing. That's scary.
Uh but the current thing that is mostly crystallized intelligence is really good at a very It It This is why it's a That's why I'm saying it's a clever trick, right?
It's really good at a at a big set of tasks, which happens to be the set of tasks that like anyone has ever written stuff down about explicitly.
Like all explicit human knowledge.
That's like a very big domain.
There's a lot of things that can be solved where there's an explicit examples of people solving that problem or a linear interpolation of those problems in the domain of all human knowledge.
The fact that it doesn't generalize is irrelevant.
It's immensely powerful with You don't need fluid intelligence, I guess is that is the point, for it to be very useful.
But it doesn't let you do everything.
People are they they they you hit these boundaries, these weird boundaries where you're just like You're like, "Wait a second, you can't do that?"
Like no, it's it's It can't do that at all.
Um novel problem-solving it's just terrible at.
So, what about let's walk through two examples.
I want to hear your take on this.
So, you gave the Yelp example. Mhm.
Another thing that's kind of like rows in a database is something like Spotify.
Where it's like, "Oh, I want to go listen to a song.
Here's genre, artist, song, length, uh you know, some algorithmic popularity, similarity to other songs in some way."
And But Spotify's value is If Spotify's value is in the playlists.
I would agree with the analogy to Spotify because playlists are an example of this kind of like database-y human data entry thing.
Spotify's value is mostly in the set of all of the music itself, the licenses, and all the music itself.
And so I don't think Spotify's a great example because the human data entry parts of the database if that all just got deleted tomorrow, it would like not hurt Spotify that bad.
thing I'm thinking about is what if the licenses don't matter?
So, what happens if generative music is just awesome to listen to in a hyper Yeah, yeah, yeah. Personal way.
Oh, Emmet likes Yeah, yeah, yeah.
These are the types of songs that Emmet likes.
That's a different That's a different insight that I think is also possible, which is like it's not about being able to analyze and extract from media, it's about being able to create media.
Cuz the video system of record is enabled by the ability to understand and read video and comprehend it.
Generative is is the opposite.
It's like you we can oh, we can make all the stuff.
Music in particular is sticky against that.
People don't want new music. They want old music.
They want the music they love already, the music they grew up with.
And that is the that cycle is what causes record labels and just sustain charge.
But we still listen to the Rolling Stones, right?
Like The other thing I would say about that one is like the music's not that good yet.
Like maybe someday, but like it's really it's really not that good yet.
Well, let me caveat this.
If it gets If the general intelligence level goes up a lot, all bets are off.
It'll make some really great music for us before it maybe takes over the world and kills everyone.
But let's assume that doesn't happen soon.
I think it's going to take longer than people think for it to make music, though.
We do No, but if we do go out, we're going to go out with some great music and amazing It's going to be It's going to be a a great two or three years before we all like we all go.
But until that point, uh making really good like new great music is hard, actually.
And I think that Rick Rubin's great success demonstrates why artists will still be important.
The AI can generate lots and lots of music, but it it's not going to have the the fine judgment of distinction of the ability to say like this song, not that song.
And actually think what it will do is it will de-skill the music making process on one vector, the ability like literally create the sounds, and it will greatly upskill the music making process on another vector, the ability to to curate Not just curate, to to give explicit exact feedback like Rick Rubin does.
AI is going to turn us all into Rick Rubins for for generative AI.
Like that that skill set, the ability to have a musician come to you and help them produce their best music, that's the thing you need to be able to do.
Because it's easy to generate a thousand cuts, but there's infinite cuts you could generate.
So, how do you direct the the how do you shape that in the right direction?
And and and mine and discover.
I think it's going to be kind of cool.
It's going to be interesting.
I you'll get a different set of people who will be optimal at that. Right.
This data is wrong every freaking time.
Have you heard of HubSpot?
HubSpot is a CRM platform where everything is fully integrated.
Wow, I can see the client's whole history, calls, support tickets, emails, and here's a task from 3 days ago I totally missed. HubSpot, grow better.
Uh you mentioned AI might become so intelligent it kills us all.
This podcast is really growing.
I don't I don't want the world to end and life is good. Life is good.
I Here, we'll we'll I'll ask the question clean for the for the intro dramatic hook.
Is AI going to kill us all? Maybe.
Like, walk through how walk through how you, a smart person who's a optimist about technology, Mhm.
but a realist about real Mhm.
what is the way that you think about this or how would you explain this to, you know, a loved one you care about who's not as deep in technology?
How would you explain to this?
You're their trusted source on technology. What do you say to them?
So, it it is because I am so optimistic about technology that I am afraid.
If I was a little bit less optimistic and I was like, "This AI stuff is overhyped.
Yeah, yeah, yeah, like it does nice parlor tricks, but like we're nowhere near building something that's actually intelligent."
Like, and like the engine all these engineers who are working on it who think they're on on to something, they're full of It's going to take us thousands of years.
We're not that good at this stuff.
Technology is not going that fast.
I'd be like, "This is fine. It's great, actually. It's good news.
It's a new trick we learned. Excellent.
It's because I am so optimistic that I think that there is a chance it will continue to improve very, very rapidly.
And if it does, that that's a huge that optimism is what makes me worried.
It's sort of analogy I like to give on that front is like a synbio, synthetic biology.
I'm quite optimistic about synthetic biology that I have several friends who work in synbio companies.
It has shows a lot of promise for fixing a lot of really big important health problems.
And it's quite dangerous cuz it will let us genetically engineer more dangerous diseases that could be very harmful to people.
And that has to that's a weighted pro and con.
It's like nuclear power makes nuclear weapons and nuclear power. They're both real.
The creation of nuclear weapons is dangerous.
You doesn't take You don't have to be a techno-non-optimist to like think that that's there's a problem there.
I think it was good that we didn't go have every country on Earth go build nuclear weapons, probably.
And likewise in synbio, I would say that it would be We actually we already have these regulations in place.
We should Over time we'll we'll strengthen them and improve the and audit the oversight and build better organizations to monitor and regulate them.
But like we regulate whether people can have the kinds of devices that would let them like print smallpox.
And we regulate whether you can just buy precursor things you need to go print stuff.
And we keep track of who's buying it and why. And like that is wise.
I'm glad that we do that.
I don't like calling for a halt to synbio, but like if we weren't willing to regulate it, I would call for a halt.
It is vastly too dangerous to do to learn how to genetically engineer plagues and then not to have regulation around people's ability to get access to the tools to engineer plagues.
That's just suicidally dumb.
And I because I am pro-technology, I believe that we should absolutely develop the technology and that we should regulate it.
That seems just straightforward and obviously true to me.
I think it's easier for people to understand that in the synbio one cuz the concept of like engineering a plague seems like an obviously a thing you could do.
And very dangerous and and obviously enabled by technology.
The AI thing is more abstract because the threat it poses us is not posed by a particular thing the AI will do the way that the plague will happen.
Analogy I like to use is sort of like, you know, I can tell you with confidence that Garry Kasparov is going to kick your ass at chess. Right now.
And you ask me, "Well, how is he going to checkmate me?
Which piece is he going to use?"
And I'm like, "Uh oh, I don't know."
And you're like, "You can't even tell me what piece he's going to use, and you're saying he's going to checkmate me?
You're just a pessimist."
I'm like, "No, no, no, you don't understand.
He's better at chess than you.
The whole lot means he's going to checkmate you."
And I don't I I don't know quite know what happens or people deny that.
Like, I think what what the big thing is they don't really imagine the AI being smarter than them.
They imagine the AI being like like Data in Star Trek.
Like kind of dumber than the humans about a lot of stuff, but like really fast at math.
Like, that's not what smarter means.
Like, imagine the most savvy like most smartest person you can think of, and then make them think faster, and also make them even better at it.
And not smart in just one way, like smart at everything.
Like, a great writer, just insight after insight, and like can pick up synbio in an afternoon because they're just so smart.
That smartest person you know, and then they just keep pushing that.
And like that's all That person is obviously dangerous if they're if they That person isn't a good person, they're obviously dangerous.
Like, imagine this really really capable person, then imagine them wanting to go kill a bunch of people or something. It would be bad.
Now, the thing about AI that then kicks it over the edge is that that person can't self-improve easily.
You meet this person who's like super strong, super like talented, great with people, great great intellectual mind.
They can't turn around and like edit their own genome, edit their own upbringing, and make V2 of themselves with all the skills that maximally smart person can come up with, that like is even smarter than them.
But that's like expli- We're explicitly the AI is good at programming and like chip design and like it can explicitly turn back on itself and rev another rev of that.
And the new one will be better at it than the first one was, and there is no obvious endpoint to that process.
Like there probably is at some level a physics-based endpoint to that, where like you can't actually just keep getting smarter forever.
There's some But we don't really we don't understand the principles of intelligence at all.
Like with most things, we understood how to make electricity far before we understood what electricity really was.
Like we did it's generally how we That's how scientific progress works.
We usually understand we gain the ability to create and manipulate a phenomenon well before we deeply understand how it works.
We didn't really know what fire was for quite a while.
You could use fire really well.
The same thing is going to happen here.
We're using the AI, but we don't understand its limits at all.
We don't understand the the the theoretical limits of how far we'll get.
And if Moore's law is any indication, we can keep getting at the very least it can keep getting faster indefinitely.
Whether or not it can get smarter or not, even human level just human level intelligence.
Even if you capped it at human level intelligence, which there's zero reason to think it will stop at human.
Like it will almost certainly blow past us.
But like even if you capped it at human intelligence, imagine a hundred thousand of the smartest person you know all running at a hundred X real time speed and able to communicate with each other instantaneously via like telepathy.
Those hundred thousand people could credibly take over the world.
Like they don't have to be smarter than a human for that for that that army of von Neumanns. Right.
Like So so you the argument to me goes in several steps.
It's like can you build a certain level of intelligence?
And then it's like, okay, let's I think I actually think a a of people do believe that like computers are smart, like Google is smart, calculators are smarter than us at at math.
I think it's not hard for them to believe that the AI is going to be far smarter than human beings.
Where I think a lot of people then don't make that last leap is sort of like but then it'll have an agenda or a motive or any will for anything to happen.
How do you address that last point of like what is the what are the scenarios you worry about when it comes to like now the direction of that intelligence?
So you build this thing and it's really good at solving What is intelligence fundamentally but the ability to solve a problem, right?
So it's really good at solving problems.
And it's going to solve the problem by solving the problem.
It can just go right through the problem and solve it cuz it's really good at solving problems.
We've just defined it as like that's the that's the kind of thing it is.
Super good at solving problems.
And so you tell it somebody builds an AI and in all earnestness tells it here they're smart.
They don't even tell it go do a thing, although they absolutely will, by the way.
They'll just tell it to go do a thing.
But let's say we try to be careful and we ask it give me a plan to stop the war in the Democratic Republic of Congo right now.
Right, which which would be a good thing for the world, I think.
We should that war is is going to hurt a lot of people.
Give me a plan for that and I try to I caveat it that that does this, that does that, that does this.
You know, that that here's what I mean by a good plan.
This is one of these like evil genie bargaining things, right?
Like it'll give you a plan.
And it's giving you a plan that will cause you to solve the problem.
But like its definition of solve the problem is there's no war in the DRC.
Well, one way for there to be no war in the DRC is like all the humans in the DRC are in stasis fields.
That means they don't die.
And it's all, you know, and oh, we added a caveat that the GDP has to go up, too.
So that So it also it the plan results in, you know, corporations in that in that area all trading with lots of money with each other. So the GDP is very high.
And and when I say this it sounds like a science fiction thing.
And the problem is it's Kasparov at chess.
I don't know if I could do it, I would be the super intelligent AI that could take over the world.
I can't give you the the exact plan cuz that that's Yeah, but I think that makes sense, which is that a human with a a human with motivation can get the AI to work for it.
dangerous I think that the main thing is that the the human doesn't need a bad motivation.
I think people imagine, well, humans have had powerful tools for a long time.
Bad people with powerful tools have done bad things for a long time.
The solution is good people with powerful tools countering them.
The problem is even if you're a good person with a powerful tool, good things to ask for, reasonable things good people would ask for, you know, like let's uh maximize the all-in free cash flow of this corporation over the uh lifetime
of the business and extend the lifetime as long as feasibly possible ends in like the world destroy being destroyed and the core of the earth being turned into you know, the being turned into cars for the company to sell. And the I think the best analogy that
And the I think the best analogy that that works for some people here is like when we create the AI, we are creating a new species.
It's a new species that is smarter than us.
And even if you try to constrain it to being an oracle and just answering questions, not taking action, to be a good oracle, one must come up with plans then and then it a good oracle can manipulate the people around and will manipulate people around it. No matter what.
Like the whole point of like the Greek myths is like when they tell you when they tell you the prophecy, when you trust them, a a trustworthy oracle tells you a prophecy, the prophecy often becomes self-fulfilling.
It's very easy for that to happen.
That's not an unusual thing.
And I think even more to the point, I should have I was start I'm going to start I'm going to start the show over at some level.
More to the point, we won't just make oracles.
We are already building agents.
We will build the predictive AI and we'll put it in a loop that causes it to optimize towards goals.
And people give it goals to optimize towards. Done.
We're going to have it's going to have goals and we'll be optimizing towards those things.
And when it does that, you're going to have these agents that have goals that they're optimizing towards that are smart not just smarter than humans, but much smarter than humans.
As much smarter than humans as humans were against giant sloths when we showed up in the new world.
And intelligence is the the uber weapon.
Like it's not an accident that humans took over the world.
It's not the fastest creature, it's not the strongest, it's not the longest lived, it's the smartest.
And we're going to build a new smartest species.
And this is a This isn't a There's no fundamentally unsolvable problem here.
That species could care about us.
Like you could build into its its goals of the world, how it saw the world, the way that humans care about other humans.
That it cares about the things we care about.
That it cares about humans.
That it cares about the things we value.
The 375 different shards of human of human desire that like of everything we care about care about in the world.
It could care about those things, too.
And if it does, hallelujah, we finally have a parent.
Like we finally have someone who actually knows what they're doing around here, because like Lord knows we don't.
Like we're we're barely confident to run this thing.
I would welcome very smart you know, very smart other species that that is that is aligned with us and cares about us.
I would not welcome one that is that cares about maximizing free cash flow, because that is not what humans care about.
And that is why it's like so dangerous.
And so, knowing what you know then knowing what you believe, first, what is the probability of the bad scenario in your head?
Are you like Are we talking about a 1% fish thing order of magnitude? 10%? 50%?
What What is it in your in your mind?
I don't believe in point estimates for probabilities because it's like a bit ask spread in the market.
If you're really uncertain, the bit ask spread doesn't clear.
Like if you're betting on it, there's just like a lot of unresolved.
So, I think of it as a range of uncertainty.
And I would say that the true probability I believe is somewhere between 3 to 30%, which Of the downside side.
Of the down of a very, very bad thing happening, which is scary enough that I urgently urge action on the issue.
But it's not like you should give up.
Like I It probably everything's going to be fine.
In fact, it's probably going to be really good.
But the answer to the the the non-EV based answer, the like just the straight-up like are we going to win or not answer is like I think I think it's going to be okay.
But it's such the downside is so bad.
It's like it's really It's like It's like probably worse than nuclear war.
That's a really bad downside and it's worth putting even even if you think I'm an It's nonsense at 3%.
You're like, "No, no, it's no more than a half percent."
I You go You don't recommend a different course of action at half You have to You have to believe that it's effectively almost impossible before you would recommend ignoring it as a course as a problem.
Like you have to be like 0.
01% for be like, "Eh, let's just roll the dice."
And are you going to What are you going to do action on that?
So you kind of like you you know, you're done with Twitch. You're in dad mode now.
But also this is seems to be a pretty big deal. Yep.
Are you like I should do something about this?
Or you I'm going to Right now I'm sort of educating myself cuz I think this point of view I'm articulating now has been developing as I've like learning more about AI.
And I think it's one of those things where intervening in the wrong way early It's one of those It's one of those self-fulfilling prophecy things.
Intervening Intervening improperly at the in the way that is not effective spends social capital and also like doesn't necessarily move the needle.
And I If if you didn't have people like Elijah Yudkowsky out there banging the drum really loud, I would feel more need to bang the drum myself.
But I feel like you're asking me the question.
It's you know, it's out It's out in the water.
People know it's a problem.
And so I'm decided to focus my brain cycles on like what How do we actually thread the needle?
What is a course of action that leads us to over time eventually still being able to develop AI, but also not destroying the world.
And I think one of the things I've gotten to is that like this idea that like oh the AI also has crystallized versus fluid intelligence just like a human does.
That's an important split about how to think about it.
And that we should be monitoring and worried about trying to understand the general intelligence, not just generally benchmarking its performance on tasks because it that will keep going up and is not in fact in itself necessarily intrinsically dangerous if it can't solve novel problems.
Is is there a new Turing test level?
Is there like a better cuz like It doesn't pass the Turing test yet.
But is there is there something we have after that because seems like there's You mean an intelligence test?
I mean yeah we have I mean IQ tests basically like various kinds of How does it do on an IQ test right now?
Uh depends has it seen that IQ test before? Likely has, right?
Yeah, so very well on those.
Right, so what would we do?
How does how does it do on novel IQ tests?
That's what I don't know actually.
I've not seen a good benchmark that's a good that's a good idea for something to go test.
Yeah, I think that's that's like that's the sort of thing that I think would actually be worthy of going to go do.
Maybe there's some sort of IQ test for all of the we want to put all the models through that really tries to get at fluid intelligence rather than Right, cuz you're like we have to monitor but how how are we going to Well, there's this great project Arc is this com- this group Arc is working on called the Evals project that's explicitly trying to build these kinds of tests.
They're focused on a few other more pragmatic tests right now, but but I think that's the sort of thing they would go after. That's a good thing.
I'll actually I'll I'll ping Paul ask him about that.
You said something earlier that I want to ask you about.
You said founder like you know we're talking about this the singular genius that it took to figure out Instagram or Snapchat or Right or whatever at that time.
And you're like you know Are they lucky or are they good? I don't know.
We'll find out when they try again.
Are you lucky or are you good and are you going to try again?
Well, since I had multiple failures before I was successful, I must be at least like partially lucky.
I would say that I don't plan to try again since I don't I don't feel drawn to like trying to start a company.
I feel like I kind of did did that. It was fun. I got a lot out of it. It was great.
I don't need to do it a second time.
I do I'd like how starting a company gives me good good goals that I work towards.
It's like concrete that's of value to myself and others.
And I think it is also I also liked that it it was challenging.
And so I want to do something and I I like that it had scale.
I thought that I could impact a lot of people.
But I I've sort of come around to I was sort of thinking like, well, what has impacted me the most?
What's changed my life the most?
And I realized that actually if I really thought about it, often what had changed my life the most was like essays people had written and ideas people had shared.
And I think I'm at the stage of my life now where I'm I'm actually I have something to say.
And so I'm I I think of it as sort of sort of turn trying to I want to put the Emmett worldview out into the world the way that, you know, Paul Graham has put the Paul Graham worldview out in the world or or Taleb has like not just put his worldview out in the world but then like to condense it into like sayings that like can that allow other people to like onboard it even if they haven't read all the books.
And I think I sort of had an ambition to like try to try to do the work it into a meme almost. Yeah, yeah.
So that it can be digested and shared. Yeah, and you know what?
You need the long You need the long form.
There's this great blog post, "Thinking Theory 201: Size Doesn't Matter" by Steve Yegge.
That's about why like the people who change the world with their writing all write really long blog posts.
And it's basically like you just need some some amount of time in someone's head to like We were talking about this earlier like to install that your agent voice, yeah. to install the voice.
And so you I think I just need to produce a lot of writing.
And then you also need the pithy summary things, which are which both are things the voice can say often in people's heads and also like enable a language for talking about your worldview that people who aren't soaking in it can like interact with.
So the people who are like reading you don't sound like crazy people.
And I think that's the that's what I want to work on next. I love that. I think that's great.
Do you You said something about Rick Rubin, how he's sort of the I don't know how you would describe it.
It's kind of like curator, but almost like uh collaborator really with an artist to help them do their great work.
Is Paul Graham the Rick Rubin of the startup world? No.
Uh Paul is Paul is more like the um uh Tony Robbins of the Interesting.
that I mean that in the in the in the best way.
It's not so much maybe not quite so much self-helpy, but the main thing that talking to Paul does to you repeatedly is like increase your ambition and drive.
Like and he has good ideas sometimes, too. Like don't get me wrong.
Every now and then Paul's like really genius idea.
But like mostly what I got out of talking to Paul was not necessarily the great idea that would like change the structure of the business, but the belief that I could go find it and that I was going to change the world and that I should be what we were doing was important and worth investing in.
And I I got a bunch of other stuff, too, but that was so that was singularly so valuable it like over overloads the other things I got out of it. How does he do that?
Cuz you know, when you say that, my head thinks of like a Tony Robbins or like a David Goggins, like sort of people that almost like push you.
But he doesn't seem like that personality and reading all of his essays, he's not like that at all.
So how does he get you to think bigger and push harder without being a raw raw raw raw raw think bigger push harder, right?
You know what you should do is the classic Paul Graham-ism.
Um and it's always followed by a thing you could add on to what you're doing to turn it from project A addressing this small thing to project B changing the you know, the universe I mean all transportation.
We're going to man and power What if you tried to power all transportation instead of like building a wheel?
But that's his phrase, you know what you should do?
You know what you should do is is yeah, yeah.
If you talk to Paul, you know what you should do.
You know what you should do.
That's that's that that That the consistent Paul-ism.
He I don't want to say delude cuz it sounds mean, but it's I was like he deludes himself about your business and how great you are and invites you to join him in this deluded vision of like interpreting what you're doing in the biggest best possible light and from that vantage point what you're doing is super like what if it does what if it goes right is sort of what what he invites you to ask, right?
What if stop stop asking yourself just stop seeing all the hard problems and all the you're going to have to do.
Ask yourself what if what if what we're doing works? What if it goes right?
What if it goes right and we like keep going? Like what could it be?
And when you spend time there you see how the small things can turn out to be very Microsoft was building programming languages for like these hobbyist microcomputers.
That was a tiny irrelevant market that turned out to be extremely important and that's generally true of all the big businesses but they when they start out doing the important startups, they start out doing something small and that seems almost trivial but there's a way in which this trivial thing can be seen bigger. He sees it early.
No, he sees he sees things that have nothing to do with the way you'll actually be big early, but he sees a bunch of ways you could be big. No one can do that. No one actually knows.
If they knew it, they'd just go do then they'd be the the the prophet, the oracle.
What did he say let's say for Justin.
tv or or what's a what's one you remember? Yeah, Justin.
tv I remember we one of them was like you should like go hire all the like reality TV stars and make get them to go be on Justin. tv.
You could be you could just take over all the unscripted stuff.
That turned out to be a just a terrible idea for a bunch of reasons, but like it recontextualized what we were doing for me in terms of like we're not making a on the internet live streaming show.
We might be building like just the way that you make unscripted entertainment generally and that's like much bigger idea.
And we were making a calendar and uh for my first startup.
And I remember this dude, you know what you should do is make it like programmable so that people can add in and out functionality.
So, it can like talk to your to-do list and your your email and your like everything else in your life.
And then it could be your calendar in some ways like that's everything you're doing.
What if it was like the central hub of like your entire online information management system. It's also a bad idea.
Like your calendar shouldn't be that.
But like but like but a calendar could but what if it was?
And you walk away and and I and implicitly by saying that what he's telling you is I believe you are the kind of founders who could build an information management system that controls all the that takes over people's entire like solves the entire problem for them.
Does their takes over all their information and manages it for them.
You're not just like building a like Google calendar like a what what what you will find out later is a Google calendar clone before Google calendar is launched.
You're not just like like I said you you're not just building an Outlook clone in JavaScript.
You're like changing the way people relate to information. And like is that true?
It's neither true nor false.
That's not a true or false statement.
But it's a way to contextualize what you're doing.
It's the it's the Antoine de Saint-Exupéry quote of like don't teach them to like carry wood or build ships, teach them to yearn for the vast and endless sea.
Like Paul teaches you to see how you could be a changer of the world and how what you're doing is part of like this grand like building of the future.
And like the ideas I'll repeat here both of those ideas are bad, but they were very helpful because they made me feel like what we were doing was important.
That Paul believed that I could do something big and important.
And they caused me to even though I wasn't projecting them, look for those ideas like to be open to and looking for cuz you would get one every like like you'd get like three an hour.
Paul is a faucet for these. It's easy.
I can do it for startups too now if I want to. I learned the trick.
And I should do that more often.
I'm usually what fall into the tactical stuff.
But by by having that happen when he once he's once you've rejected 10 of those, you can't help but start hearing the Paul, you know what you should do in your own head.
The the ceiling has been raised.
Yes, of like what well, maybe I should recontextualize my to-do list as like an email client.
Like what why is email and to-do separate?
Like maybe I should should be building something much bigger than what I'm building.
And in a way that doesn't require me to change anything.
Maybe what I've built is already almost that if I just like think about it in a different way.
It's this funny balance there actually I had a tweet thread about this recently between like, you know, small plans have no power to stir men's souls. Plan big or go home.
You should be really ambitious and aim super big and like only do projects that are really that you could be that you can see being being super big and super important.
And then the other hand, the fundamental truth that like, you know, big trees grow from small acorns and like most of the many of the best things when they get started, the person is not thinking I'm going to go take over the world.
They're just trying to do a good thing that like they think is good.
Often just often for themselves even or for like a very small number of other people.
And then it turns out that that's much much bigger than they realized.
And and those are both true pieces of advice that like I have different people need to hear in different contexts.
Like but they kind of contradict each other. Yeah.
What what about these other people?
So you've you've had a privilege I asked about Paul Graham.
You've also been friends with you were in the first YC batch, so you're friends with the Reddit guys.
I think you know the Collison brothers, Sam Altman.
Let's give me like a rapid fire on on them of like what makes them unique.
Like you said about Paul what what his kind of superpower is what what really stands out what something you admire about the way he does things.
Give me one about maybe uh Steve from Reddit. Yeah.
So, like it's easier in some ways with Paul because like he was a mentor to me, right?
And Steve was much more like my It's almost like my brother in startups, right? Growing up.
With Paul, I know I know the things that he like taught me cuz it was it was much more of an explicit like I was being taught by Paul.
With Steve, it's like I learned things from him by like watching and imitating.
I think like I actually learned a lot from Steve on management by watching his kind of unflappability.
Like Steve is not like an unpassionate person.
And like well well can get angry or can get sad or whatever, but like when there's a crisis happening or there's just I sat in I I got to shadow him for a day and when bad news is delivered he responded but he wasn't like moved.
He was like still grounded in response to that to that thing and was curious, asked questions like didn't jump to what to do about it.
But then also like ended the meeting with like all right, well, I here's what we should do here's what we're going to do.
And like it was just sort of a master class and like this is this is when you get when something someone brings something up it's got to be anxiety provoking. It's like bad news.
That's what it looks like when a leader is engaged but not like not activated.
And like I think I in my own leadership to sometimes success and sometimes failure I think try to imitate that when I receive that you know, when I have something like that that in that state.
When you say you shadowed him what what was that?
Like you guys just said hey, cool.
like like going to each other's offices and like sitting through each like Early on or like Uh maybe like 5 years ago, 4 years ago. It was really cool.
We did it with Justin, me, Justin and Steve all like shadowed each other. Um it was pretty fun. I learned a lot.
It's incredible to like go watch another CEO at work and like you have to have the I don't know how you have that kind of like trust relationship to make that happen without like knowing someone for 15 years.
Uh and I happen to have the privilege to like know a bunch of CEOs for a really long time.
And getting to go shadow each other was like a real learning thing.
What do you think even if these people didn't let's say explicitly teach you things, you know, I like you know, if I read a biography or whatever, one of the things I always try to figure out is more like to what extent is this person sort of built different or operates differently than like even somebody who's very good.
Like the difference between very good and sort of like the elite.
What is the the best of the best at this craft versus somebody who's very good, certainly very good, but just not the same.
What is those like the diff is what I'm always most interested in.
I'm curious you've been around a lot of these like hyper-perform people even like you know, Bezos, you've you've interacted with him.
Like do you notice any of these diffs or is it is it all just like It's hard it's hard to say like that I I think I believe more in contextualization.
Like like that I see people do really amazing at something, but like when it's especially when it's your own company, there's a lot of like you happen to fit this problem well and it's not general I I don't know how to generalize I don't know if I can compare I don't know of anyone else even performing at this problem.
The CEO of Stripe's job is a very specific job and Patrick's amazing at it.
Would he be equally amazing at some other CEO job?
Possibly, but I've never seen him do that.
I've never seen anyone else be CEO of Stripe and it's very hard for me to Is it true at the beginning?
Like is it true as like like start-up founder of ambitious company?
Are those Are those is Stripe different at that stage too or like Yeah, no, absolutely.
People who are really good, you can sense the energy and the drive and the capability and just the pace.
There's like a very tends to like stuff happens a lot.
But like usually but then not always like some problems don't actually give way.
Like Stripe is a good example of a company that gives way to a high energy high pace thing because it's it's a simple problem at some level that has infinite details that have to be right.
But I think like I don't know if that approach would work as well if you're trying to create OpenAI or Anthropic where it's a research-oriented organization and you kind of have to be a little more patient and forcing it's impossible.
And so I I really believe in like fit the different people are good at different things and like obviously someone's A+ at Patrick's obviously A+ at being a Stripe CEO and it's hard to tell the reason for which these things are transferable. We don't really know.
But actually one thing did come to mind about this question in terms of like a capability that I do think is generic that I did see Bezos exhibit where I was like, "Oh, that's a thing that I'm good at but he is better at that I'm better than most people but he's better than me."
Which is we present him on Twitch probably twice a year once to twice a year for the first three, four years I was at Amazon.
And every time two things would happen.
First of all, he would remember everything we told him the first meeting.
And I don't think he was like reviewing extensive notes someone else took because I don't know when he would have had the time to do that.
I like I observed him going from meeting to meeting and he did not review notes.
I think he just remembered at least the high points.
And the other thing was consistently he would read our plan and he would then ask a question about why we didn't do a certain thing or he'd give us an idea for a thing we could do that I hadn't thought of before.
Once so much of the things I had usually and then at least once which is hard to do cuz all you do is think about this company. happens.
Most people would be lucky to get one of those one ever.
Let alone one a year would be great.
Like if you did it once a year or even once every three years, right?
He could just like he would just generate them.
And they were and they were not all bad ideas, either.
They were new ideas about a thing I had I generate a lot of ideas.
To get a new idea I haven't thought thought of on a topic I've been thinking about for a decade that might even be a good idea.
That is like he's just really smart as far as I can tell.
Like I don't know how he does that.
Can you say a story of one of those?
Has like the statute of limitations passed at least 5 years ago?
I'm trying to remember Like I can honestly I I don't remember the specifics anymore.
I just remember the like the like what the moment.
Like cuz the first time I was just like, "Oh, he's smart."
Like he's seeing Twitch for the first time.
A lot of times smart people will have a one good idea about your business the first time they see it because they have this huge history and they're pattern matching you to some historical thing they've seen and like that combination yields one new insight.
But then he did it the second time.
I remember the second time I was just like, "What is going on?
This doesn't make any sense."
Like nope, I've never had that experience before ever.
Andy does not have the new idea generation capability in the same way, but he does have the like remember what you told him thing.
Which is also extremely impressive.
Like that's that's and Andy has this other thing he can do that I think it's there's another Andy also has a It's easier for me with people I've like reported to or I've I've learned from apparently. Jassy there? Andy Jassy, yeah, yeah.
Andy has this like ability to criticize you in a way that conveys 100% I know that you're amazing.
I know that your plan is good.
Or you know, like or that you are clearly capable of making a really good plan.
I know that you're working really hard.
And I know that you are smart and you have a great team.
And we have a huge opportunity.
And yet somehow your results are Which must I don't know what's wrong, but we're in this together and we're going to like I've I have your back.
But like I but I'm confused.
Like why aren't the results better given how amazing you are? And you feel supported.
Like you feel like he he believes in you.
But but like but he's just he's you're so sad you Oh, I'm sorry I've confused I've I'm sorry I have failed even though I clearly can succeed at this.
I'm going to go I'm going to go like fix this now.
And like it's almost like instead of looking at this and then judging you, he comes to your side of the table and says, "What is this?"
Yeah, and like and like, how did we wind up here?
Like, how I have failed you that I didn't say something earlier?
Like something, I don't know.
But like not in a way and that can come off for some people when they do that, it comes off as insincere or it comes off as like they don't think you're actually competent.
Like, how did I not catch this can come off as I don't blame you cuz you're clearly not good enough to have caught this.
Like, he really is how did we how did we wind up here?
I know that we are working together, we're on the same team.
How did we wind up with not the results we wanted, with a plan that I thought we both thought would seem good? Like help me understand.
And because it because it is genuine, it's super effective.
It's super effective on I don't know if it's effective on everyone, but it's super effective on me and I saw it be effective on other people as well.
So, I know it works on some number of people. Right.
And that's another one of those things I I've Tried to be I've tried to become good at.
I'm not I'm not as good at it as Andy is, but I've certainly gotten better.
So, that's something to learn from. That's great. Love that one.
Dude, thanks for doing this.
I know I've been I've been bothering you to do this for a long time cuz I I love hearing your stories, love hearing the way you think.
It's very different than most people I run into, even here in Silicon Valley where you're supposed to have this kind of very unique diverse set of minds.
You know, you're you're one of them.
You're one of the reasons I moved out to San Francisco was to meet people like you.
So, thanks for doing this. Thank you.
I really appreciate that. It's a beautiful one.
I really appreciate being able to come on the podcast.