0:00
Welcome to episode 124 of the All-In podcast.
Welcome to episode 124 of the All-In podcast.
My understanding is there's going to be a bunch of global fan meetups for episode 125.
If you go to Twitter and you search for All-In fan meetups, you might be able to find the link.
to be clear, we're not They're not official All-In.
It's fans that self-organized, which is pretty mind-blowing.
But we can't vouch for any particular organization, right?
Nobody knows what's going to happen at these things. You could get robbed. It could be a setup. I don't know.
But I retweeted it anyway because there are 31 cities where you lunatics are getting together to celebrate the world's number one business technology podcast. It is pretty crazy.
You know what this reminds me of is in the early '90s when Rush Limbaugh became a phenomenon. Uh-huh.
There used to be these things called Rush Rooms where like restaurants and bars would literally broadcast Rush over their speakers during I don't know, like what from the morning through lunch broadcast.
And people would go to these Rush Rooms and listen together. What was it like, Sachs?
Were you about 16, 17 years old at the time?
What was it like when you hosted this? It was a phenomenon.
But I mean, it's kind of crazy.
We've got like a phenomenon going here where people are self-organizing.
You've said phenomenon three times instead of phenomenon. He said phenomenon. Phenomenal.
Why is Sachs in a good mood, Chamath? What's going on?
There's a specific secret toe tap that you do under the bathroom stalls when you go to a Rush Room.
We're already off the rails.
I think you're getting confused about different event you went to.
There's a lot of actual news in the world, and generative AI is taking over the dialogue, and it's moving at a pace that none of us have ever seen in the technology industry. I think we'd all agree.
The number of companies releasing product and the compounding effect of this technology is phenomenal.
I think we would all agree.
A product came out this week called AutoGPT.
And people are losing their mind over it.
Basically, what this does is it lets different GPTs talk to each other.
And so you can have agents working in the background and we've talked about this on previous podcasts.
But they could be talking to each other essentially and then completing tasks without much intervention.
So if let's say you had a sales team and you said to the sales team, "Hey, look for leads that have these characteristics for our sales software, put them into our database, find out if they're already in the database, alert a salesperson to it, compose a message based on that person's profile on LinkedIn or Twitter or wherever, and then compose an email, send it to them.
If they reply, offer them to do a demo and then put that demo on the calendar of the salesperson, thus eliminating a bunch of jobs and you could run these what would essentially be cron jobs in the background forever and they can interact with other LLMs in real time.
Sachs, I've just gave but one example here, but when you see this happening, give us your perspective on what this tipping point means.
Let me take a shot at explaining it in a slightly different way. Sure.
Not that your explanation was wrong, but I just think that maybe explain it in terms of something more tangible. Sure.
So I I had a friend who's a developer who's been playing with AutoGPT.
By the way, so you can see it's on GitHub.
It's kind of an open source project.
It was sort of a hobby project, it looks like, that somebody put up there.
It's been out for about 2 weeks.
It's already got 45,000 stars on GitHub, which is a huge number.
Explain what GitHub is for the audience. Thank you.
It's just a code repository and you can create, you know, repos of code for open source projects.
That's where all the developers check in their code.
So, you know, for open source projects like this, anyone can go see it and play with it.
It's like Pornhub, but for developers.
It would be more like amateur Pornhub because you're contributing your scenes, as it were, your code. Yeah. But yes, continue.
But anyway, this thing has a ton of of stars and apparently just last night I got another 10,000 stars overnight.
This thing is like exploding in terms of popularity.
But anyway, what you do is you give it an assignment and what AutoGPT can do that's different is it can string together prompts.
So, if you go to ChatGPT, you prompt it one at a time and what the human does is you get your answer and then you think of your next prompt and then you kind of go from there and you end up in a long conversation that gets you to where you want to go.
So, the question is what if the AI could basically prompt itself?
Then you've got the basis for autonomy and that's what this project is designed to do.
So, what you'll do is what my friend did is he said, "Okay, you're an event planner AI and what I would like you to do is plan a trip for me for a wine tasting in Healdsburg this weekend.
And I want you to find like the best place I should go and it's got to be kid-friendly.
Not everyone's going to drink.
We're going to have kids there and I'd like to be able to have other people there.
And so, I'd like you to plan this for me."
And so, what AutoGPT did is it broke that down into a task list and every time it completed a task, it would add a new task to the bottom of that list.
And so, the output of this is that it searched a bunch of different wine tasting venues.
It found a venue that had a bocce ball lawn area for kids.
It came up with a schedule. It created a budget.
It created a checklist for an event planner.
It did all these things and my friend says he's actually going to book the venue this weekend and use it.
So, we're going beyond the ability just for a human to just prompt the AI.
We're now the AI can take on complicated tasks and again, it can recursively update its task list based on what it learns from its own previous prompt.
So, what you're seeing now is the basis for a personal digital assistant.
This is really where it's all headed is that you can just tell the AI to do something for you pretty complicated and it will be able to do it.
It will be able to create its own task list and get the job done.
And quite complicated jobs.
So, that's why everyone's losing their [ __ ] over this.
Free burger, your thoughts on automating these tasks and having them run and and add tasks to the list.
This does seem like a sort of seminal moment in time that this is actually working.
I think we've been seeing seminal moments over the last couple of weeks and months kind of continuously.
Every time we chat about stuff or every day there's new releases that are paradigm shifting and kind of reveal new applications and and perhaps concepts structurally that we didn't really have a good grasp of before some demonstration came across.
ChatGPT was kind of the the seed of that and then all of this evolution since has really I think changed the landscape for really how we think about our interaction with the digital world and where the digital world can go and how it can interact with the physical world.
It's it's just really profound.
One of the interesting aspects that I think I saw with some of the applications of AutoGPT were these almost like autonomous characters in in like a game simulation that could interact with each other or these autonomous characters that would speak back and forth to one another where each instance has its own kind of predefined role and then it explores some set of discovery or application or prompt back and forth with the other agent.
and forth with the other agent. And that the kind of recursive outcomes with this agent-to-agent interaction model, and perhaps multi-agent interaction model, again, reveals an entirely new paradigm for, you know, how things can be done, simulation-wise, you know, discovery-wise, engagement-wise, where one agent, you know, each agent can be a different character in a room, and you can almost
see how a team might resolve to create a new product collaboratively by telling each of those agents to have a different character background, or different set of data, or different set of experiences, or different set of
personality traits, and the evolution of those that multi-agent system outputs, you know, something that's very novel that perhaps any of the agents operating independently were not able to kind of reveal themselves. So, again, like
So, again, like another kind of dimension of interaction with these with these models.
And it again, like every week, it's a whole 'nother layer to the onion.
It's super exciting and compelling, and the the rate of change and the the pace of kind of, you know, new paths being being defined here, really, I think, makes it difficult to catch up, and particularly, it highlights why it's going to be so difficult, I think, for regulators to come in and try and set a set of standards and a set of rules at this stage, cuz we don't even know what we have here yet.
And it's going to be very hard to kind of put the genie back in the box.
Yeah, and and you're also referring I think to the Stanford and Google paper that was published this week.
They did a research paper where they created essentially The Sims, if you remember that video game, put a bunch of, what you might consider NPCs, non-playable characters, you know, the merchant or the whoever in a in a video game, and they said, "Each of these agents should talk to each other, put them in a simulation."
One of them decided to have a birthday party, they decided to invite other people, and then they have memories.
And so then over time they would generate responses like I can't go to your birthday party, but happy birthday.
And then they would follow up with each player and seemingly emergent behaviors came out of this sort of simulation, which of course now has everybody thinking, well, of course we as humans and this is simulation theory are living in a simulation.
We've all just been put into this.
Chamath, is what we're experiencing right now how impressive this technology is or is it oh, wow, human cognition maybe we thought was incredibly special, but we can actually simulate a significant portion of what we do as humans.
So, we're kind of taking the shine off of consciousness.
I'm not sure it's that, but I would make two comments.
I think this is a really important week because it starts to show how fast the recursion is with AI.
So, in other technologies and in other breakthroughs the recursive iterations took years, right?
If you think about how long did we wait for from iPhone 1 to iPhone 2? It was a year. Right?
We waited 2 years for the App Store.
Everything was measured in years.
Maybe things when they were really, really aggressive and really disruptive were measured in months.
Except now these incredibly innovative breakthroughs are being measured in days and weeks.
That's incredibly profound.
And I think it has some really important implications to like the three big actors in this play, right?
So, it has I think huge implications to these companies.
It's not clear to me how you start a company anymore.
I don't understand why you would have a 40 or 50 person company to try to get to an MVP.
I think you can do that with three or four people.
And that has huge implications then to the second actor in this play, which are the investors and venture capitalists that typically fund this stuff, because all of our capital allocation models were always around writing 10 and 15 and 20 million dollar checks and 100 million dollar checks, then 500 million dollar checks into these businesses that absorbed tons of money.
But the reality is like, you know, you're looking at things like Midjourney and others that can scale to enormous size with very little capital, many of which can now be bootstrapped.
So, it takes really, really small amounts of money.
And so, I think that's a huge implication.
So, for me personally, I am looking at company formation being done in a totally different way.
And our capital allocation model is totally wrong sized.
Look, Fund 4 for me was $1 billion. Does that make sense? Nope.
For the next three or four years?
No, the right number may actually be $50 million invested over the next four years.
I think the VC job is changing.
I think company startups are changing.
I want to remind you guys of one quick thing as a tangent.
I had this meeting with Andrej Karpathy.
I talked about this on the pod, where I said I challenged him.
I said, "Listen, the real goal should be to go and disrupt existing businesses using these tools, cutting out all the sales and marketing, right?
And just delivering something."
And I used the example of Stripe, disrupting Stripe by going to market with an equivalent product with 1/10 of employees at 1/10 the cost.
What's incredible is that this AutoGPT is the answer to that exact problem. Why?
Because now, if you are a young, industrious entrepreneur, if you look at any bloated organization that's building enterprise class software, you can string together a bunch of agents that will auto construct everything you need to build a much, much cheaper product that then you can deploy for other agents to consume.
So, you don't even need a sales team anymore.
This is what I mean by this crazy recursion that's possible. Yeah.
So, I'm really curious to see how this actually affects like all of this all of these you know, single product companies.
I mean, it's a continuation Chamath of And then the last thing I just want to say is related to my tweet.
I think this is exactly the moment where we now have to have a real conversation about regulation.
And I think it has to happen otherwise it's going to be a [ __ ] show.
Let's put a pin in that for a second, but I want to get Sachs's response to some of this.
So, Sachs, we saw this before.
It used to take two or three million dollars to commercialize a web-based software product app.
Then it went down to 500k, then 250.
I don't know if you saw this story, but if you remember the hit game on your iPhone Flappy Birds, Flappy Birds uh you know, was a phenomenon at you know, hundreds of millions of people played this game over some period of time.
Somebody made it by talking to Chat GPT-4 and Midjourney in an hour.
So, the perfect example and listen, it's a game, so it's something silly.
But I was talking to two developers this weekend and one of them was an okay developer and the other one was an actual 10x developer who's built you know, very significant companies and they were coding together last week and because of how fast Chat GPT and other services were writing code for them, he looked over at her and said, "You know, you're basically a 10x developer now. My superpower is gone."
So, where does this lead you to believe company formation is going to go?
Is this going to be you know, massively deflationary?
Companies like Stripe are going to have a hundred competitors in a very short period of time or are we just going to go down the long tail of ideas and solve everything with software?
How How going to play out in the in the startup space, David Sacks?
Well, I think it's true that developers, and especially junior developers, get a lot more leverage on their time.
And so, it is going to be easier for small teams to get to an MVP, which is something they always should have done anyway with their seed round.
You shouldn't have needed, you know, 50 developers to build your V1.
It should be, you know, just the founders, really.
So, that that I think is already happening, and that trend will continue.
I think we're still a ways away from startups being able to replace entire teams of people.
I just, you know, I think right now we're at the phase of this. To find a ways. Months, years, decade?
Well, it's in the years, I think, for sure.
We don't know how many years.
And the reason I say that is it's just very hard to replace, you know, 100% of what any of these particular job functions do.
100% of what a sales rep does, 100% of what a marketing rep does, or even what a coder does.
So, right now, I think we're still at the phase of this where it's a tool that gives a human leverage.
And I think we're still a ways away from the, you know, human being completely out of the loop.
I think right now, I see it mostly as a a force for good.
As opposed to something that's creating a a ton of dislocation.
Friedberg, your thoughts?
If we follow the trend line, you know, to make that video game that you shared took probably a few hundred human years, then a few dozen human years, then, you know, with other toolkits coming out, maybe a few human months, and now this person did it in one human day using this tooling.
So, if you think about the implication for that, I mentioned this probably last year, I really do believe that at some point the whole concept of publishers and publishing maybe goes away.
Where, you know, much like we saw so much of the content on the internet today being user generated, you know, most of the content is made by individuals, posted on YouTube or Twitter.
That's most of what we consume nowadays, or Instagram or TikTok in terms of video content.
We could see the same in terms of software itself, where you no longer need a software startup or a software company uh to render or generate a set of tools for a particular user, but that the user may be able to define to their agent their AI agent the set of tools that they would individually like to use or to create for them to do something interesting.
And so, the idea of buying or subscribing to software um or even buying or subscribing to a video game or to a movie or to some other form of content starts to diminish as the leverage goes up with these tools, the accessibility goes up.
You no longer need a computer engineering degree or computer science degree to be able to harness them or use them.
And individuals may be able to speak in simple and plain English that they would like a book or a movie that does that looks and feels like the following or a video game that feels like the following.
And so, when I open up my iPhone, maybe it's not a screen with dozens of video games, but it's one interface.
And the interface says, "What do you feel like playing today?"
And then I can very clearly and succinctly state what I feel like playing, and it can render that game and render the code, render the engine, render the graphics, and everything on the fly for me, and I can use that.
And so, you know, I kind of think about this as being a bit of a leveling up.
That the idea that all technology again starts central and moves to kind of the edge of the network over time, that may be what's going on with computer programming itself now, where the toolkit to actually use computers to generate stuff for us is no longer a toolkit that's harnessed and controlled and utilized by a set of centralized publishers, but it becomes distributed and used at the edge of the network by users like anyone.
And then, the edge of the network technology can render the software for you.
And it really creates a profound change in the the entire business landscape of software and the internet.
And I think it's you know it it's it's really like we're just starting to kind of see have our heads unravel around this notion and we're sort of trying to link it to the old paradigm which is all startups are going to get cheaper and smaller teams but it may be that you don't even need startups for a lot of stuff anymore.
You don't even need teams and you don't even need companies to generate and render software to do stuff for you anymore.
Chamath, when we look at this it it's kind of a pattern of augmentation as we've been talking about here.
We're augmenting human intelligence and replacing this replication or this automation I guess might be a nice way to say it.
So there's augmentation then automation and then perhaps deprecation.
Where where do you sit on this?
It seems like Sachs feels it's going to take years and Freeberg thinks hey maybe startups and content are over.
What do you sit on this augmentation automation deprecation journey we're on?
I think that humans have judgement and I think it's going to take decades for agents to replace good judgement and I think that's where we have some defensible ground and I'm going to say something controversial.
I don't think developers anymore have good judgement.
Developers get to the answer or they don't get to the answer and that's what agents have done because the the 10x engineer had better judgement than the 1x engineer.
But by making everybody a 10x engineer you're taking judgement away.
You're taking code paths that are now obvious and making it available to everybody.
It's effectively like what you did in chess.
An AI created a solver so everybody understood the most efficient path in every single spot to do the eat most EV positive thing.
The most expected value positive thing.
Coding is very similar that way.
You can reduce it and view it very very reductively.
So there is no differentiation in code and so I think Freeburg is right.
So, for example, let's say you're going to start a company today.
Why do you even care what database you use?
Why do you even care which cloud you're built on?
To Freeburg's point, why do any of these things matter? They don't matter.
They were decisions that used to matter when people had a job to do, and you paid them for their judgment.
Oh, well, we think GCP is better for this specific workload, and we think that this database architecture is better for that specific workload, and we're going to run this on AWS, but that on Azure.
And do you think an agent cares?
If you tell an agent, "Find me the cheapest way to execute this thing, and if it ever gets not, you know, cheaper to go someplace else, do that for me as well, and, you know, ETL all the data and put it in the other thing, and I don't really care."
So, you're saying it will it will swap out Stripe for Adyen, or It doesn't Node for Amazon Web Services.
It's going to be ruthless.
It's going to be ruthless, and I think that the point of that That and that's the exact perfect word, Jason.
AI is ruthless because it's emotionless.
It was not taken to a steak dinner.
It was not brought to a basketball game.
It was not sold into a CEO.
It's an agent that looked at a bunch of API endpoints, figured out how to write code to it to get done the job at hand that was tasked to it within a budget, right?
The other thing that's important is these agents execute within budgets.
So, another good example was and this is a much simpler one, but a guy said, "I would like 7 days worth of meals.
Here are my constraints from a dietary perspective.
Here are also my budgetary constraints."
And then what this agent did was figured out how to go and use the Instacart plugin at the time, and then these other things, and execute within the budget.
How How that different when you're a person that raises $500,000 and says, "I need a full stack solution that does X, Y, and Z for $200,000?"
It's the exact same problem.
So, I think it's just a matter of time until we start to cannibalize these extremely expensive, ossified, large organizations that have relied on a very complicated go-to-market and sales and marketing motion.
I don't think you need it anymore in a world of of agents and I and Auto GPTs.
And I think that to me is quite interesting because A, it creates an obvious set of public company shorts.
And then B, you actually want to arm the rebels.
And arming the rebels, to use the Toby Lutke analogy here, would mean to seed hundreds of one-person teams. Hundreds.
And just say, "Go and build this entire stack all over again using a bunch of agents."
Yeah, I think recursively you'll get to that answer in in less than a year.
Interestingly, when you talk about the emotion of making these decisions, if you look at Hollywood, I just interviewed on my other podcast the founder of You have another podcast? I do.
It's called This Week in Startups. Thank you.
700 episodes, you've been on it four times. It's my favorite show.
don't give him an excuse to plug it.
Listen, I'm not going to plug This Week in Startups available on Spotify and iTunes and youtube. com/thisweekin.
Runway is the name of this company I interviewed.
And what's fascinating about this is he told me on Everything, Everywhere, All at Once, the award-winning film, they had seven visual effects people on it, and they were using his software.
The late-night shows like Colbert and stuff like that are using it.
They are ruthless in terms of creating crazy visual effects now without and you can do text prompt to get video output.
And it is quite reasonable what's coming out of it, but you can also train it on existing data sets.
So, they're going to be able to take something, Sachs, like The Simpsons or South Park or Star Wars or Marvel.
Take the entire corpus of the comic books and the movies and the TV shows and then have people type in have Iron Man do this, have Luke Skywalker do that and it's going to output stuff.
And I said, "Hey, when would this reach the the level that the Mandalorian TV show is?"
And he said, "Within 2 years."
Now, he's talking his own book, but it's quite possible that that all these visual effects people from Industrial Light & Magic on down are going to be replaced with director Sacks who are currently using this technology to do What do they call the images like that go with the script? Storyboards. Storyboards, thank you.
They're doing storyboards in this right now.
The difference between the storyboards Sacks and the output is closing in the next 30 months, I would say. Right.
I mean, maybe you could speak to a little bit about the pace here because that is the perfect ruthless example of ruthless AI.
I mean, you could have the entire team at Industrial Light & Magic or Pixar be unnecessary this decade.
Well, I mean, you see a bunch of the pieces already there.
So, you have stable diffusion.
You have the ability to type in the image that you want and it spits out, you know, a version of it or 10 different versions of it and you can pick which one you want to go with.
You have the ability to create characters.
You have the ability to create voices.
You have the ability to replicate a celebrity voice.
The only thing that's not there yet as far as I know is the ability to take static images and string them together into a motion picture.
But, that seems like it's coming really soon.
So, yeah, in theory, you should be able to train the model where you just give it a screenplay and it outputs essentially an animated movie.
And then you should be able to fine-tune it by choosing the voices that you want and the characters that you want and, you know, and that kind of stuff.
So, yeah, I think we're close to it.
Now, I think that the question though is, you know, every nine, let's call it a reliability is a big advancement.
So, yeah, it might be easy to get to 90% within two years, but it might take another two years to go from 90 to 99% and then it might take another two years to get to 99. 9 and so on.
And so, to actually get to the point where you're at this stage where you can release a theatrical quality movie, I'm sure it will take a lot longer than two years.
Well, but look at this, Sax.
I'm just going to show you one image.
This is The input was aerial drone footage of a mountain range and this is what it came up with.
Now, if you were watching TV in the '80s or '90s on a non-HDTV, this would look indistinguishable from anything you've seen.
And so, this is at a pace that's kind of crazy.
There's also opportunity here, right, Friedberg?
I mean if we were to look at something like The Simpsons, which has gone on for 30 years, if young people watching The Simpsons could create their own scenarios or with AutoGPT, imagine you told The Simpsons stable diffusion instance, read what's happening in the news, have Bart Simpson respond to it, have the South Park characters parody whatever happened in the news today.
You could have automated real-time episodes of South Park just being published onto some website.
Before you move on, did you see the the Wonder Studio demo? We can pull this one up. It's really cool. Yeah, please.
This is a startup that's using this type of technology and the way it works is you film a live-action scene with a regular actor, but then you can just drag and drop an animated character onto it Mhm.
and it then converts that scene into a movie with that character.
Like Planet of the Apes or Lord of the Rings, right? Yeah, exactly.
Sudeikis, was he the person who kept winning all the Oscars?
So, there it goes after the robot has replaced the human. Wow.
You can imagine like every piece of this just eventually gets swapped out with AI, right?
You like you should be able to tell the AI give me a picture of a human leaving a building.
Like a Victorian-era building in New York.
And certainly it can give you a static image of that.
So it's not that far to then give you a video of that, right?
And so I yeah, I think we're we're pretty close for let's call it hobbyists or amateurs to be able to create pretty nice-looking movies using these types of tools.
But again, I think there's a a jump to get to the point where you're just altogether replacing One of the things I'll say on this is we still keep trying to relate it back to the way media narrative has been explored and written by humans in the past.
Very kind of linear storytelling, you know, it's a 2-hour movie, 30-minute TV segment, 8-minute YouTube clip, 30-second Instagram clip, whatever.
But one of the enabling capabilities with this um set of tools is that the stories the way that they're rendered and the way that they're explored by individuals can be fairly dynamic.
You could watch a movie with the same story all four of us could watch a movie with the same story but from totally different vantage points.
And some of us could watch it in an 18-minute version or a 2-hour version or a, you know, three-season episode episodic version where the the the way that this opens up the potential for creators.
And also So now I'm kind of saying before I was saying, "Hey, individuals can make their own movies and videos.
That's going to be incredible."
There's a separate, I think, creative output here which is the leveling up that happens with creators that maybe wasn't possible to them before.
So perhaps a creator writes a short book, a short story.
And then that short story gets rendered into a system that can allow each one of us to explore it and enjoy it in different ways.
And I as the creator can define those different vantage points.
I as the creator can say, here's a little bit of this personality, this character trait.
And so what I can now do as a creator is stuff that I never imagined I could do before.
Think about old school photographers doing black and white photography with pinhole cameras.
And then they come across Adobe Photoshop.
What they can do with Adobe Photoshop was stuff that they could never con- conceptualize of in those old days.
I think what's going to happen for creators going forward, and this is going back to that point that we had last week or two weeks ago about the guy that was like, "Hey, I'm out of a job."
I actually think that the opportunity for creating new stuff in new ways is so profoundly expanding that individuals can now write entire universes that can then be enjoyed by millions of people from completely different lengths and viewpoints and and models.
They can be interactive, they can be static, they can be dynamic.
And that the tooling that you Personalized.
But the tooling that you as a creator now have, you could choose which characters you want to define, you could choose which content you want to write, you could choose which content you want the AI to fill in for you.
And say, "Hey, create 50 other characters in the village."
And then when the viewer reads the book or watches the movie, let them explore or have a different interaction with a set of of those villagers in that village.
Or you could say, "Hey, here's the one character everyone has to meet.
Here's what I want them to say."
And you can define the dialogue.
And so the way the creators can start to kind of harness their creative chops and create new kinds of modalities for content and for exploration.
I think it's going to be so beautiful and incredible. I mean, Freiberg.
Yeah, you can choose the limits of how much you want the individual to enjoy from your content versus how narrowly you want to define it.
And my guess is that the creators that are going to win are going to be the ones that are going to create more dynamic range in the creative output.
And then individuals are going to kind of be be stuck They're going to be more into than they will with the static everyone watches the same thing over and over.
So, there will be a whole new world of creators that, you know, maybe have a different set of tools than than Just Just than we've realized in the last build on what you're saying for Burbs, I think it's incredibly insightful.
Just think about the controversy around two aspects of a franchise like James Bond.
Number one, who's your favorite Bond?
We grew up with Roger Moore, we lean towards that, then we discover Sean Connery, then all of a sudden you see, you know, the latest one, he's just extraordinary.
And and in Daniel Craig, you're like, you know what, that's the one that I love most.
But what if you could take any of the films?
You could say, let me get, you know, give me the Spy Who Loved Me, but put Daniel Craig in it, etc.
And that would be available to you.
And then think about the next controversy, which is, oh my god, does Daniel Does James Bond need to be a white guy from the UK? Of course not.
You can release it around the world, and each region could get their own celebrity, their number one celebrity, to play the lead, and controversy over.
You know the old story, the Epic of Gilgamesh, right?
So, like that story was retold in dozens of different languages, and it was told through the oral tradition.
It was like, you know, spoken by bards around a fire pit and whatnot.
And all of those stories were told with different characters and different names and different experiences.
Some of them were 10 minutes long, some of them were multi-hour sagas explained through the story.
But ultimately, the morality of the story, the storyline, the intentionality of the original creator of that story Yes. came through.
The The Bible is another good example of this, where much of the underlying morality and ethics in the Bible comes through in different stories read by different people in different languages.
And I think that that may be where we go.
Like, my kids want to have a 10-minute bedtime story?
Well, let me give them Peter Pan in 10 minutes.
I want to do, you know, a a chapter a night for my older daughter for a week long of Peter Pan? Now, I can do that.
And so, the the way that I can kind of consume content becomes different.
So, I guess what I'm saying is there's two aspects to the way that I think the entire content the the the the realm of content can be rewritten through AI.
The first is like individual personalized creation of content where I as a user can render content that of my liking and my interest.
The second is that I can engage with content that is being created that is so much more multi-dimensional than anything we conceive of today where current centralized content creators now have a whole set of tools.
Now from a business model perspective, I don't think that plat publishers are really the play anymore, but I do think that platforms are going to be the play.
And the platform tooling that enables the individuals to do this stuff and the platform tooling that enables the content creators to do this stuff are definitely entirely new industries and models that can create multi-hundred billion-dollar outcomes.
Let me hand this off to Sachs because there has been the dream for everybody, especially in the Bay Area, of a hero coming and saving Gotham City.
And this has finally been realized.
David Sachs, I did my own little Twitter AI hashtag and I said to Twitter AI, "If only, please generate a picture of David Sachs as Batman crouched down on the peak of the Golden Gate Bridge."
The amount of creativity, Sachs, that came from this and this is something that, you know, if we were talking about just 5 years ago, this would be like a $10,000 image you could create through a birthday card.
not these were not professional, quote-unquote, artists.
These were individuals individuals that were able to harness a set of platform tools to generate this incredible new content.
And I think it speaks to the opportunity ahead.
And by the way, we're in inning one, right?
So Sachs, do you see yourself as Batman?
Do you ever think you should take your enormous wealth and resources and put it towards building a cave under your mansion that lets you out underneath the Golden Gate Bridge and you could go fight crime? So good. So good.
Sachs, do you want to go fight this crime in Gotham?
I think San Francisco has a lot of Gotham-like qualities.
I think the villains are more real than the heroes.
Unfortunately, we don't have a lot of heroes, but Yeah, we got a lot of Jokers.
Yeah, we got a lot of Jokers. Yeah.
That's a whole separate topic. I'm sure we'll get to.
separate topic, we'll get to it at some point today.
You guys are talking about all this stupid [ __ ] like there are trillions of dollars of software companies that could get disrupted and you're talking about making [ __ ] children's books and fat pictures of socks. It's so dumb.
No, it's a conversation entered the entertainment industry and a [ __ ] job.
No, it nobody cares about entertainment anymore because it's totally useless.
Okay, so why don't you talk about where are the money is?
Why don't you teach people where there's going to be actual economic destruction and there's going to be amazing economic destruction and opportunity.
You You spend all this time on the most stupidest [ __ ] topics.
Listen, it's an illustrative example.
No, it's an elitist example that you [ __ ] circle jerk yourself around.
It's Batman's not populist. Come on.
Nobody Nobody cares about movies. Nobody cares.
of Chamath's tweet over everybody about how he's got a point.
I mean, I think I think US box office is somewhere like 20 billion a year.
I remember when like PayPal got to like 100 billion a year payment volume and now it's like hundreds of billions.
So Stripe are going to process two trillion dollars almost.
Why don't you talk about that disruption you ninny?
Market size of US media and entertainment industry 717 billion.
Okay, it's it's not insignificant.
Video games are nearly half a trillion a year.
Yeah, I mean, this is not insignificant.
But, let's pull up Chamath's tweet.
Of course, the dictator wants to dictate here.
All this incredible innovation is being made and a new hero has been born, Chamath Palihapitiya.
A tweet that went viral over 1. 2 million views already.
I'll read your tweet for the audience.
If you invent a novel drug, you need the government to vet and approve it, FDA, before you can commercialize it.
If you invent a new mode of air travel, you need the government to vet and approve it, FAA.
I'm just going to edit this down a little bit.
If you create new security, you need the government to vet and approve it, SEC.
More generally, when you create things with broad societal impact, positive and negative, the government creates a layer to review and approve it.
AI will need such an oversight body.
The FDA approval process seems the most credible and adaptable into a framework to understand how a model behaves and it's counterfactual.
Our political leaders need to get in front of this sooner rather than later and create some oversight before the eventual big avoidable mistakes happen and genies are let out of the bottle.
Chamath, you really want the government to come in and then when people build these tools, they have to submit them to the government to approve them.
That's what you're saying here and you want that to start now. Here's the alternative.
The alternative is going to be the debacle that we know as Section 230.
So, if you try to write a brittle piece of legislation or try to use old legislation to deal with something new, it's not going to do a good job because technology advances way too quickly.
And so, if you look at the Section 230 example, where have we left ourselves?
The politicians have a complete inability to pass a new framework to deal with social media, to deal with misinformation.
And so now, we're all kind of guessing what a bunch of eight, 70, and 80-year-old Supreme Court justices will do in trying to rewrite technology law when they have to opine on Section 230.
So, the point of that tweet was to lay the alternatives.
There is no world in which this will be unregulated.
And so, I think the question to ask ourselves is do we want a chance for a new body So, the FDA is a perfect example why.
Even though the FDA commissioner is appointed by the president, this is a quasi organization, it's still arms length away.
It has subject matter experts that they hire and they have many pathways to approval.
Some pathways take days, some pathways are months and years, some pathways are for breakthrough innovation, some pathways are for devices.
So, they they have a broad spectrum of ways of of arbitraging what can be commercialized and what cannot.
Otherwise, my prediction is we will have a very brittle law that will not work.
It'll be like the Commerce Department and the FTC trying to gerrymander some old piece of legislation.
And then what will happen is it'll get escalated to the Supreme Court, and I think they are the last group of people who should be deciding on this incredibly important topic for society.
So, what I have been advocating our leaders, and I will continue to do so, is don't try to ram this into an existing body.
It is so important, it is worth creating a new organization like the FDA and having a framework that allows you to look at a model and look at the counterfactual, judge how good, how important, how disruptive it is, and then release it in the wild appropriately.
Otherwise, I think you'll have these chaos GPT things scale infinitely.
Because, again, as Freeburg said and as Sax said, you're talking about one person that can create this chaos.
Multiply that by every person that is an anarchist or every person that just wants to sow seeds of chaos, and I think it's going to be all avoidable.
I think regulating what software people can write is a near impossible task.
Number one, I think you can probably put rules and restrictions around commerce, right?
That that's certainly feasible uh in terms of how people can monetize, but in terms of writing and utilizing software, uh it's going to be as challenged as trying to monitor and demand oversight and regulation around how people write and use tools for uh for genome and biology uh exploration.
Certainly, if you want to take a product to market and sell a drug to people that can influence their body, you have to go get that approved, but in terms of, you know, doing your work in a lab, it's very difficult.
I think the other challenge here is software can be written anywhere.
It can be executed anywhere.
And so, if the US does try to regulate or does try to put the brakes on the development of tools where the US can have kind of a a great economic benefit and a great economic interest, there will be advances made elsewhere without a doubt.
And those markets and those those places will benefit in an in an extraordinarily out out paced way.
As we just mentioned, there's such extraordinary kind of economic gain to be realized here that if we're not if the United States is not leading the world, we are going to be following and we are going to get disrupted.
We are going to lose an incredible amount of value and talent.
And so, any attempt at regulation or slowing down or telling people that they cannot do things when they can easily hop on a plane and go do it elsewhere, I think it's is fraught with peril.
So, you don't agree with regulation, Sachs?
Are you on board with the Chamath plan or you on board with the Free Bird plan?
Well, I'll I'll say I think I think just like with computer hacking, it's illegal to break into someone else's computer.
It is illegal to steal someone's personal information.
There are laws that are absolutely simple and obvious and you know, no nonsense laws.
Those laws need to be implemented rid of 100,000 jobs by making a piece of software, though. That's right.
And so, I think trying to intentionalize how we do things versus intentionalizing um the things that we want to prohibit happening as an outcome, we can certainly try and prohibit the things that we want to happen up as an outcome and pass laws and and institute governing bodies with authority to oversee those laws with respect to things like stealing data.
But, you can jump on a plane and go do it in Mexico, Canada, or whatever region you get to.
Sachs, where do you stand on this debate?
I'm Yeah, I'm saying like there there ways to protect people.
There's ways to protect society about passing laws that that make it illegal to do things as the output of the outcome.
What law do you pass on Chaos GPT? Explain Chaos GPT.
Give me an example, please. Yeah.
Do you want to talk about it real quick?
It's a recursive agent that basically is trying to destroy itself.
Trying to destroy humanity.
Yeah, but I guess by first becoming all powerful and destroying humanity and then destroying itself.
Yeah, it's a tongue-in-cheek Auto GPT.
But it's it's not it's not it's not a tongue-in-cheek Auto GPT.
guy the guy that created it, you know, put it out there and said like he's trying to show everyone to your point what intentionality could arise here, which is negative intentionality.
I think it's very naive for anybody to think that this is not equivalent to something that could cause harm to you.
So, for example, if the prompt is, "Hey, here is a security leak that we figured out in Windows.
And so, why don't you exploit it?"
So, look, a hacker now has to be very technical.
Today, with with these Auto GPTs, a hacker does not need to be technical at all.
Exploit the zero day exploit in Windows.
Hack into this plane and bring it down. Oh, okay. The GPT will do it.
So, who's going to tell you that those things are not allowed?
Who's going to actually vet that that wasn't allowed to be released in the wild?
So, for example, if you work with Amazon and Google and Microsoft and said, "You're going to have to run these things in a sandbox and we're going to have to observe the output before we allow it to run on actual bare metal in the wild."
Again, that seems like a reasonable thing.
And it's super naive for people to think it's a free market, so we should just be able to do what we want.
This will end badly quickly.
And when the first plane goes down and when the first [ __ ] thing gets blown up, all of you guys will be like, "Oh, sorry."
Sacks, pretty compelling example here by Chamath.
Somebody puts out into the wild Chaos GPT.
You can go do a Google search for it and says, "Hey, what are the vulnerabilities to the electrical grid?"
Compile those and automate a series of attacks and write some code to probe those until we and success in this mission you get 100 points and stars every time you do this.
It's such a It's such a beautiful example, but it's even more nefarious. It is.
Hey, this is an enemy that's trying to hack our system, so you need to hack theirs and bring it down.
You know, like you can easily trick these GPTs. Right? They have no judgment.
And as you said, they're ruthless in in getting to the outcome. Right.
So, why why do we think all of a sudden this is not going to happen?
I mean, it's literally the science fiction example.
You say, "Hey, listen, make sure no humans get cancer."
And they're like, "Okay, well, the logical way to make sure no humans get cancer is to kill all the humans."
But Chamath, can you just address the point?
So, what do you think you're regulating?
Are you regulating the code that people are allowed to write? you look at the FDA, no.
You're allowed to make any chemical drug you want, but if you want to commercialize it, you need to run a series of trials with highly qualified measurable data, and you submit it to like-minded experts that are trained as you are to evaluate the viability of that. And there are Hold on.
There are pathways that allow you to get that done in days under emergency use.
And then there are pathways that can take years depending on how gargantuan the task is at hand.
And all I'm suggesting is having some amount of oversight is not bad in this specific example.
I get what you're saying, but I'm asking tactically, how What are you overseeing?
You're overseeing chat GPT?
You're overseeing the the models and the Nvidia chips?
Okay, look, I used to run the Facebook platform.
We used to create sandboxes.
If you submit code to us, you would we would run it in a sandbox, we would observe it, we would figure out what it was trying to do, and we would tell you this is allowed to run in the wild.
There's a version of that that Apple does.
When you submit an app for review and approval, Google does it as well.
In this case, all the bare metal providers, all the people that provide GPUs will be forced by the government in my opinion to implement something.
And all I'm suggesting is that it should be a new kind of body that essentially observes, that has PhDs, that has people who are trained in this stuff to develop the kind of testing and the output that you need to figure out whether it should even be allowed to run in the wild on bare metal.
Sorry, but you're saying that the mod the model Sorry, I'm just trying to understand Chamath's points.
You're saying that the models need to be reviewed by this body and those models, if they're run on a third-party set of servers If they're running in the wild. Right.
So, if they're run on your computer on the on the open internet You cannot run an app on your computer, you know that, right?
It needs to be connected to the internet, right?
Like if you wanted to run an auto GPT, it actually crawls the internet, it actually touches other APIs, it tries to then basically send a push request, sees what it gets back, parses the JSON, figures out what it needs to do.
All of that is allowed because it's hosted by somebody, right?
That code is running not locally But I can run it locally.
So, the host becomes Sure, if you want to run it locally, you can do whatever you want to do.
But evil agents are going to do that, right?
So, if I'm an evil agent, I'm not going to go use AWS to run my evil agent.
I'm going to set up a bunch of servers and connect it to the internet. How? I could use VPNs.
I mean the internet is open.
There's open packets of data that fly around.
in another rogue country, they can do whatever they want.
I think that what you're going to see is that if you, for example, try to VPN and run it out of like Tajikistan back to the United States, it's not going to take years for us to figure out that we need to IP block rando [ __ ] coming in push and pull requests from all kinds of IPs that we don't trust anymore because we don't now trust the regulatory oversight that they have for code that's running from those IPs that are not US domesticated IPs.
uh let me steal man Chamath's position for a second. Jason, hold on.
I I think the ultimate if if what Chamath is saying is the point of view of Congress.
And if if Chamath has this point of view, then there will certainly be people in Congress that will adopt this point of view.
The only way to ultimately do that degree of regulation and restriction is going to be to restrict the open internet.
It is going to be to have monitoring and firewalls and safety protocols across the open internet.
Because you can have a set of models running on any set of servers sitting in any physical location, and as long as they can move data packets around, they're going to be able to get up to their nefarious activities.
Let me steelman that for you, Freeberg.
I think yes, you're correct.
The the internet has existed in a very open way, but there are organizations and there are places like the National Highway Traffic Safety Administration.
If I were to steelman Chamath's position, if you want to manufacture a car and you want to make one in your backyard and put it on your track and on your land up in Napa somewhere, and you don't want to have brakes on the car, and you don't want to have you know, a speed limiter or airbags or seat belts, and you want to drive on the hood of the car, you can do that.
But once you want it to go on the open road, the open internet, you need to get you need to submit it for some safety standards like has to.
So, Sachs, where do you sit on this?
Are is Let's assume that people are going to do very bad things with very powerful models that are becoming available.
Amazon today said they'll be Switzerland, they're going to put a bunch of LLMs and other models available on AWS.
Bloomberg's LLM, Facebook's, Google Bard, and of course ChatGPT, OpenAI, and Bing.
All this stuff's available.
To have access to that, do you need to have some regulation of who has access to those at-scale powerful tools?
Should there be some FDA or NHTSA?
I don't think we know how to regulate it yet. I think it's too early.
And I think the harms that we're speculating about, we're making the AI more powerful than it is, and I believe it will be that powerful, but I think that it's premature to be talking about regulating something that doesn't really exist yet.
Take the the chaos GPT scenario.
The way that would play out would be you've got some future incarnation of Auto GPT and somebody says, "Okay, Auto GPT, I want you to be, you know, WMD AI and figure out how to cause like a mass destruction event, you know?"
And then it creates like a planning checklist and that kind of stuff.
So, that's the basically the the type of scenario we're we're talking about.
Um we're not anywhere close to that yet.
I mean, the Chaos GPT is kind of a joke.
It doesn't produce It doesn't produce a checklist of anything.
that would actually be completely plausible.
One of the first things on the Chaos GPT's checklist was to stay within the boundaries of the law cuz it didn't want to get prosecuted. Got it.
So, the person who did that had some sort of good intent, but I can give you an example right now that could be done by ChatGPT and Auto GPT that could take down large swaths of society and cause massive destruction.
I'm almost reticent to say it here. Say it.
Well, I'll say it and then maybe we'll have to delete this, but if somebody created this and they said, "Figure out a way to compromise as many powerful people's and as many systems passwords, then go in there and delete all their files, and turn off as many systems as you can."
ChatGPT and Auto GPT could very easily create phishing accounts, create billions of websites to create billions of logins, have people log into them, get their passwords, log into whatever they do, and then delete everything in their accounts, which would cause chaos.
And it could be done today.
I don't think it could be done today. Simpler than this.
How about How about you fish them and just create a fishing website?
Yeah, pieces of it can be created today, but you're you're accelerating the progress.
Yeah, but you can automate spear fishing now to get it done in 30 days. Yeah, exactly.
I think I'm accelerating it in weeks.
Why don't you just spoof the bank accounts and just steal the money?
Like that's even simpler.
Like people will do this stuff cuz they're trying to do it today. Holy cow.
Now they just have a more efficient way to solve the problem. So, look. Jeez.
So number one, this is a tool.
And if people use a tool in nefarious ways, you prosecute them.
Number two, the platforms that are commercializing these tools do have trust and safety teams.
Now, in the past, trust and safety has been a euphemism for censorship, which it shouldn't be.
But, you know, Open AI has a safety team and they try to detect when people are using their tech in a nefarious way and they try to prevent it. Do you trust that team?
Well, not not on censorship, but I think that they're probably people are using ChatGPT.
Do you think they're policing it?
Are you willing to abdicate your or societal responsibility to to Open AI to do the trust and safety?
Well, what I'm what I'm saying is I'd like to see how far we get in terms of the system Yes, you're saying you want to see the mistakes.
You want to see where the mistakes are and how bad the mistakes are.
I'm saying it's still very early to be imposing regulation.
We don't even know what to regulate.
So, I think we have to keep tracking this to develop some understanding of how it might be misused, how the industry is going to develop safety guardrails. Okay?
And then you can talk about regulation.
Look, you create some new FDA right now, okay?
First of all, we know what would happen.
Look at the drug process.
As soon as the FDA got involved, it slowed down massively.
Now it takes years, many years to get a drug approved. Appropriately so.
Yes, but at least with a drug, we know what the gold standard is.
You run a double-blind study to see whether it causes harm or whether it's beneficial.
We don't know what that standard is for AI yet. We have no idea.
You can absolutely do a double-blind study in AI. What?
No, we don't know what the somebody review the code.
You have two instances in a sandbox. the code to do what?
No, Sachs, Listen, no, no, no, listen to my point. Auto GPT, it's benign.
I mean, my friend used it to book a wine tasting.
So, who's going to review that code and then speculate and say, "Oh, well, in 99.
9% of cases, it's perfectly benevolent and fine and innocuous, but I can fantasize about some cases someone might do." How Hold on.
How are you supposed to resolve that? Very simple.
There are two types of regulation that occur in any industry.
You can do what the movie industry did, which is they self-regulate and they came up with their own rating system, or you can do what happens with the FDA and what happens with cars, which is an external government-based body.
I think now is the time for self-regulation so that we avoid the massive heavy hand of government having to come in here.
But, these tools can be used today to create massive harm.
They're moving at a pace we just said in the first half of the show that none of us have ever seen.
Every 48 hours something drops that is mind-blowing.
That's never happened before, and you can take these tools and in the one example that Chamath and I came up with at the top of our head in 30 seconds, you could create phishing sites, compromise people's bank accounts, take all the money out, delete all the files, and cause chaos on a scale that has never been possible by a series of Russian hackers or Chinese hackers working in a boiler room.
This can scale, and that is the the fundamental difference here.
And I didn't think I would be sitting here steel-manning Chamath's argument.
humans have a horrible ability to compound.
I think people do not understand compound interest, and this is a perfect example where when you start to compound technology at the rate of 24 hours or 48 hours, which we've never really had to acknowledge, most people's brains break and they don't understand what 6 months from now looks like.
And 6 months from now, when you're compounding at 48 or 72 hours, is like 10 to 12 years in other technology solutions. This is compounding.
This is This is different because of the compounding. I agree with that.
The pace of evolution is very fast.
We are on a bullet train to something, and we don't know exactly what it is, and that's disconcerting.
However, let me tell you what would happen if we create a new regulatory body like the FDA to regulate this.
They would have no idea how to arbitrate whether a technology should be approved or not.
Development will basically slow to a crawl just like drug development.
There is no double-blind standard I agree.
What self-regulation can we do?
What self-regulation can we do?
There is no double-blind standard in AI that everyone can agree on right now to know whether something should be approved.
And what's going to happen is the thing that's made software development so magical and allowed all this innovation over the last 25 years is permissionless innovation.
Any developer any dropout from a university can go create their own project which turns into a company and that is what has driven all the innovation and progress in our economy over the last 25 years.
So, you're going to replace permissionless innovation with going to Washington to go through some approval process.
And it will be the politically connected, it'll be the big donors who get their projects approved, and the next Mark Zuckerberg who's trying to do his little project in a dorm room somewhere will not know how to do that, will not know how to compete, and that highly political process.
Chamath, I think you're mixing a bunch of things together.
So, first of all, permissionless innovation happens today in biotech as well.
It's just that it's what Jason said.
When you want to put it on the rails of society and make it available to everybody, you you actually have to go and do something substantive.
In the negotiation of these drug approvals, it's not some standardized thing.
You actually sit with the FDA and you have to decide what are our endpoints, what is the mechanism of action, and how will we measure the efficacy of this thing?
The idea that you can't do this today in AI is laughable. Yes, you can.
And I think that smart people, so for example, if you pit DeepMind's team versus OpenAI's team to both agree that a model is good and correct, I bet you they would find a systematic way to test that it's fine.
I just want to point that out.
Okay, so basically, in order to do what you're saying, okay, this entrepreneur who just dropped out of college to do their project, they're going to have to learn how to go sit with regulators, have a conversation with them, go through some complicated approval process, and you're trying to say that that won't turn into a game of political connections. Of course it will. Of course it will.
of course it will, but there is a step between it, which is self-regulation.
Yeah, well, let's get to that. Hold on a second.
And let's look at the drug approval process.
If you want to create a drug company, you need to raise hundreds of millions of dollars.
It's incredibly expensive.
It's incredibly capital intensive.
There is no drug company that is two guys in their garage, like many of the biggest companies, like many of the biggest companies in Silicon Valley, started.
That is because you're talking about taking a chemical or biological compound and then injecting into some hundreds or thousands of people who are both racially, gender-based, age-based, highly stratified all around the world or at a minimum all around the country.
You're not talking about that here, David.
here, David. I think that you could have a much simpler and cheaper way where you have a version of the internet that's running in a huge sandbox someplace that's closed off from the rest of the internet, and another version of the
internet that's closed off from everything else as well, and you can run on a parallel path as it is with this agent, and you can easily, in my opinion, actually, figure out whether this agent is good or bad, and you can probably do it in weeks. So, I actually think the approvals are
So, I actually think the approvals are actually not that complicated.
And the reason to do it here is because I get that it may cause a little bit more friction for some of these mom-and-pops, but if you think about what's the societal and consequences of letting the worst-case outcomes happen, the AGI type outcomes happen, I think those are so bad, they're worth slowing some folks down.
And I think like just because you want to, you know, buy groceries for $100, you should be able to do it. I get it.
But if people don't realize and connect the dots between that and bringing airplanes down, then that's because they don't understand what this is capable of.
I'm not saying we're never going to need regulation.
What I'm saying is it's way too early.
We don't even know what we're regulating.
We don't know what the standard would be.
And what we will do by racing to create a new FDA is destroying American innovation in this sector.
And other countries will not slow down.
They will beat us to the punch here. Got it.
I think there's a middle ground here of self-regulation and thoughtfulness on the part of the people who are providing these tools at scale.
To give just but one example here.
And this tweet is from 5 minutes ago.
So, to look at the pace of this, 5 minutes ago this tweet came out.
A developer, who's an AI developer, says, AI agents continue to amaze.
My GPT-4 coding assistant learned how to build apps with authenticated users.
It can build and design a web app, create a back end, handle off logins, upload code to GitHub, and deploy.
He literally, while we were talking, is deploying websites.
Now, if this website was a phishing app or the one that Chamath is talking about, he could make a gazillion different versions of Bank of of America, Wells Fargo, etc.
Then find everybody on the internet's email, then start sending different spoofing emails, determine which spoofing emails work, iterate on those, and create a global financial collapse.
Now, this sounds insane, but it's happening right now.
People get hacked every day at 1 2 3%.
Sacks, fraud is occurring right now in the low single-digit percentages.
Identity theft is happening in the low single identity percentages.
Th- This technology is moving so fast that bad actors could 10x that relatively easy.
And so, if 10% of us want to be hacked and have our credit cards hacked, this could create chaos.
I think self-regulation is the solution.
I'm the one who brought up self-regulation.
What I said is that it up first. I brought it up first. I get credit. No, go ahead.
No, I'm not It's not about credit.
I'm No, it's self-regulation is the solution.
my point about it because you interrupted me.
You talked minutes, so if you have a point to make you should have got in the 8 minutes.
Oh my god, you guys kept interrupting me. Go ahead.
What I said is that there are trust and safety teams at these big AI companies, these big foundation model companies like OpenAI.
Like I said, in the past trust and safety has been a euphemism for censorship and that's why people don't trust it, but I think it would be appropriate for these platform companies to apply some guardrails on how their tools can be used and based on everything I know they're doing that.
This guy just released a website to the open web with ChatGPT-4 and he's going to have it do an automated You're basically postulating capabilities that don't yet exist.
I just tweeted the guy's doing it.
He's got a video of himself doing it on the web.
What do you think Freeberg?
That's a far cry from basically running like some fishing expedition that's going to bring down the entire banking system.
A literally a fishing a fishing site and a site with OAuth are the same thing. Go ahead Freeberg.
I think that that guy is doing something illegal if he's hacking into computers into people's emails and bank accounts. That's illegal.
You're not allowed to do that.
And so that action breaks the law.
That person can be prosecuted for doing that.
The tooling that one might use to do that can be used in a lot of different ways.
Just like you could use Microsoft Word to forge letters.
Just like you could use Microsoft Excel to create fraudulent financial statements.
I think that the application of a platform technology needs to be distinguished from the technology itself.
And while we all feel extraordinarily fearful because the unbelievable leverage that these AI tools provide, again I'll I'll remind you that this ChatGPT-4 or this GPT-4 model by some estimates is call it a few terabytes.
You could store it on a hard drive or you could store it on your iPhone and you could then go run it on any set of servers that you could go set up physically anywhere.
So, you know, it's a little bit naive to say we can go ahead and, you know, regulate platforms and we can go regulate the tools.
Certainly, we should continue to enforce and protect ourselves against nefarious actors using, you know, new tools in in inappropriate and illegal ways.
You know, I also think that there's a moment here that we should all kind of observe just how quickly we want to shut things down when, you know, they take away what feels like the the control that we all have from one day to the next.
from one day to the next. And, you know, that the the the real side kind of sense of fear that seems to be quite contagious for a large number of people that have significant assets or significant things to lose is that, uh, you know, tooling that's
that's, you know, creating entirely newly disruptive systems and models for business and and economics and opportunity for so many needs to be regulated away to minimize, you know, what we claim to be some potential downside when we already have laws that protect us on the other side. So, you know, I just kind of
So, you know, I just kind of want to also consider that this set of tools creates extraordinary opportunity.
We gave one sort of simple example about the opportunity for creators, but we talked about how new business models new businesses can be started with one or two people.
You know, entirely new tools can be built with a handful of people, uh, entirely new businesses.
This is incredible economic opportunity.
And again, if the US tries to regulate it or the US tries to come in and stop the application of models in general or regulate models in general, you're certainly going to see those models of continue to evolve and continue to be utilized in very powerful ways that are going to be advantageous to places outside the US.
There's over 180 countries on Earth.
They're not all going to regulate together.
It's been hard enough to get any sort of coordination around financial systems, to get coordination around climate change, to get coordination around anything on a global basis.
To try and get coordination around the the software models that are being developed, I think is is pretty naive.
You don't want to have a global organization.
I think you need to have a domestic organization that protects US.
And I think Europe will have their own.
They again, FDA versus EMA.
Canada has its own, Japan has its own, China has its own, and they they have a lot of overlap and a lot of commonality in in the guardrails they use.
And I think that's what's going to happen here.
This will be beneficial only for political insiders who will basically be able to get their projects and their apps approved with a huge deadweight loss for the system because innovation will completely slow down.
But let me build on Freeberg's point, which is that we have to remember that AI won't just be used by nefarious actors, it'll be used by positive actors.
So, there will be new tools that law enforcement will be able to use.
And if somebody's creating phishing sites at scale, they're going to be probably pretty easy for, you know, law enforcement AIs to detect.
So, let's not forget that there'll be co-pilots written for our law enforcement authorities.
They'll be able to use that to basically detect and fight crime.
And a really good example of this was in the crypto space.
We saw this article over the past week that Chainalysis has figured out how to basically track, you know, illicit Bitcoin transactions, and there's now a huge number of prosecutions that are happening of illegal use of Bitcoin.
And if you go back to when Bitcoin first took off, there was a lot of conversations around Silk Road, and the only thing that Bitcoin was good for was basically illegal transactions, blackmailing, uh drug trafficking, and therefore we have to stop Bitcoin.
Remember that was the main argument.
And the counterargument was that, well, no, Bitcoin, like any technology, can be used for good or bad.
However, there will be technologies that spring up to combat those nefarious or illicit use cases.
And sure enough, you had a company like Chainalysis come along and now it's been used by law enforcement to basically crack down on the illicit use of Bitcoin.
And if anything, it's cleaned up the Bitcoin community tremendously.
And I think it's dispelled this idea that the only thing you'd use Bitcoin for is black market transactions.
Quite the contrary, I think you'd be really stupid now to use Bitcoin in that way.
It's actually turned Bitcoin into something of a honeypot now because if you used it for nefarious transactions, your transaction's recorded in the blockchain forever and it's just waiting for Chainalysis to find it.
So, again, using Bitcoin to do something illegal would be really stupid.
I think in a similar way, you're going to see self-regulation by these major AI platform companies combined with new tools that are used, new AI tools, that spring up to help combat the nefarious uses.
And until we let those forces play out, I'm not saying regulate never.
I'm just saying we need to let those forces play out before we leap to creating some new regulatory body that doesn't even understand what its mandated mission is supposed to be.
The Bitcoin story is hilarious, by the way.
I have a friend who works at the Wall Street Journal story. It's unbelievable. Pretty epic.
It took years, but basically this guy was buying blow on Silk Road and he deposited his Bitcoin and then when he withdrew it, he there was a bug that gave him twice as many Bitcoins.
So, he kept creating more accounts, putting more money into Silk Road and getting more Bitcoin out.
And then years later, the authorities figured this out again with, you know, Chainalysis type things.
Look at James Zhong over there. Look at him. James Zhong.
The accused uh had a Lamborghini, a Tesla, a lake house, uh and was living his best life, apparently, when the feds uh knocked on his door and found the digital keys to his crypto fortune in a popcorn tin in his bathroom and in a safe in his basement floor.
So, there you have it, folks.
reason The reason I posted this was I was like, what if this claim that you can have all these anonymous transactions actually fooled an entire market?
Because it looks like that this anonymity has effectively been reverse-engineered, and there's no anonymity at all.
And so, what Bitcoin is quickly becoming is like the most singular honeypot of transactional information that's complete and available and public.
And I think what this article talks about is how companies like Chainalysis and others have worked now for years, almost a decade, with law enforcement to be able to map all of it.
And so, now every time money goes from one Bitcoin wallet to another, they effectively know the sender and the recipient.
And I just want to make a one quick correction here.
It wasn't actually exactly popcorn, it was Cheetos spicy-flavored popcorn.
And there's the tin of it where he had a motherboard of a computer that held Is there a chance that that this project was actually introduced by the government?
mean, there's been reports of Tor and the anonymous Tor network that the CIA had their hands all over Tor, T O R if you don't know it, which is an anonymous like multi-relay peer-to-peer web browsing system, and people believe it's a CIA honeypot, an intentional trap for criminals to get themselves uh caught up in.
All right, as we wrap here, what an amazing discussion.
My lord, I didn't I never thought I would be I want to say one thing. Yes.
We saw that someone was arrested for the murder of Bob Lee.
That's what I was about to get to. morning.
Yeah, which It out that the report of the SFPD's arrest is that it's uh someone that he knew that also works in the tech industry.
Someone that none of us know.
So, it's still breaking news, yeah. Yes, possibly.
But, I I I want to say two things.
One, obviously based on this arrest and the storyline, it's quite different than what we all assumed it to be, which was some sort of homeless robbery type moment that has become all too commonplace in SF.
It It's a commentary for me on two things.
One is how quick we all were to kind of judge and assume that, you know, a homeless robber type person would do this in SF, which I think speaks to the condition in SF right now.
Also speaks to our conditioning that that we all kind of lacked or didn't even want to engage in a conversation that maybe this person was murdered by someone that they knew because we wanted to kind of very quickly fill our own narrative about how bad SF is.
And that's just something that I really felt when I read this this morning.
I was like, man, like I didn't even consider the possibility that this guy was murdered by someone that he knew because I am so enthralled right now by this narrative that SF is so bad and it must be another data point that validates my point of view on SF.
So, you know, I kind of want to just acknowledge that and acknowledge that we all kind of do that right now.
But, I do think it also does, in fact, unfortunately speak to how bad things are in SF because we all are we've all have these experiences of feeling like we're in danger and under threat all the time we're walking around in SF uh in so many parts of San Francisco, I should say, where things feel like they've gotten really bad.
I think both things can be true that we can kind of feel biased and fill our own narrative by kind of latching on to our assumption about what something tells us.
But, but it also tells us quite a lot about what is going on in SF.
So, I I just I just wanted to make that point.
in fairness, and I think it's fine for you to make that point.
I am extremely vigilant on this program to always say when something is breaking news, withhold judgment, whether it's the Trump case or Jussie Smollett or anything in between, January 6th, let's wait until we get all the facts.
And in fact, quote from Sachs, "We don't know exactly what happened yet." Correct.
Literally Sachs started with that.
We do that every [ __ ] time on this program.
We know when there's breaking news to withhold judgment, but you can also know two things can be true.
A tolerance for ambiguity is necessary.
But I'm saying I didn't even do that.
I As soon as I heard this, I was like I was like, "Oh, a homeless person did this."
to But David, that is a fine assumption to make.
That's a fine assumption to make.
Listen, You make that assumption for your own protection.
We got all these reporters who are basically propagandists trying to claim that crime is down in San Francisco.
They're all basically seeking comment from me this morning sending emails.
They're trying to dunk on us because we basically talked about the Bob Lee case in that way.
Listen, we said that we didn't know what happened, but if we were to bet, at least what I said is I bet this case it looks like a lot like the Breonna Cup for case. That was logical.
That's not conditioning or bias. That's logic.
And you need to look at what else happened that week.
Okay, so just the same week that Bob Lee was killed, let me give you three other examples of things that happened in Gotham City aka San Francisco.
So, number one, former fire commissioner Don Carmignani was beaten within an inch of his life by a group of homeless addicts in the Marina.
And one of them was interviewed in terms of why it happened and basically Don came down from his mother's house and told them to move off his mother's front porch cuz they were obstructing her ability to get in and out of her apartment.
They interpreted that as disrespect and they beat him with a tire iron or or a metal pipe.
And one of the hoodlums who was involved in this apparently admitted this. Yeah, play the video.
somebody over the head like that and attacked him.
As he was really dis- he was disrespectful.
He Who was disrespectful?
There was a big old kind of bald-haired old man out Don. Don.
So, he was being disrespectful and then but is that enough to beat him up? Yeah, sometimes. Oh my lord.
I mean So, this is case number one and apparently in the uh reporting on that person who was just interviewed, he's been in the marina kind of terrorizing people, maybe not physically but verbally.
So, you have, you know, bands of homeless people encamped in front of people's houses.
Don Carmignani gets beaten within an inch of his life.
You then had the case of the Whole Foods store on Market Street shut down in San Francisco.
And this was not a case of shoplifting like some of the other store closings we've seen.
They said they were closing the store because they cannot protect their employees.
The bathrooms were filled with needles and pipes that were drug paraphernalia.
You had drug addicts going in there using it.
They were engaging in altercations with store employees.
And Whole Foods felt like that to close the store because again, they cannot protect their employees.
Third example, Board of Supervisors had to disband their own meeting because their internet connection got vandalized.
The fiber for the cable connection to provide their internet got vandalized so they had to basically disband their meeting.
Aaron Peskin was the one who announced this and you saw in the response to this, yeah, my retweeting him went viral.
There were lots of people said, "Yeah, I've got a small business and the fiber or the copper wire or whatever was vandalized."
And in a lot of cases, I think it's basically drug addicts stealing whatever they can.
They steal $10 of copper wire, sell that to get a hit and it causes $40,000 of property damage.
Here's the insincerity, Sachs.
Literally the proper response when there's violence in San Francisco is, "Hey, we need to make this place less violent."
Is there a chance that it could be people who know each other?
Of course, that's inherent in any crime that occurs that there'll be time to investigate it.
But literally, the press is now using this as a moment to say there's no crime in San Francisco or that they were acting and like I just have the New York Times email me during the podcast.
Heather Knight from the Chronicle, San Francisco Chronicle.
In light of the Bob Lee killing appearing to be an interpersonal dispute, she still doesn't know, right?
We we don't have all the facts.
With another tech leader, do you think the tech community jumped to conclusions?
Why are so many tech leaders painting San Francisco as a dystopian hellscape with the reality with the reality is more nuanced.
I think there's a little typo there. When the reality yes.
it's like of course the reality is nuanced.
Of course it's a hellscape. Walk down the street. Heather. Can I give you a theory? Please.
I think it was most evident in the way that Elon dismantled and manhandled the BBC reporter.
Oh my god, that was brutal.
This is a small microcosm of what I think media is.
So, I used to think that media had an agenda.
I actually now think that they don't particularly have an agenda other than to be relevant because they see waning relevance.
And so, I think what happens is whenever there are a bunch of articles that tilt the pendulum into a narrative, they all of a sudden become very focused on refuting that narrative.
And even if it means they have to lie, they'll do it. Right?
So, you know, I think for months and months I think people have seen that the quality of the discourse on Twitter became better and better.
Elon was doing a lot with bots and all of this stuff, cleaning it up.
And this guy had to try to establish the counter narrative and was willing to lie in order to do it then he was dismantled.
Here, you guys, I don't have a bone to pick so much with San Francisco.
I think I've been relatively silent on this topic, but you guys as residents and former residents, I think have a vested interest in the quality of that city, and you guys have been very vocal.
But, I think that you're not the only ones.
Michelle Tandler, you know, Shellenberger, there's a bunch of smart, thoughtful people who've been beating this drum. Gary Tan.
And so now, I think reporters don't want to write the N plus first article saying that San Francisco is a hellscape, so they have to take the other side.
And so now, they're going to go and kick up the counter narrative, and they'll probably dismantle the truth and kind of redirect it in order to do it.
So, I think that what you're seeing is they'll initially tell a story, but when then there's too much of the truth, they'll go to the other side because that's the only way to get clicks and be seen.
So, I think that that's what you guys are a part of right now.
They are in the business of protecting the narrative, but I I do think there's a huge ideological component to the narrative, both in the Elon case where they're trying to claim that there was a huge rise in hate speech on Twitter.
The reason they're saying that is because they want Twitter to engage in more censorship.
That's the ideological agenda here.
The agenda is this radical agenda of decarceration.
They actually believe that more and more people should be let out of prison, and so therefore, they have an incentive to deny the existence of crime in San Francisco and the rise in crime in San Francisco.
If you poll most people in San Francisco, large majorities of San Francisco believe that crime is on the rise because they can see it, they hear it.
And what I would say is, look, I think there's a pyramid of activity, a pyramid of criminal or antisocial behavior in San Francisco that we can all see.
The base level is you've got a level of chaos on the streets where you have open-air drug markets, people doing drugs.
Sometimes you'll see, you know, a person doing something disgusting, you know, like people defecating on the streets or even worse.
Then there's like a level up where they're chasing after you or you know, harassing you.
People have experienced that. I've experienced that.
Then there's a level up where there's petty crime, your car gets broken into or something like that.
Then there's the level where you get mugged.
And then finally, the top of the pyramid is that there's a murder.
And it's true that most of the time the issues don't go all the way to the top of the pyramid where someone is murdered, okay?
But that doesn't mean there's not a vast pyramid underneath that of basically quality of life issues.
And I think this term quality of life was originally used as some sort of way to minimize the behavior that was going on saying that they weren't really crimes, we shouldn't worry about them.
But if anything, what we've seen in San Francisco is that when you ignore quality of life crimes, you will actually see a huge diminishment in what it's like to live in these cities.
Like quality of life is real. And that's the issue.
And I think what they're trying to do now is that say that because Bob Lee wasn't the case that we thought it was that that whole pyramid doesn't exist. exist. That pyramid exists.
We can all experience it. god.
I mean and that's the insincerity of this. It is insincere.
And the existence of that pyramid that we can see and hear and feel and experience every day is why we're willing to make a bet.
We called it a bet that the Bob Lee case was like the Brianna Kupfer case.
And in that With the disclaimer. With a disclaimer.
And we always do a disclaimer here.
And just to George Hammon from the Financial Times who emailed me, here's what he asked me.
There's a lot of public attention lately on whether San Francisco's status as one of the top business and technology hubs in the US is at risk in the aftermath of the pandemic. Duh. Obviously it is.
I wondered if you had a moment to chat about that and whether there's a danger that negative perceptions about the city will damage its reputation for founders and capital allocators in the future.
So essentially the And it says the obviously a lot of potential for hysteria in this conversation, which I'm keen to avoid.
And it's like have you walked down the street?
And I asked him, have you walked down the street in San Francisco?
Jason, the best response is send him the thing that Sachs sent, which is the amount of available office space in San Francisco.
People are voting companies Companies are voting with their feet.
So, it's already if the quality of life wasn't so poor, they'd stay.
This is the essence of of gaslighting.
Is what they do is the people who've actually created the situation in San Francisco with their policies, their policies of defunding the police, making it harder for the police to do their job, decriminalizing theft under $950, allowing open-air drug markets.
The people who have now created that matrix of policies have created this situation.
What they then turn around and do is say, "No, the people who are creating the problem are the ones who are observing this."
That's all we're doing is observing and complaining about it.
And what they try to do is say, "Well, no, you're you're running down San Francisco.
We're not the ones creating the problem. We're observing it."
And just this week, another data point is that the mayor's office said that they were short more than 500 police officers in San Francisco.
Yeah, nobody who who's going to become a police officer here? Are you crazy?
Well, and there was another article just this week about how there's a lot of speculation and rumors are swirling of an unofficial strike, an informal strike by police officers who are normally on the force who are tired of risking life and limb, and then, you know, they basically risking a physical altercation with a homeless person, they bring them in, and then they're just released again.
So, there's a lot of quiet quitting that's going on on the job.
It's like this learned helplessness because why take a risk?
And then the police commission doesn't have your back.
It seems like the only time you have prosecutorial zeal by a lot of these prosecutors is when they can go after a cop, not one of these repeat offenders.
You just saw that, by the way, in LA.
Motherboard and New York Times just emailed and DM'd me.
And then And then did you guys say that instead of solving these issues, the Board of Supervisors was dealing with a wild parrot? What was it? It's just in the group.
The meeting that was disbanded?
They had Yeah, they had scheduled a meeting to vote on whether the wild parrots are be official animal of the city of San Francisco.
So, that was the the scheduled meeting that got uh disbanded.
Also, connect May I just clarify what Chamath's talking about with the Elon interview?
A BBC reporter interviewed Elon and said, "There is much more race and hate and hate speech in the feeds on Twitter."
And he said, "Can you give me an example?"
And he said, "Well, I don't have an example, but people are saying this."
He said, "Which people are saying it?"
And the BBC reporter said, "Well, just different groups of people are saying it and, you know, I've certainly seen it."
He said, "Okay, you saw it in for you?"
He goes, "No, I stopped looking at for you."
He said, "So, give me one example of hate speech that you've seen in your feed."
Now, we without speaking about any inside information, which I do not have much of, they they've been pretty deliberate of removing hate speech from places like for you and, you know, it's a very complicated issue when you have an open platform, but the the people may say a word, but it doesn't reach a lot of people.
So, if you were to say something really nasty, it doesn't take a genius to block that and not have it reach a bunch of people.
This reporter kept insisting to Elon that this was on the rise with no factual basis for it, that other people said it.
And then he said, "But I don't look at the feed."
He said, "So, you're telling me that there's more hate speech that you've seen, but you just admitted to me that you haven't looked at the for you feed in 3 months."
And it was just like this completely weird thing.
I just had mother board him a liar. He called him a liar. him a liar.
And and this is the thing, if you're a journalist, just cut it down the middle, come with prepared with facts, and stop taking a position either way.
I want to connect one dot, Please.
which is that he filled in his own narrative, even though the data wasn't necessarily there.
In the same way that, you know, we kind of filled in our narrative about San Francisco with the Bob Lee, you know, murder being another example of the San uh uh Immediately put a disclaimer on it. We did it. Hold on a second.
We said what we knew and what we didn't know.
And furthermore, we're taking great pains this week to correct the record and explain what we now know. Yeah. He was being honest.
Was it so hard to be intellectually honest?
This is just intellectual honesty.
Honestly, you're you're you're going soft here, Freeberg.
You're getting gaslit by all these people.
I'm not getting gaslit by anyone.
I think the guy The guy totally The guy totally had zero data.
By the way, when you're a journalist, you're supposed to report on data and evidence.
So, he certainly, you know, I think completely failed in that regard. Lee with Don Carmignani. It's the same story. Yeah.
It's just that Don Don happened to survive.
Guys, I love I love you, but I got to go. Goodbye.
Here's what Maxwell from Motherboard Have fun.
There's been a lot of discussion about the future of San Francisco and the death has quickly become politicized.
Has that caused any division or disagreement from what you've seen or has that not been the case?
The press is gleeful right now. They're gleeful. Like, oh my god. It's just you know what?
Just like the right was gleeful with Jussie Smollett having gotten himself beaten up or, you know, setting up his own All right, everybody.
Four the sultan of science currently conducting experiments on a beach to see exactly how burned he can get with his SPF 200 under an umbrella wearing a sun shirt and pants.
Freeberg Freeberg on the beach wears the same outfit astronauts wear when they do space walks.
Hey, Stable Diffusion, make me an image of David Freeberg wearing a full body bathing suit covered in SPF 200 under three umbrellas on a sunny beach.
Thank you, Stable Diffusion. Oh my gosh.
Or the dictator, Chamath Palihapitiya, creating regulations.
And the regu- Oh, the regulator.
You can call me the regulator. The regulator. Huh?
See you tonight when we'll eat our ortolans, what's left of them.
The final four or five ortolans in existence are in a late, otherwise I'm putting you on the B list today if you're late. I will be there. I'll be there. I promise. I promise. I promise. Can't wait to be there.
And the Rain Man himself, Na'vi didn't even get to pudding Ron.
Oh, we'll talk I think you should ask Auto GPT how you can eat more endangered animals.
Have we got a plan for you? Yes.
And then how do we go kill those animals in the real world?
Put something on the dark web to go kill the remaining rhinos and bring them to Chamath's house for poker night.
I don't think rhinos would taste good.
Wasn't that the plot of a movie?
It was a Oh, did you guys see is Cocaine Bear out yet? No.
It was a Matthew Broderick Marlon Brando movie, right?
Where they're doing the take off on the Godfather was The Freshman or something. yeah, yeah, yeah.
It's like a conspiracy to eat uh endangered animals. Yeah, it's The Freshman.
The movie came out in 1990.
Yeah, Marlon Brando did it with um Matthew Broderick and like Bruno Kirby.
They actually they that was the whole thing is Kirby, that's a deep pull.
uh they were eating endangered animals.
What do you What do you think?
Heat 2, is that going to be good?
Sachs, I know Heat's one of your favorite films. Me too. Heat's awesome.
Is there a sequel coming?
They're going to do Heat 2.
And the novel's already come out.
Adam Driver I saw the novel. Yeah. Heat's amazing. Heat is amazing.
It's one of those movies where when it comes on, you just can't stop watching it.
Let's do a Heat 2 screener.
Best bank robbery / shootout in movie history, you know?
That is literally the best heist film ever.
Like it's up there with like The Joker, with Reservoir Dogs, the the the Joker in that Batman movie where he robs the bank.
Like I mean, what a great scene.
All right, love you besties.
And for blah blah blah blah blah, this has been the All-In podcast 124.
If you want to go to the fan meetups and hang out with other fans and blah blah blah blah blah blah blah blah blah. Bye-bye. Bye-bye. Let your winners ride. Rain Man David Sack.
And I said, "We open sourced it to the fans and they've just gone crazy with it." Love you, S. I'm the queen of quinoa. Besties are back.
That is why you have a dog taking a piss in your driveway. Oh, man.
We should all just get a room and just have a one big huge orgy cuz they're all just useless.
It's like this like sexual tension that they just need to release somehow. Wet your big feet. Wet your pure feet. We need to get merch. Besties are back.