General relativity from first principles – Adam Brown

0:00

I'm back with Adam Brown.

0:00

You currently lead BlueShift at Google DeepMind, which is cracking science and reasoning.

0:02

In a previous life, Adam was a prolific physicist, taught at Stanford, and did research  on everything from cosmology to string theory to general relativity.

0:11

It's said that general relativity is the most beautiful thing the human  mind has ever conceived or seen.

0:17

I was curious if there's a way that ordinary  people like me could understand what is happening, or have some vantage on why it's beautiful,  without taking your 20-lecture graduate course.

0:28

That was the prompt for this lecture.

0:28

I appreciate you being willing to do it.

0:31

Super exciting to be here.

0:31

Yes, I think the answer is yes, we can.

0:36

General relativity, Einstein's theory of  gravity, is, as you say, the most beautiful product of a single mind that we've ever created.

0:41

It's one of the two great theories of 20th century physics, along with quantum mechanics.

0:45

Unlike quantum mechanics, it was basically Einstein.

0:49

He had a little help, but basically it was one person doggedly pursuing  this idea for 10 years and then he wrote down this theory that ends up describing the  motion of planets in the solar system and also the origin and fate of the universe.

1:03

It's pretty extraordinary.

1:03

It took Einstein, one of the most famous minds in history,  about a decade to figure it out.

1:14

But when I teach it I'll do a 10-week  course, and in 10 weeks people will get a better idea of general relativity  than Einstein really had in 10 years.

1:26

That's because we have an advantage  that Einstein didn't have.

1:30

We have Einstein, and many others like him going  before us, who've been able to take these super complicated ideas—understood at the time as  being totally incomprehensible by anybody with a sub-Einstein level of intelligence—and boil them  down to their essentials, and not make many of the same mistakes that were made by our forebears.

1:46

In 10 or 20 minutes, I can't give you a better idea of general relativity than Einstein had,  but we can get to the core insight—what Einstein said was his most beautiful idea—and  push through it to try and understand what the central idea of this theory is. Ok, let's go.

2:07

Before general relativity, there was special relativity.

2:14

Special, meaning it doesn't apply everywhere.

2:21

That was also invented by Einstein, 10 years  earlier, in 1905, during his annus mirabilis.

2:32

If you want to sloganize special relativity,  you would start with the observation, or the hypothesis, that nothing can go faster than light.

2:38

Special relativity takes that observation, promotes it to a principle, takes that  principle extremely seriously as the central observation of our understanding of  spacetime, and you arrive at special relativity.

2:56

Special relativity applies to electromagnetism.

2:56

It applies—though Einstein didn't even know about these at the time—straightforwardly to the  strong and weak nuclear forces, two of the other fundamental forces that we know about.

3:09

It does not obviously apply to gravity.

3:14

That was corrected 10 years later by  Einstein in his general theory of relativity, a theory more general because it includes gravity.

3:24

It completes the set of fundamental forces.

3:30

Again, it was invented by Einstein after  10 years of dogged pursuit, in 1915.

3:36

If you wanted to sloganize general  relativity, you might say, "Not even gravity."

3:43

Nothing can go faster than  light, not even gravity.

3:46

There's much more to it than that, but it's going  to complete this arc of the centrality of nothing being able to go faster than the speed of light.

3:53

To see some background here, we're going to have to rewind all the way back to the theory  of gravity that existed before Einstein.

4:08

The reigning theory of gravity at the  time of Einstein stretches all the way back to Newton in the late 17th century,  Newton's laws, in his Principia in 1687. Well, he had a few.

4:26

Maybe the one we could most talk about today is two of them.

4:30

His famous second law says the acceleration, a, caused by a force is given by the formula ma=F.

4:41

If you have a force F, it'll cause an acceleration on an object given by a, where the mass tells  you how much an object resists being accelerated.

4:59

The bigger the mass, the bigger the force  you need to cause a given acceleration.

5:06

This law, his second law, will turn out to be  still true once we come to general relativity.

5:13

We'll have to have a more sophisticated  understanding of what we mean by force and acceleration, but this will be  preserved by general relativity.

5:20

A special case of the second  law is Newton's first law.

5:23

Newton's first law says that if the force  is zero, then the acceleration is zero.

5:29

If the force is zero, then objects continue  to move on a straight line at all times.

5:37

That will also continue to be  true in general relativity.

5:40

That if not subject to an external  force, objects move along straight lines.

5:45

However, we'll have to upgrade our  understanding of what we mean by force and what we mean indeed by straight line.

5:49

That's going to keep being true.

5:56

The one that's not going to keep  being true is Newton's law of gravity.

6:00

Newtonian gravity tells you what the  acceleration is in response to a force, but you need to know what the force is  to be able to do anything with that.

6:08

Newton's law of gravity says that the force caused  by the gravitational interaction of two bodies is what's called Newton's constant—just some  constant of nature—times the mass of one body times the mass of the other body—the mass  of the sun times the mass of the Earth—divided by the distance between them squared.

6:29

It's the famous inverse-square law.

6:36

It's a vector that points in the  direction of separation, and it's attractive, so there's a minus sign there.

6:40

This will not be true in general relativity.

6:48

In fact, you immediately see that there's  a tension between this gravitational force law and the claim that nothing can  go faster than the speed of light.

6:56

If this were literally true, then by  jiggling the sun, a straightforward interpretation of this law would just say that  the force at the Earth varies immediately.

7:08

I've changed the distance of the Earth and the  sun, and so I can immediately detect it at the Earth, not eight minutes later but immediately.

7:13

That would imply that you could send an influence faster than the speed of light.

7:20

Newton's force law is inconsistent with this principle.

7:23

One option, of course, could be that this is true for non-gravitational forces, but not true once  you have gravity, and that indeed, using gravity, you could perhaps build a faster-than-light  telephone using gravitational effects.

7:42

That's a possibility, but not a possibility  that Einstein really wanted to embrace.

7:47

He'd spent many years chasing  out any possibility of going faster than light or any superluminal influences.

7:53

So Einstein, and in fact many people at the time, thought that this is the one that has to give.

8:00

Indeed, that is what's going to turn out to be true. Okay, so where are we?

8:09

There's actually a precedent here for  an inverse-square law getting modified in such a way that it ends up being consistent  with special relativity, and that precedent is the other force of nature, the electric force.

8:24

There's also the electrostatic force law—not written down by Newton, but written down a century  or so later—which says that the force caused, not by the gravitational interaction of  two objects, but by the electrostatic interaction of two charged objects, has a  very similar form to the gravitational force.

8:47

It tells you that the force is equal to some  constant times the charge of one object times the charge of the other object, pointing also  in the direction of separation between the two objects, divided by the distance squared.

8:59

It’s another inverse-square law.

8:59

Again, for exactly the same reason, electrostatics  looks to be inconsistent with special relativity. But ultimately it's not.

9:15

Or  ultimately, this is not the full story.

9:20

Electrostatics is just one limit of  the true theory of electromagnetism, which is Maxwell's laws, which has not just  electric forces, but it also has magnetic forces.

9:32

The electric forces only look exactly  like this when nothing is moving.

9:35

When things do start to move, there are  additional corrections to this, all of which conspire to make the electrostatic force  law fully consistent with special relativity.

9:47

In fact, the historical direction of  understanding ran the opposite way.

9:51

First of all, you have Maxwell  in the middle of the nineteenth century writing down Maxwell's equations.

9:54

Only later do people notice, "Hey, Maxwell's equations actually are fully consistent with  nothing going faster than the speed of light."

10:07

That consistency is reflected in a symmetry  called the Lorentz symmetry of the Maxwell field equations, only noticed later after they  were written down, that eventually led Einstein to formulate his special theory of relativity.

10:16

So we have a precedent for starting with an inverse-square law and then dressing it up  in a full relativistically invariant theory.

10:29

So you might say, well, let's just take  gravity and do exactly the same thing to gravity that we did to electrostatics, in order  to make some gravito-magnetic theory that makes Newton's second law an approximation that's  ultimately consistent with special relativity.

10:50

In some grand sense, that is  what we're going to end up doing.

10:53

That is what Einstein's going to end up doing.

10:53

But it's going to be a much more radical departure than the Maxwell generalization of electrostatics.

10:58

There's really two hints, both of which are visible in this formula, that we're going  to have to do something slightly different than we did for electrostatics.

11:08

The first difference between the electrostatic force law and Newton's  law of gravity is this sign difference.

11:22

There is a big difference, which is that here  it is a minus sign, and here it is a plus sign.

11:27

That is reflected in the fact that if you  have two positive masses—the Earth and the Sun—they gravitationally attract each other.

11:33

Conversely, if you have two like charges, they electrostatically repel each other, which is  why that's a minus sign and that's a plus sign.

11:51

That means that you cannot do literally  the same thing for gravity that you did for electromagnetism, because otherwise,  if you did mathematically the same trick, you'd end up with mathematically the same result,  which is that you would find that like masses would repel rather than attract.

12:06

Not to get ahead of ourselves, but ultimately that's because electrostatics  is mediated by a spin-1 particle, the photon, and gravity is going to be mediated by a  spin-2 particle, and that's responsible for the change in that sign there.

12:23

That's why you can't do exactly the same thing as electrostatics.

12:26

So Einstein had to look for something else.

12:31

He had to look for some other way to try and  lift this to a relativistically invariant theory.

12:38

In doing that, he had one clue.

12:38

There's lots of stuff going on.

12:43

It's part of Einstein's central  genius to focus on this as a highly significant clue of where he should look.

12:48

It's sometimes described as his most beautiful thought, that's how he would describe it. The clue is this.

12:52

There is another difference between the gravitational  force law and the electrostatics, and that is the object that plays the analog  of the charge in electrostatics, for gravity.

13:14

It's the fact that it's the mass sitting here.

13:14

That's a strange coincidence from Newtonian physics.

13:24

Mass, in electrostatic forces and accelerations, plays exactly one role. It's sitting here.

13:29

It's the inertia of the object, and it's what is resisting being accelerated.

13:36

This is sometimes called the inertial mass.

13:44

And then the charge is completely  different and unrelated to the mass.

13:46

You can have heavy objects that  have no charge, like the neutron.

13:52

You can have light objects, like  the electron, that have high charge.

13:55

There is no necessary relation between  the charge of a particle and its mass.

14:01

They're just two entirely separate things. Not true in gravity.

14:01

In gravity, this mass that's sitting here in Newton's second  law—the inertial mass that's resisting the force—is exactly equal to the mass that's  sitting here in Newton's gravitational law, that's telling you how much you're pulled along. It's the same mass.

14:20

So this is sometimes called the gravitational mass, and this is  sometimes called the inertial mass.

14:30

Unlike in electrostatics, the gravitational  mass that appears in this formula is equal to what's sometimes called the inertial  mass that sits in this formula.

14:50

This equation is already  true in Newtonian physics.

14:53

Newton noticed it, in fact, and did a  number of experiments to confirm that this was true to one part in 1,000 or so.

14:57

By the time of Einstein, we knew it was true to one part in a billion, and now  we know it's true to one part in 10¹⁵.

15:08

It's striking that these two—which in Newtonian  physics is just a complete coincidence, essentially, that they're  the same thing—nevertheless were observed to be exactly the same thing.

15:16

Einstein honed in on this fact, and it was his central clue for what to do next.

15:23

This is sometimes called the equivalence principle.

15:27

It's responsible for the fact that if you take a feather and a brick in  a vacuum chamber and drop them both, they will both fall and hit the ground at the same time.

15:37

They'll fall and hit the ground at the same time because even though the force on the  brick is much stronger than the force on the feather because it's heavier, that exactly  cancels out the fact that the resistance to acceleration of the brick is larger than the  resistance to acceleration of the feather, and they fall exactly at the same rate.

16:00

The equality of those two is responsible for that exact equality.

16:04

Einstein's genius was to hone in on this as a central clue for how he  is going to end up replacing Newton's law.

16:17

A reason it's a central clue is because there  is, in fact, another class of forces—not fundamental forces like electromagnetism or  gravity, but a set of emergent forces—that exactly have this property baked into  them, that's guaranteed in those theories.

16:36

To explain that, we're now going to move over  to the experimental section of this discussion. So here's a bucket.

16:42

Here's  some water filling the bucket.

16:52

You better know your physics, Adam.

16:52

Otherwise you'll destroy the studio. No tricks.

16:56

Will you put your finger  in that and confirm that it's wet? Here is the bucket.

17:03

At the  bottom, there's no mystery why the water is not falling out of the bucket.

17:06

It's not falling out because the force of gravity, as we'd understand it, is pointing  down to the bottom of the bucket.

17:15

But now what we're going to do is go  a little bit faster and loop the loop.

17:22

Now there is what you might  find superficially surprising, which is that the water doesn't fall out of  the bucket even when the bucket is upside down.

17:34

There are two ways to understand that.

17:34

One way is just the straightforward way.

17:39

You would say the water wants to fall out of  the bucket when it's at the top of its arc, but by the time it's got itself together to  accelerate enough to fall out of the bucket, the bucket's moved on and is now below, and it  just didn't have time to fall out of the bucket.

17:59

Or you might say the same reason that  astronauts don't end up falling to Earth.

18:04

The second perspective, which is an equally  valid perspective, is imagining that you're riding along with the water in the bucket.

18:08

And from that point of view, there's another explanation for why the water doesn't fall out  of the bucket, and that is the centrifugal force.

18:17

From the perspective of somebody moving along  with the bucket, there is a force pushing them towards the bottom of the bucket, and that  force is known as the centrifugal force.

18:34

It's what's known as a  fictitious or inertial force.

18:38

The centrifugal force just says that there  is a force caused by being in a rotating reference frame, given by your speed divided  by the radius of the circle you're going round in, pointing positively outwards.

18:53

So this is the centrifugal force that pins you to the bottom of the bucket, or pins you to  the outside of the car as you go around a bend. What do we notice?

19:08

What we notice is that  your charge under the centrifugal force, if you will—how intensely you feel a centrifugal  force—is once again, just like with gravity but unlike with electrostatics, given by your mass.

19:19

The mass that tells you how much centrifugal force you get is given by your inertial mass.

19:28

But of course, here it's absolutely no mystery whatsoever why the mass that's sitting here on the  right-hand side is given by your inertial mass.

19:40

It is given by your inertial mass precisely  because the reason you're experiencing this force is precisely the tendency of masses  to wish to move along straight lines.

19:49

The fact that you're not moving along a  straight line, you're moving in a circle, it is precisely that inertial tendency  that causes the mass to begin with.

19:57

Another way to say it: any time you  have one of these inertial forces, caused just by your inertia, it is guaranteed  to be the case that the charge under that force is given by the inertial mass.

20:09

So inertial forces always have a charge given by the inertial mass.

20:17

Gravity has a charge, and the charge of gravity is given by the inertial mass.

20:26

So Einstein leapt: could it be the case, and this was his central idea, that  gravity itself is an inertial force?

20:38

That's permitted because the gravitational  mass is equal to the inertial mass.

20:42

It would be totally impossible for  something like electromagnetism, because it would require that the electromagnetic  charge was equal to the inertial mass, which is simply false for electromagnetism.

20:51

Could it be the case, Einstein asked, that it's true for gravity?

20:55

It's permitted by this fact.

20:58

It would also explain this fact as now not  an accidental truth like in Newton's laws, but a necessary fact about the world.

21:02

So this was Einstein's central idea in 1907, his most beautiful thought.

21:09

But it sounds totally crazy.

21:14

It sounds totally crazy because it requires  us to be wrong about what straight lines are.

21:21

It is an extremely radical proposition for  the reason that I will describe right now.

21:26

Inertial forces—like the centrifugal force or the  Coriolis force or any of these other ones that we're familiar with—are forces you experience  when you are not moving on a straight line.

21:42

When you are moving on a straight line,  you don't experience any inertial forces.

21:49

So in order for this to be true, we'd have to  say that astronauts who are free-floating and free-falling are moving along a straight line.

21:56

We'd have to say that you, who are just sitting there, seemingly not moving, are experiencing  the force of gravity pushing you into your chair.

22:08

We'd have to say that you're not  moving along a straight line.

22:11

So we'd have to be pretty wrong about who's  moving along a straight line and who's not.

22:17

As I’ve gotten to know the folks at Jane  Street, I’ve noticed that a lot of them have physics backgrounds.

22:20

I recently  got a chance to talk to Jed Thompson, who was a particle physicist before he was  a trader, about how his physics training helps him with his work at Jane Street.

22:28

I think very few Jane Street traders or researchers come in with any finance  background or any trading background.

22:36

When I used to be in physics, something that I  would say is, I almost never do a calculation without already having a pretty good guess at  the answer.

22:41

In trading, I think the same is true.

22:45

These things are fundamentally models for how the  world is behaving.

22:45

You can build good intuition by seeing patterns over and over again, and  come to a point where you’re mostly asking the right question from the beginning,  which short-circuits a lot of the work.

23:01

So even if you don’t have a finance background,  or for that matter a physics background, you should still consider applying. Go to janestreet.

23:04

com/Dwarkesh to learn more.

23:10

So this is a radical idea because it requires  us to be wrong about what a straight line is.

23:15

In particular, you sitting here, just sitting in  your chair… Here is your height above the center of the Earth as a function of time.

23:23

Here is Dwarkesh just sitting here at constant height.

23:34

Because you are experiencing the force of gravity, if gravity is an inertial force—because  you're experiencing a force down—that means that you have to be moving along a not straight line. So that's you.

23:44

By contrast, this piece of chalk, as it goes up and down, executes something  that's well approximated by a parabola.

24:07

The chalk is in free fall until I catch  it, which means that if gravity is an inertial force, this has to be straight.

24:14

Now, certainly the way I've plotted it, this looks straight and that one does not.

24:20

So if gravity is to be an inertial force, we have to be wrong about what is a straight  line and what is not a straight line.

24:33

However, this is actually a situation  with which you should be familiar if you've sat in an airplane seat and  looked at the screen in front of you.

24:41

Imagine the map that you see on  an airplane, and imagine you are flying from San Francisco to London.

24:47

Now, I'm not good at drawing the Earth, but here is my version of it.

24:56

Here we are in San Francisco.

25:01

Here is Greenland, coming in from the North Pole. And here is England. Here's London.

25:13

I can tell you're a physicist because of  the very idealized forms of the continents.

25:22

Sometimes it can be quite frustrating sitting  there in the backseat of the airplane, because obviously the plane should  be flying like this, moving along the shortest distance from one place to another.

25:33

But instead they take this massive detour that clips Greenland and heads on down.

25:38

You know that in fact that's not what's going on.

25:46

You know that in fact, despite what it looks  like on the graph, this is not a straight line.

25:52

This rhumb line, it's sometimes called, is  not straight, and would certainly not be the shortest path from San Francisco to London.

25:57

And this is in fact, to a good approximation, a straight line.

26:04

So in fact, the straight line from San Francisco to London does indeed  go over Greenland, as I will now demonstrate.

26:22

Here is San Francisco, here is London.

26:22

You can see that the straight line that goes straight from one to the other would go in  this direction over Greenland and hit London.

26:39

That's obvious on this map, because this  map reflects the curvature of the Earth.

26:45

This map is getting confused, and  it's getting confused because it's trying to pretend that the Earth is flat.

26:50

It is trying to ignore the curvature of the Earth, and because it's trying to map a round Earth  onto a flat panel, there have to be distortions.

27:05

Whenever you try and take something that  is curved and pretend it's not curved, you will inevitably end up being wrong  about what is and is not a straight line.

27:15

You see this on the Earth, where  this line that goes up and then comes down is in fact the straight line.

27:22

You see it also in spacetime with general relativity, where this parabolic arc of the  chalk as it's thrown up, it is in free fall, it is the straight line in general relativity.

27:36

And just like in general relativity, the reason you are confused about what's  straight and what's not straight is that you are trying to pretend with this  graph that you are in a flat spacetime.

27:52

In fact, you are in a curved spacetime.

27:52

So in Einstein's theory, the effect of matter is going to be to curve spacetime.

27:58

Through curving spacetime, it's going to change what's a straight line  and what's not a straight line.

28:10

People who are going along what they incorrectly  think of as straight lines are going to experience the gravitational force, whereas astronauts are  going to not experience the gravitational force.

28:22

The only missing piece here is to mathematically  characterize the way in which spacetime is curved.

28:33

In Newtonian physics, the Newtonian  force is caused by the presence of mass.

28:37

In Einstein's general theory of  relativity, it will be the curvature of spacetime that is caused by the mass.

28:41

He struggled for eight years between 1907, when he had this picture approximately mapped  out, and 1915, when he wrote down in its finished form his general theory of relativity.

28:56

The final output of those eight years was his famous formula, that I will not explain but will  write down, that exactly captures his intuition.

29:23

I will walk you through this formula.

29:23

This is just a beautiful formula.

29:29

The left-hand side is some mathematics  invented by some Eastern Europeans that characterizes the curvature of spacetime.

29:35

This says how much spacetime is curved.

29:42

This is some tensor, and the tensor will be  zero if spacetime were flat, and non-zero when spacetime is curved in a particular way.

29:47

On the right-hand side is not spacetime anymore.

29:54

On the right-hand side is matter.

29:54

There are some constants: our old friend Newton's constant, π an even  older friend, and the speed of light.

30:05

And then this quantity T_(μν).

30:05

T_(μν) is like a relativistic generalization of the mass that sits on the  right-hand side of Newton's force equation.

30:18

So it is saying that the presence of mass—and  in fact not just mass, but all forms of mass and energy—on the right-hand side causes the  curvature of spacetime on the left-hand side.

30:31

Or in a slogan: matter tells  spacetime how to curve.

30:37

Once matter's told spacetime how to curve,  the curvature of spacetime tells matter how to move, in the second half of the slogan.

30:42

The curvature of spacetime tells matter to move along straight lines of the curved space,  and so experience fictitious forces if you try and pretend that spacetime is flat.

30:51

That is Einstein's general theory of relativity in a nutshell.

30:56

Backing up: an amazing thing about Newtonian gravity is that he  invented it, allegedly due to some thought experiment to do with an apple falling off a tree.

31:06

It describes not only an apple falling off a tree, but the motion of the objects in the heavens.

31:11

It’s a massive cross hit that it describes planetary motion and also  an apple falling off a tree.

31:21

This was this amazing thing that Newton  unified the heavens and the Earth and had one formula that applied to both.

31:26

General relativity does all of that and goes one step further.

31:29

It describes the motion of apples falling off trees, it describes the motion of Mercury and  the planets in the solar system, and it describes the expansion of the entire universe.

31:37

That's a crazy, huge number of orders of magnitude that it hits.

31:42

You were saying a moment ago that one of the beautiful things about this theory is  that it has reach in all these interesting ways that were not originally anticipated, to solve  this original observation that Einstein had.

31:57

One of them, obviously, is the black hole.

31:57

I would love to get more insight than the high school version—that light falls into it and can't  get out—of why black holes work the way they do.

32:08

Black holes are fascinating objects in general  relativity, really the quintessential object in general relativity that doesn't exist  in the same way in Newtonian physics.

32:20

The story is kind of wild.

32:20

Einstein wrote down his field equations, the field equations we wrote on the board,  describing the relationship between curvature and the amount of energy in the system.

32:29

He thought that those equations are so complicated, no one would ever come up with  exact solutions to them, that we'd just always be having to do approximations.

32:40

That turned out not to be correct.

32:44

Schwarzschild was a Prussian artillery  officer in the First World War.

32:50

In between calculating the trajectories of  artillery they were lobbing in the direction of their enemy, he figured out that Einstein's  equations—pretty much immediately after Einstein had written them down, within a matter of  months—in fact have an exact solution, a solution now known as the Schwarzschild equation,  and that we now understand describes a black hole.

33:18

It is a solution in which there  is no matter, except possibly at the very center in a way we'll not describe.

33:22

It's a central point-like amount of matter.

33:28

It describes what the spacetime  around that looks like.

33:31

It's called the Schwarzschild solution,  and it describes a black hole.

33:34

They were not called black holes at the time.

33:34

In fact, people were extremely confused about what this solution even meant.

33:39

People wrote down wrong things for about half a century about what this meant.

33:43

Perhaps the worst offender was Einstein, who got extremely confused about it.

33:48

He got particularly confused about what I will describe as the event horizon, and wrote  all sorts of wrong things about how objects would maybe bounce off the event horizon.

33:54

He was just totally confused, but from a modern perspective it's extremely  simple to understand what's going on.

34:01

So let me tell you what a black hole is.

34:01

General relativity, as we set it up, is about a collision between gravity  and the finite speed of light.

34:10

The simplest collision you could do was actually  noticed by people even in the 18th century, before we had special relativity or anything like that.

34:14

They just asked a very simple question.

34:20

If you want to shoot something off the  Earth, you know you need to shoot it with a certain velocity, the escape velocity.

34:25

You need to shoot it fast enough if you want to escape far away from the Earth, so  that the kinetic energy of the object you're shooting is equal to the gravitational  binding energy of the Earth's surface.

34:40

M is the mass of the Earth and  r is the surface of the Earth.

34:43

For Earth, the escape velocity turns out  to be about 11 kilometers per second.

34:48

But for objects that are heavier or more  compact, the escape velocity is larger.

34:54

For example, for Jupiter it would  be hundreds of kilometers a second.

34:58

You can imagine objects that are so heavy  or so compact that in fact the escape velocity becomes equal to the speed of light.

35:06

So people idly wondered what would happen then.

35:12

They didn't have the tools to address it, but in  the 18th century they wondered what would happen.

35:16

You can calculate what the  critical value of the velocity is.

35:21

Just putting the velocity equal to the speed of  light, this gives a critical radius of 2GM—the mass of the object cancels—divided by c².

35:29

So that's somewhat suggestive.

35:29

If you had an object that was this compact and had this  mass, the escape velocity would be given by c, the speed of light.

35:43

The connection you're pointing out is a Newtonian one.

35:44

Did anyone make this connection before GR? Absolutely.

35:48

People in the late 18th  century wrote this formula down.

35:52

I think both Michell and Laplace had this.

35:52

And they said that if you had an object that was that massive and compact,  light would not be able to escape.

36:04

That reason is not particularly compelling  by modern standards but it turns out to be particularly correct, including crazily  this factor of 2, which is correct for completely coincidental reasons.

36:12

But let me give you a more compelling argument that something funny is  going to happen around this radius.

36:22

And to do that, let's think about trying  to extract energy from objects by lowering the objects down towards a central mass.

36:27

Let's start off perhaps with the Earth. Here it is.

36:32

We're going to start off a long way  away from the Earth, with a brick of mass m.

36:39

I'm going to take this brick,  attach it to a pulley system, and then slowly lower the brick down towards the  surface of the Earth and deposit it with zero velocity on the surface of the Earth down there.

36:49

In doing so, I can extract energy from the brick.

36:57

I've extracted energy from the brick because  there's a force pulling the brick down.

37:02

That force I'm doing through a certain  distance, and that gives you an energy.

37:05

We know, at least in Newtonian physics, what  the formula for the amount of energy you can extract from the brick is: G times the mass  of the Earth times the mass of the brick, divided by r, the radius away.

37:18

It's an energy, not force, so it's an inverse distance law, not an inverse square distance law.

37:23

That's the energy you can extract from the brick by lowering it down to a  distance r away from the Earth.

37:30

Of course, if you try to lower it beyond the  surface of the Earth, this formula changes.

37:34

But let's just put it on the surface of the Earth.

37:34

So this is the amount of energy I have extracted from the brick, out here a long way away.

37:38

You can ask, what fraction of the rest mass energy of the brick have I extracted?

37:44

This is a question that you would only naturally ask once you've invented special relativity and  know that the rest mass energy is given by mc².

37:55

We can straightforwardly calculate, at least  in this approximation, that the fraction of the energy that you've extracted is that divided  by the rest mass energy you started with.

38:08

The mass of the brick, of course, is going  to cancel, but not the mass of the Earth.

38:12

This is going to be given by G times  the mass of the Earth, divided by c² times the radius away from the Earth at  which you stop, the radius of the Earth.

38:25

So what fraction have I got out of it?

38:25

If you lower down to the Earth's surface, the answer is you haven't really  extracted that much from the brick.

38:38

You've extracted a fraction 7x10⁻¹⁰ of the  original rest mass energy of the brick, doing useful work a long way away.

38:46

First observation: this is small.

38:54

In other words, the gravitational binding  energy of something on the Earth's surface is quite small in natural units.

38:57

That's why we didn't really notice general relativity on the Earth's surface until  we did very sensitive experiments, because general relativity is in some sense a Taylor expansion  in this number, where the relativistic effects, where the first order term is just Newtonian,  and then the next order terms will give you the GR corrections to the Newtonian answer.

39:17

Observation number two, and this is something of a digression, is that by essentially sheer  coincidence, this number here is very close to the chemical binding energy of rocket fuel.

39:31

So if you take a rocket fuel like an oxygen-hydrogen mix, the chemical energy  binding the rocket together, which is the energy that you're going to extract when you burn it to  make your rocket go, divided by the mc² of the oxygen and hydrogen you're going to  mix together, is given by 1. 5x10⁻¹⁰.

40:01

First observation: these two are close  to each other, even though they came from completely different calculations.

40:04

This was a gravitational calculation that was something to do with the Earth.

40:08

This is a chemical property of hydrogen and oxygen. This is also very small.

40:19

The reason it's very small is that almost  all of the energy in hydrogen and oxygen is not stored in the chemical binding  energy of these things going together.

40:28

The vast majority of it is stored in just the  rest mass energy of the protons and the neutrons, which chemical burning doesn't affect at all.

40:34

The second largest amount is stored in the nuclear binding energy of the protons  and the neutrons to each other, given by the strong force and the weak force, which  again chemical reactions don't touch at all.

40:47

This is a small number because chemical  bonds are very weak compared to the rest mass of the things we're considering.

40:52

These two small numbers are almost exactly equal to each other, which is why we can use  chemical rockets to get to space, but it's hard.

41:03

In particular, this number is a few times bigger  than this number, which means that your payload fraction is quite small when trying to  use chemical rockets to get to space, because most of your fuel cannot get to orbit.

41:17

You have to pay a rocket factor that's going to tell you that most of what's sitting there on  the launch pad is going to have to be burnt up before you get to space, in order to get a  small fraction of the rocket up to space.

41:37

In other words, we can use chemical  rockets to get to space in a way that would be totally impossible if we tried to do  it from the surface of the sun, but it's hard.

41:46

Okay, that's the fraction on the Earth.

41:46

But this formula tells you that if you have an object that's heavier or more  compact, the fraction of energy that you extract by lowering the object down  to the surface is going to be larger.

41:59

For example, if you lower it not down to the  Earth's surface but down to the sun's surface, this would be larger.

42:05

It’d be a million times larger, because the sun is a few million times the  mass of the Earth, but then it's also bigger, so that takes it away a little bit.

42:15

You end up with 2x10⁻⁶, the famous redshift from the sun's surface.

42:23

You can escalate from there.

42:28

You can imagine cramming a  sun-like mass into an Earth-like radius to make this formula even bigger. Sun mass, Earth radius.

42:33

That's pretty much exactly what happens in a white dwarf like Sirius B.

42:37

And this would get even bigger again.

42:55

A larger fraction of the mass of the object you'd  be extracting by lowering it down to the surface.

43:00

But it really feels like something  has to give before we make an object that is too massive and too compact.

43:04

In particular, if you look at this formula, what happens for r less than or equal to GM over c²?

43:13

If this object were so compact and so heavy that it had a radius less than the mass of the  object divided by c², it sure looks like you could get more than a hundred percent.

43:34

The fraction would be bigger than one.

43:37

You could get more than a hundred percent  of the mass of your brick back by lowering it down to the surface of this object. And that feels wrong.

43:41

That feels, in fact, more wrong than what's going on here, because  now you've got all this energy a long way away.

43:52

You could perhaps use it  to make a whole new brick.

43:55

You've got all this more than mc² out there.

43:55

Lower that one down, and it feels like we've figured out a way to make a huge amount of  energy where there was no energy before.

44:08

This argument is pretty suggestive  that something has to go wrong by the time you get down to that radius.

44:12

Indeed, when you do the calculation—this is a Newtonian calculation, so it's only  suggestive —in full general relativity, indeed something does go wrong.

44:20

The thing that goes wrong is that you form a black hole.

44:23

You can imagine two ways that you could avoid this conclusion.

44:28

One would be somehow that gravity becomes very weak when you get close to a massive object,  weaker than the Newtonian law would predict.

44:41

That's sort of what saves you if you try and  repeat this same trick in electromagnetism, lowering a charge down towards another  charge and trying to extract the electrostatic energy between them.

44:50

What happens is, essentially due to quantum effects, when one gets too close  to the other, they start to fuzz out.

45:04

The energy going like inverse r gets softened,  and you can't extract more energy because they stop attracting each other so hard.

45:10

So that's one possibility, the force gets weaker than Newtonian law would  predict as you approach the other object.

45:22

That's actually the opposite of how  general relativity resolves this.

45:25

General relativity resolves this  paradox by the force getting stronger than Newtonian law would predict.

45:31

In particular, the force gets so strong when you try to get within this radius, that in fact  you cannot slowly lower the brick down towards the surface because you've formed a black hole.

45:43

The gravitational force becomes infinite at a finite distance away—not at r=0, but at some  finite value of r—and the brick simply gets ripped out of your hand and you're unable  to extract any more energy out of it.

45:58

That's the resolution that general  relativity provides to this paradox.

46:01

In particular, you will find  that you've formed a black hole.

46:05

Crusoe gave us early access to their  serverless fine-tuning product, which lets you fine-tune open models without  having to deal with infra or provisioning.

46:12

I thought it’d be cool to try fine-tuning  a question generator using the transcripts of my old interviews.

46:16

Have the models gotten so  good that if they had all my research and prep, and they could look at a conversation so far, they  could ask a next question better than I would?

46:25

Crusoe made the implementation super  straightforward.

46:25

I just uploaded the data, picked an open model, and started the run.

46:29

I  didn’t have to touch any of the hyperparameters.

46:33

Crusoe’s applied AI team maintains optimal recipes  for each model, so I just set everything on auto.

46:38

When the run finished, I deployed it as a  self-serve endpoint and built an eval for my team.

46:42

I had them choose the best next question out  of three anonymized choices: one that was produced by the base model, one that was produced by the  fine-tuned model, and one that I actually asked.

46:52

Fortunately, my team preferred my actual  questions about two-thirds of the time.

46:56

Hopefully this benchmark doesn’t saturate.

46:56

And in  the remaining cases, they almost always preferred the fine-tuned model over the base model.

47:01

Serverless inference is live now, and serverless fine-tuning goes live next  week. Learn more at crusoe. ai/Dwarkesh.

47:12

So far, everything we've written  down on the board is Newtonian.

47:14

It's just Newtonian, and you start plugging in the  speed of light, and you start getting confused.

47:18

To actually answer some of these questions  that we're asking, you need to go to general relativity, the theory that correctly  unifies the speed of light with gravity.

47:29

This was first done in the context of black  holes by Schwarzschild, who wrote down the Schwarzschild metric that describes the  gravitational field around a central mass, including potentially around a black hole.

47:36

Let me write down some of the formulas that emerge.

47:41

In fact, I think I'm going to write down three formulas, three direct  consequences of the Schwarzschild metric.

47:48

They're going to give us intuition for what it's  like outside and indeed inside a black hole.

47:52

The first formula I'm going to write down is  the formula for the gravitational field that you would experience if you were trying  to remain static outside a central mass.

48:08

So let's just talk about static observers.

48:08

I can discuss how these will get upgraded for observers who are moving around.

48:12

But for now, I'm just going to imagine that you're trying to sit here at some  fixed radius r away from the black hole.

48:26

The reason you don't fall in, maybe  I'm lowering you down on a pulley.

48:32

You're just sitting here holding the pulley.

48:34

The question is, how strong a force  do you need to stop you falling down?

48:38

You're abseiling down very slowly. You're static.

48:38

What is the local force of gravity that you experience?

48:41

Or you can imagine that you're sitting here, and the reason you're static is  that you're firing a rocket very hard.

48:50

The question is, how much  acceleration do you locally feel?

48:54

So by whatever mechanism, you're remaining static.

48:54

What is the local force of gravity that you feel?

49:04

In Newtonian physics, you know what  the answer to that question would be.

49:08

The force of gravity is GM/r², which  is Newton's famous inverse-square law.

49:18

But this gets a correction  from general relativity.

49:21

The correction is 1/√(1-2GM/(c²r)), this  same 2GM/c² that we find all over the place.

49:38

What this tells you: first of all, if you're  a very long way away from the black hole, this here is essentially one.

49:44

r is very big,  and you get Newton's force law back again.

49:54

For the Earth, this is very small.

49:54

As we discussed, it's down by a factor of 10⁻¹⁰, and then you take the square root.

50:04

So you don't really notice it, but you can Taylor-expand this at large  r, and you find that you get corrections.

50:13

You get an inverse-square law plus an  inverse-cube law correction plus an inverse-fourth law correction.

50:17

You find that gravity at short distances is stronger than it would  have been in Newtonian physics.

50:26

This is the general relativity correction and  it's making the gravitational field stronger.

50:33

You have to accelerate harder  to not fall into the black hole.

50:37

In particular, once r is equal to 2GM/c²,  what's called the Schwarzschild radius, you have to accelerate infinitely.

50:44

The proper acceleration required to not move in r goes to infinity.

50:50

In fact, if we now convert this Earth to a black hole, this is a very  significant radius over here, 2GM/c².

51:07

It's called the event horizon.

51:07

It's called the event horizon because if you want to remain static outside the event  horizon, further away from the event horizon, you just need to accelerate with some  finite velocity in order to remain static.

51:28

You need to have a finite gravitational field.

51:28

But the gravitational field, as you approach the event horizon, becomes infinite.

51:31

So once you're at or beyond the event horizon, it is impossible to remain static.

51:35

You will inevitably get sucked into the black hole no matter how hard you fire your rocket.

51:39

Now, this is just a static formula.

51:44

You might imagine, "Okay, it's impossible  to remain static closer than that, but maybe I could avoid falling into the  black hole by orbiting really, really fast.

51:54

If I orbit really fast, I have a huge centrifugal  force that pushes me away from the black hole, and I can stay out of the black hole that way."

51:59

That actually doesn't work.

51:59

The reason it doesn't work is somewhat instructive  for the way gravitational attraction happens in general relativity.

52:08

Of course, if you think about the International Space Station, why  doesn't it fall towards the Earth?

52:14

It is precisely the fact that it's orbiting.

52:14

The fact that it's orbiting gives it a centrifugal force that shoots the astronauts  away from the Earth and precisely balances the gravitational field on the astronauts,  which is why they feel weightless there.

52:29

So orbital angular momentum, if you're a long  way away from the black hole, helps you stay away from the black hole, stops you falling in.

52:36

There is this kind of sci-fi notion that black holes just suck in everything around them. Not true.

52:41

You are perfectly able to orbit around a black hole if you're a long way away from it,  just like you would orbit around any central mass.

52:51

You are not inevitably  falling into the black hole. You can orbit just fine.

52:54

But orbiting stops helping when you get too close to the black hole.

52:58

We said that the event horizon is 2GM/c².

53:03

In fact, once you're already within  3GM/c², orbiting is counterproductive if you're trying to stay away from the black hole.

53:09

That's because there are two effects of orbiting.

53:15

One effect helps you stay  away from the black hole.

53:17

That's the centrifugal effect.

53:17

Orbital  angular momentum pushes you away from the black hole due to the centrifugal effect.

53:21

It's not too hard to write down the version of this formula that applies when you have  angular momentum, and you would see that pushing you away from the black hole.

53:31

But there's another effect which drags you towards the black hole, and that  is the fact that in general relativity, all energy gravitates, not just rest mass energy.

53:39

Kinetic energy also gravitates.

53:39

So the effect of orbiting is that you have an additional pull down  towards the black hole from the coupling between the gravitational attraction between the mass of  the black hole and your orbital angular energy.

54:04

When you're far away from the black hole, the  centrifugal force is the more important term.

54:09

When you're close to the black hole,  that coupling is the more important term.

54:14

In fact, once you get within 3GM, orbital angular  momentum stops helping and starts hurting.

54:21

There are no ballistic orbits that go  within 3GM and manage to escape again.

54:26

So that's formula number one.

54:26

It tells you what the gravitational field is a distance r away from a black hole.

54:31

In particular, it shows you that once you get to this critical radius, the  gravitational field becomes infinite.

54:42

If you cross that, you must proceed  to the center of the black hole, no matter how hard you fire a rocket.

54:45

That's called the event horizon.

54:49

At the event horizon, you are not yet dead.

54:49

You are, however, doomed if you cross the event horizon.

54:53

You will never be able to escape, not if you convert yourself to light  and try to shoot yourself out, not if you fire your rocket infinitely hard.

54:58

The other place, of course, is r=0, which is where you actually die.

55:04

That's at the singularity, and we'll describe that a little bit in a moment.

55:08

In Newtonian physics, the gravitational force only becomes infinite there.

55:12

In general relativity, it becomes infinite already at the event horizon if  you try to resist the force of gravity.

55:21

That's formula number one.

55:21

Now  let's do formula number two.

55:27

All three formulas I'm going to write  down are heavily related to each other.

55:32

They're really going to be  reformulations of each other.

55:34

Formula number two asks about  gravitational time dilation.

55:39

Let's again imagine that you're sitting  here, Dwarkesh sitting here some radius r away from the black hole.

55:45

I'm sitting out here, way off at infinity, just watching you.

55:52

We're static relative to each other.

55:56

There's no relative motion.

55:56

You're just  suspended here by your pulley system.

56:01

The question is, how fast does  your watch go relative to mine?

56:05

Of course, as far as you're concerned, your  watch is ticking at one second per second.

56:10

As far as I'm concerned, my watch  is ticking at one second per second.

56:12

But if I look at you, I see  your watch as running slow.

56:18

If you look at me, you see  my watch as running fast.

56:22

The second formula makes that quantitative.

56:22

How much slower does your wristwatch—which is closer to the black hole—run than mine?

56:29

It says that the time interval, as measured by your wristwatch, is given by the time interval  as measured by my wristwatch a long way away, times this exact same square root factor  that's showing up all over the place: the square root of 1-2GM/(rc²).

56:51

This factor here is less than one.

57:02

So if I think one second has passed, you  think less than one second has passed.

57:07

In other words, if I slowly lower you down towards  the black hole—you hang out some finite distance away from the black hole for what feels to you  like a year, and then I raise you back up a long way away from the black hole—you will return to  a world that has aged a lot more than you have.

57:27

This formula makes that precise.

57:27

I observe your wristwatch to be running slow.

57:34

You observe my wristwatch to be running fast.

57:34

Time passes slower down here than it does up here.

57:42

This is a fact that has by now been  extremely well observed experimentally.

57:46

In the 1950s, in the Harvard physics  department, they put two atomic clocks at two different heights in the building,  and noticed the one that was higher was running faster than the one that was lower.

57:57

This is an effect that is now considerably within the precision of, for example, GPS.

58:03

It just has to subtract that effect, otherwise everything would drift all over the place.

58:08

GPS clocks that are sitting on the Earth's surface are running slow compared to the atomic  clocks that are in orbit sending out the signal.

58:22

You have to account for that difference and  subtract it off in order to get an accurate read.

58:29

This is known as gravitational time dilation.

58:29

Notice it's quite different from the relativistic time dilation you see in special  relativity, which is caused by two objects being in motion relative to each other.

58:37

Here, we're not in motion relative to each other. We're both static. We're fixed.

58:41

This is  caused by us being at a different place in the gravitational potential, you deeper  in the gravitational potential than me.

58:49

So those are two different sources  of time dilation, and they stack.

58:54

Let's say instead of being  static here, you're in orbit.

58:58

You're far enough away that  you can orbit the black hole.

59:02

How slow do I see you as moving?

59:02

There are now two contributions, both of which make you look slow relative to me.

59:06

One contribution is the gravitational time dilation given by this formula.

59:11

A second contribution is the good old special relativity correction where  moving observers look like they're going slow, and we'll have both of those effects.

59:22

So you'll look like you're going even slower than you would have done otherwise  as you go around the black hole.

59:34

One thing that seems different between this and  special relativity is that there's no symmetry.

59:38

In special relativity, both observers will feel  that the other one is aging slower than they are, because they're both moving relative  to each other at the same rate, and there's no true inertial path.

59:47

But here, it actually does seem like there's a global sense in which one is a more  relevant inertial frame than the other one. You're exactly right.

1:00:03

In special relativity,  if you and I are moving relative to each other, I think your watch is moving slow,  you think my watch is moving slow.

1:00:10

Neither of us is more correct than the other.

1:00:10

The principle of relativity tells you that both of our perspectives are equally valid.

1:00:13

Here, both of our perspectives are not equally valid, because there is not the symmetry  that there was in special relativity.

1:00:22

In particular, the symmetry  is broken by the black hole.

1:00:25

We both agree that you are deeper  in the gravitational well than I am, and your clock runs slower than mine does.

1:00:30

You do not see my clock reciprocally running slow.

1:00:38

You, in fact, see me sped up.

1:00:38

If you were observing me, you see me living my life in fast-forward.

1:00:42

So this is the second formula.

1:00:47

It says how fast our wristwatches  move relative to each other.

1:00:51

Now let's imagine that you're here  with your slow-moving wristwatch, and you shine a light towards me.

1:00:55

Let's say the light has a particular frequency.

1:01:02

You made it with a sodium transition, for example.

1:01:02

As that light travels upwards, by the time it reaches me, I'm going to think that  it is lower frequency than you thought it was when you sent it. Why?

1:01:16

Because frequency is about how rapidly it oscillates.

1:01:19

I just think that everything you do is moving slow relative to me.

1:01:26

You think it's oscillating slower.

1:01:30

It has lower frequency, which means it gets  shifted towards the red part of the spectrum.

1:01:35

The word that we use is  redshift, gravitational redshift.

1:01:39

It's redshifted: lower frequency,  and therefore less energy.

1:01:43

If you send one photon up, the energy  of the photon is given by the frequency.

1:01:48

It'll arrive at me more redshifted and with  lower energy than it had when it left you.

1:01:56

Conversely, if I am up here, and I send you  a photon generated by the sodium transition, as observed by you, by the time the  light reaches you—you see me moving in fast-forward—you think that it has a higher  frequency than I thought it had when it left me.

1:02:16

It's moved towards the blue part of the spectrum.

1:02:16

We say that it is blueshifted.

1:02:23

So this thought experiment tells you that knowing  the exchange rate for how time passes at different altitudes directly gives you the exchange rate for  how much energy is worth at different altitudes.

1:02:41

If you try to send me some energy, by the time  it reaches me, it's worth less to me than you perceived it as being worth to you.

1:02:46

The amount it's less by is going to be precisely given by the same square root  formula that's controlling everything else.

1:02:57

So that gives us our third equation.

1:02:57

The third formula says: suppose that you, Dwarkesh, have an object of mass, mc², sitting  with you at this fixed radius down there.

1:03:10

How much energy, as measured by me a long way  away from the black hole, is that worth to me?

1:03:18

Of course, if I had it with me, it  would be worth mc² worth of energy.

1:03:22

But I don't have it with me.

1:03:22

It's unfortunately sitting with you deep in a gravitational potential.

1:03:25

So it's worth less than mc² to me.

1:03:30

In fact, it's just the exact same formula.

1:03:30

The amount of energy that it's worth to me, by the time it reaches me, is GM/(rc²).

1:03:34

There are a couple of ways to see that.

1:03:41

One is the way that we just said.

1:03:41

Suppose you take your object of mass m.

1:03:47

It's just half an Avogadro's  number of carbon atoms and half an Avogadro's number of anti-carbon atoms.

1:03:53

One way you could send me the energy is by smashing them together, a violent explosion.

1:04:02

You convert all of that energy to light and you try to beam that light energy up to me.

1:04:06

But what you find, precisely because of this gravitational time dilation, is by the time  it reaches me, I'm not getting mc² worth out.

1:04:17

I'm getting, by the argument we  just gave, less than mc² worth out.

1:04:20

I'm getting 1-GM/(rc²) out.

1:04:20

Mass down  here suffers this redshifting as it goes up and has less energy by the time it  reaches infinity than it did to begin with.

1:04:33

There is another way that you could have got  the energy to me, not by beaming it up as light, but by just taking your mass object, attaching it  to the pulley, and having me pull the object out.

1:04:46

By the time I've pulled it out,  I've now got mc² sitting out here, a long way away from the black hole.

1:04:50

So I do have the full mc² worth of energy.

1:04:55

But to get it, I needed to pay.

1:04:55

What I needed to pay was precisely pulling it out of the gravitational potential.

1:05:00

So from that way of thinking about it, that's why I have less than mc² worth of energy  left, because I had to pay to pull it out of the potential in order to accrue that mass.

1:05:11

So this formula tells you: if I have a brick of mass, mc², sitting at some radius r away from  the black hole, how much energy can I extract from that brick if I'm a long way from the black hole?

1:05:24

If we know that formula, then we can in fact calculate exactly this formula: how  much energy have I extracted from the brick by lowering it down to a radius r?

1:05:38

Well, we know the answer to that question.

1:05:43

The energy it started with is mc².

1:05:43

The energy it now has is this.

1:05:50

So the energy I've extracted from the brick  while slowly lowering it down using my pulley system must be the energy I started  with, mc², minus the energy it now has.

1:06:01

In other words, the fraction of the  energy that I've extracted by lowering it down to a radius r is mc² minus this,  all divided by mc²: 1 - √(1 - 2GM/(c²r)).

1:06:27

This is the exactly correct answer for  the fraction of the energy extracted.

1:06:31

It doesn't look exactly like this, because  this is only correct in the Newtonian limit.

1:06:35

We derived this using Newtonian physics.

1:06:35

This is exactly correct, not just in the Newtonian limit, but all the way to where the  effects of general relativity are important.

1:06:46

Now, if you're a very, very long way  away from the black hole—r is much, much bigger than 2GM/c²—then you  can Taylor-expand this formula.

1:06:55

The first order term is just  the old Newtonian formula. It better be.

1:06:58

It better be that the long-distance  limit of general relativity recovers the Newtonian physics that we originally discovered.

1:07:03

But as you get closer and closer to the black hole, this starts to deviate from the Newtonian  answer, in a way that exactly is going to end up resolving our original thought experiment to do  with lowering a brick down towards a black hole.

1:07:17

So how much, then, looking at this  formula, have I extracted from the brick as I lower it down towards the black hole?

1:07:24

If r equals infinity—if the brick's still a long way from the black hole—then I've extracted 1-1=0.

1:07:32

I haven't extracted any energy.

1:07:39

As I lower it closer and closer to the black  hole, initially I just get the Newtonian formula.

1:07:46

So in fact, these are pretty close to  correct in general relativity as well, because the corrections are only going to start  getting large when this term becomes order one, and it's still very small here.

1:07:56

So these are all essentially correct.

1:08:00

But once I get closer and closer to the  black hole, they stop being correct.

1:08:04

What I see is that as r approaches  the black hole event horizon, as this formula goes to zero, I have extracted  exactly all of the energy from the brick.

1:08:18

So I start off with a brick a very, very long way  from the black hole, attach it to a rope, slowly lower the brick down towards the event horizon.

1:08:25

Of course, I can't lower it past the event horizon, otherwise I'll lose control of the brick.

1:08:30

But I lower it right above the event horizon—the last possible place I can lower it to—and  then just let go of it with zero velocity.

1:08:39

The brick falls into the black hole and I  have extracted the entire mc² that used to be in the brick in my pulley system out there.

1:08:45

So it exactly resolves this question we had.

1:08:52

Is it possible to extract  more than mc² from the brick? No.

1:08:55

Is it possible to extract the full  mc² from the brick using a black hole? Yes, it is.

1:09:01

That's actually pretty  neat, and why people talk about using black holes as power plants.

1:09:06

Most power plants today operate by burning chemical energy.

1:09:12

That is not very efficient.

1:09:16

You have to pay a factor of 10⁻¹⁰,  because chemical bonds are super weak compared to the rest masses of objects.

1:09:20

You're really only extracting a tiny fraction of the rest mass of the fuel that you're considering.

1:09:25

You can level up from there by going to nuclear energy, which instead of dealing with the feeble  electromagnetic bonds between atoms, starts to concern itself with the nuclear forces between  the protons and the neutrons within the nucleus.

1:09:45

So you can go up from about 10⁻¹⁰ to about  10⁻³ for fission, or 10⁻² for fusion.

1:09:51

But that's about as good as you can  go, even with fission and fusion.

1:09:55

Because even though you can extract  energy from the strong nuclear force, neither fission nor fusion changes the total  number of protons plus neutrons in your process.

1:10:05

The bulk of the energy—99% of the energy—is  stored not in the electromagnetic interaction, not in the strong interaction, but in  the rest mass energy of the protons and neutrons, something that neither chemical  reactions nor nuclear reactions can touch.

1:10:20

But gravity can touch them.

1:10:20

If I start off with a mass object of m, I can extract, up to quantum  corrections, essentially 100% of the rest mass energy that I've gone in with.

1:10:31

It is the most efficient possible power plant, because by building an apparatus like  this, in principle, I could extract 100% of the energy of whatever I started with.

1:10:40

I intuitively get how energy equals mass.

1:10:46

There's these chemical bonds.

1:10:46

Those  get dissolved, they release energy.

1:10:50

The thing weighs less if those bonds are released.

1:10:50

I even get that if the bonds between the protons and the neutrons are broken, that releases  energy and makes the thing have less mass.

1:11:00

But if something with protons and neutrons  is just slightly above the event horizon, is the interpretation that those protons and  neutrons stop existing right at that point?

1:11:12

What does it even mean for them to have  1% or 2% or 5% of their original mass? That's a great question.

1:11:19

It really becomes  relevant once you turn on quantum mechanics, which is beyond the scope of today's discussion.

1:11:24

Classically, the black hole just sits there forever.

1:11:28

So you can just say, "Well, what happened to the protons and neutrons?"

1:11:30

You say, "Well, they now live inside the black hole."

1:11:32

The number of protons plus neutrons is still conserved out there in the universe.

1:11:37

It's just you need to assign what's called a nucleon number to the black hole itself.

1:11:40

That's fine as far as it goes classically.

1:11:47

Quantum mechanically—way beyond the scope  of today's lecture—Hawking and Bekenstein discovered that black holes radiate away energy,  and eventually the black hole will be gone.

1:11:56

All of the energy, if you calculate it, ends up in  gravitons and photons and perhaps some neutrinos.

1:12:02

None of it, or almost none of it,  ends up in protons and neutrons.

1:12:05

So it is a very interesting fact,  once you turn on quantum gravity, that black holes eat nucleon number.

1:12:09

This thing that seems like it's conserved, at least perturbatively, both by  electromagnetism and by the nuclear forces, ends up being eaten by gravity.

1:12:19

People like to promote this—we're talking about quantum gravity now—to a  general principle that quantum gravity doesn't respect any global symmetries.

1:12:29

It doesn't respect nucleon number symmetry.

1:12:34

It doesn't respect any of these symmetries.

1:12:34

That's a whole other can of worms that we can open some other day.

1:12:38

I recently wrote this blog post where I speculated that sample efficiency during training  actually hasn’t improved that much over the last few years, and rather, we’ve just dramatically  improved and widened the data distribution.

1:12:51

I was having dinner with friends recently, and  then I had this idea of how you could get some empirical information on this question.

1:12:55

There’s  this nanoGPT speedrun where people compete to train Karpathy’s GPT-2 baseline to a fixed loss  with less and less compute.

1:12:59

The training data has frozen, so I wondered if the loss curves  over time of each record could tell you roughly how fast sample efficiency is improving.

1:13:09

So I pulled out my phone, dumped this idea into a voice note in the Cursor app, and went back to  dinner.

1:13:14

Then I got a notification about 15 minutes later: the Cursor agent had cloned the modded  nanoGPT repo, analyzed all the loss curves for all the records, and estimated that sample efficiency  had been improving about 2–5x every single year.

1:13:29

Of course, this is very naive and circumstantial  evidence, but it inspired me to start writing a full post with a friend where we investigate  this question using many different methods.

1:13:38

The friction really mattered here.

1:13:38

The  idea would have just floated away if I wasn’t able to kick off the investigation  right then and there with the Cursor app.

1:13:44

If you want to try Cursor’s iOS  app, go to cursor. com/Dwarkesh. Okay, Adam.

1:13:50

I like to think on  this podcast we impart not only theoretical but practical knowledge as well.

1:13:52

So suppose one learns all these equations, but then finds themself in the unfortunate  position of falling into a black hole. What would they see? Great question.

1:14:02

There are actually two different perspectives you could take.

1:14:07

One is the perspective of me watching you falling into the black hole.

1:14:11

The other is the perspective of you falling into the black hole.

1:14:15

Those two perspectives are consistent with each other but interestingly different,  so maybe I should describe them both.

1:14:22

First, let's ask the question: what do  I see as you fall into the black hole?

1:14:28

This is how hard you need to fire  your rocket to not fall into the black hole but you’re not going to do this.

1:14:32

You're just going to sit here a long, long way away from the black hole, turn  off your rocket, and accept what comes.

1:14:40

What comes is you'll slowly accelerate towards the  black hole, at a rate first given by the Newtonian formula and then, when you get close to the  black hole, start picking up general relativity corrections to the Newtonian inverse-square law.

1:14:52

What I will see as I watch you fall towards the black hole is that first you'll go faster  and faster and faster as you fall down the gravitational potential of the black hole.

1:15:02

But then something strange will happen.

1:15:09

You'll stop going faster, and  you'll start going slower.

1:15:12

The reason you're going slower is that, as  I watch you, you start to get gravitational time dilation as you fall down, and I  start to see your clock running slow.

1:15:24

The static formula doesn't apply exactly  since you're moving, but the formula has the same effect, which is that as you get closer  and closer to the black hole, your wristwatch starts running slower and slower and slower.

1:15:36

In fact, if you do the appropriate integral, I never see you cross the event horizon.

1:15:40

I just see you getting closer and closer to the event horizon, but slowing  and slowing as you approach it.

1:15:50

As I watch you—I'm presumably using light to watch  you—that light gets more and more redshifted.

1:15:55

The wavelength gets longer and longer,  and the longer the wavelength of light, the harder it is to even really see you.

1:15:59

You start getting delocalized by the wavelength of the light, and eventually  I just stop seeing you entirely.

1:16:07

There's a final photon that you emit, and then  you just fade to black, fade through red to black.

1:16:13

I never see you cross the event horizon.

1:16:13

This was noticed by people in the early days of general relativity and greatly confused them.

1:16:20

They started to think that you would experience something funny yourself as you  fell across the event horizon. That is not true.

1:16:29

If I instead adopt  your perspective, from your point of view, your clock isn't running slow.

1:16:35

It's running at one second per second.

1:16:38

If you look back at me, there's some funny stuff  going on to do with me running fast perhaps.

1:16:42

But as far as you're concerned,  everything's totally normal.

1:16:46

You accelerate towards the black hole,  getting faster and faster as you approach it.

1:16:51

You just sail across the event  horizon totally as normal.

1:16:55

The event horizon is not a  particularly violent place for you.

1:16:58

You can calculate the tidal forces as you  approach and then cross the event horizon.

1:17:06

They're not particularly big, or rather, for  large black holes, they're not particularly big.

1:17:09

For a solar mass black hole, they would  be pretty big and would be pretty painful.

1:17:14

You'd find that your feet are being  attracted to the black hole much more vigorously than your head is, because they're  closer, and you end up getting stretched.

1:17:22

But if I take a big enough black  hole, you wouldn't notice anything funny happening whatsoever.

1:17:25

The bigger the black hole, the smaller the tidal effects.

1:17:31

If I took a black hole the mass of the galaxy, you'd be basically  fine as you cross the event horizon.

1:17:39

If I took an even bigger black hole than  that, you could live out your entire life having crossed the event horizon, before  you hit the singularity, which is fatal.

1:17:51

When you cross the event horizon, you are doomed.

1:17:51

You are doomed because once you cross the event horizon, you must proceed to the singularity.

1:17:58

There's no way you can fire a rocket to stop yourself hitting the singularity.

1:18:02

You are doomed, but you are not dead.

1:18:07

You are only for sure dead once you hit  the singularity and get spaghettified, mangled by the tidal forces.

1:18:12

But for a large enough black hole, you can be doomed and not even know it.

1:18:15

The event horizon is really a not locally measurable quantity.

1:18:21

It is a teleological fact.

1:18:24

It says that once you have crossed the event  horizon, you must proceed to the singularity.

1:18:29

But it can take a long time to get  there for a large enough black hole.

1:18:33

In principle, for a black hole that  was many light centuries across, you could live out your entire life.

1:18:41

You could have descendants, all of whom live inside the black hole.

1:18:43

Only once you really approach the singularity do the tidal forces get strong and kill you.

1:18:48

As you were saying, GR explains or predicts a lot of phenomena.

1:18:54

Some we think are correct, some we don't know are correct.

1:18:57

Why do we think black holes are correct but not wormholes? That's a great question.

1:19:00

People did not believe it to begin with.

1:19:03

Schwarzschild wrote down his solution almost immediately after  Einstein wrote his field equations.

1:19:08

People thought that that equation was  sick in some way, that it was a measure zero thing that would never happen.

1:19:11

It was some mathematical monstrosity, but it was impossible to make black  holes naturally in the real universe.

1:19:20

They were wrong, because black holes do exist.

1:19:20

We're extremely confident now.

1:19:20

There were theoretical developments, and there was  experimental evidence that black holes exist.

1:19:29

The biggest theoretical development was Penrose,  and then later Hawking and Penrose—for which he won the Nobel Prize—who showed theoretically  that the formation of black holes is a generic feature of general relativity.

1:19:40

It's not just some sick thing that happens if you fine-tune the initial conditions.

1:19:44

If you start off with generic initial conditions, the development of black  holes is a generic feature.

1:19:52

That was a huge development.

1:19:52

Then there was the experimental side.

1:19:55

The pieces of experimental evidence  we have for black holes are now huge.

1:20:00

They did not exist in Einstein's  day, and for 50 years after Einstein, people were extremely confused about  black holes and thought they didn't exist.

1:20:06

But there are numerous pieces of evidence.

1:20:06

I think the most visually appealing piece of evidence is just observing  the center of our galaxy.

1:20:16

If you look at the center of the galaxy—spoiler  alert—there is a black hole there.

1:20:21

We call it Sagittarius A*.

1:20:21

It’s a huge black hole, weighing many millions of times the mass of the sun.

1:20:24

You can't see the black hole directly, because it's black.

1:20:31

What you can see is the stars around it.

1:20:35

If you watch these stars over the course of  decades—and we now have a number of decades of observations of them—you will see the stars not  moving along what we would call straight lines, but instead moving in nice little  ellipses, or precessing ellipses.

1:20:52

Those ellipses look like  they are orbiting something.

1:20:56

You cannot see the something, but you  can see the stars that are orbiting it.

1:21:01

You can calculate how big  it is, how massive it is.

1:21:05

What you find is that it's very massive  indeed, and it's also very small indeed.

1:21:09

You know it's small because the stars get super  close to it but don't seem to collide with it.

1:21:14

So by tracing these orbits, you can tell  that there is something super heavy, super dark, and super compact  at the center of the galaxy.

1:21:22

That is Sagittarius A*, the black  hole at the center of our galaxy.

1:21:26

That's one compelling piece of evidence.

1:21:26

Another piece of compelling evidence: about a decade ago, we not only  saw black holes, we felt them.

1:21:34

LIGO is this huge laser interferometer that we  built at a number of different sites, that is super attuned to vibrations in spacetime itself.

1:21:42

There's a famous event pretty much immediately after we turned it on in late 2015,  where we felt spacetime shaking.

1:21:54

You knew it was spacetime shaking, not  just the Earth shaking, because we had a bunch of these detectors—then two, now  four—at different points on the Earth, and they all shook in exactly the same way.

1:22:05

So it couldn't just be explained by a truck passing one and not the other, or a  seismic event on one and not the other.

1:22:12

They all shook in exactly the same way,  and we were able to back-calculate that the thing causing them to shake was the  collision of two ginormous black holes.

1:22:21

Two black holes, both of which weighed about 30  times as much as the sun, on the other side of the universe, about 1.

1:22:25

6 billion light-years away.

1:22:25

That collision happened about 1.

1:22:25

6 billion years ago, and just happened to reach the Earth within  weeks of us turning on the LIGO detectors.

1:22:37

We've now felt thousands of such shakings  corresponding to thousands of black hole mergers.

1:22:44

And then there's more evidence.

1:22:44

Later, we had what's called the Event Horizon Telescope, which is a ginormous conglomeration  of radio telescopes all over the Earth, that were able to look very closely at the black  hole at the center of our galaxy, Sagittarius A*, and the even bigger black hole at the center of  our neighboring galaxy, and see, very faintly, the radio emissions of matter falling into these black  holes, which shines super brightly as it does so.

1:23:16

So we felt them, we've seen them, and we've seen  their gravitational effects on orbiting stars.

1:23:22

We're extremely confident at this  stage that black holes exist.

1:23:26

It's so beautiful that not only can a single mind  come up with this theory, but the theory has so much reach, and that we can come up with the  machinery to evaluate and perturb and understand its implications in so many different wild ways.

1:23:36

It's crazy the number of degrees of freedom, the number of orders of magnitude that it covers.

1:23:43

You first start thinking about it by doing thought experiments to do with jumping up and down in  elevators, and then it reaches out to describe the orbit of Mercury and detectable perturbations  of orbital dynamics within the Solar System, and then the bending of light, and then it  describes the rotation of the entire galaxy, and then it describes the expansion and  potential fate of the entire universe.

1:24:10

That's many orders of magnitude indeed,  and it's pretty impressive that it was the work of almost a single mind.

1:24:14

Frankly, our universe should be honored to be described by such a beautiful theory.

1:24:19

Can you tell the story of how GR went from a theory that Einstein had to something  that the world came to believe is true?

1:24:28

That would be the bending of light.

1:24:28

There were known anomalies with Newton's physics beforehand, like we couldn't  get the orbit of Mercury exactly right.

1:24:38

One of the very nice early tests of  general relativity is that it did get the orbit of Mercury exactly right.

1:24:42

So that was a pretty good confirmation.

1:24:46

But at the same time, that's not quite so  satisfying because it was a number that's already known, as opposed to one where you  invent a theory and then it correctly predicts.

1:24:53

It's considered more impressive if you  get the right answer without knowing what the right answer is in advance.

1:24:58

So that would be the bending of light.

1:25:01

Certainly, historically, that  was the most influential.

1:25:05

According to general relativity, all energy  gravitates and all energy is affected by gravity.

1:25:12

So light, as it's passing a massive object  like the Sun, will get bent in the direction of the Sun.

1:25:17

Actually, the same will happen in Newtonian physics.

1:25:18

Suppose you have a particle going along.

1:25:27

You know how much it gets bent as  it passes the Sun, depending on its impact parameter, but also its velocity.

1:25:30

The faster it's going, the less it gets bent.

1:25:34

So you just take that Newtonian formula,  plug in velocity equal to speed of light, and see what answer you get.

1:25:39

You can get a certain amount of bending through Newtonian physics.

1:25:41

In general relativity, you can do the same calculation, and you actually  get double the Newtonian answer.

1:25:51

The slightly strange history of it.

1:25:51

Before he had finished writing down general relativity, Einstein had a prediction  based on his understanding of the equivalence principle for what this answer should be.

1:26:05

He wrote down the answer, and then in response to him and a number of other people  being interested in this, people were sending out expeditions to go and try and measure it.

1:26:13

I think the very first thing that he did was he phoned up the observatory and said, "Can you look  at distant stars behind the Sun and measure how light bends as it passes the Sun?"

1:26:26

This was the true theorist move, because I think the director of the Mount  Wilson Observatory said, "Absolutely not. We cannot do that.

1:26:35

If you point a  telescope at the Sun, you'll go blind.

1:26:37

If you point it just next to the Sun,  you'll just get washed out by the corona of the Sun and you won't see anything."

1:26:40

Except there's one time when you won't get washed out by the Sun, and that's during a total  solar eclipse, when the Moon blocks the Sun and you're able to see stars very close to the Sun  and measure the bending of the light behind them.

1:26:55

So during the 1910s, there were  a whole bunch of expeditions sent to measure the deflection of light.

1:26:59

They'd park out in the path of totality and look through telescopes at the stars right next  to the Sun and see if they moved in the sky, and if they moved, how much they moved.

1:27:13

I think the first one was in 1911.

1:27:18

They went to Argentina for an  eclipse, and everything's set up.

1:27:23

This is the problem with this thing.

1:27:23

You get there, all the way to Argentina, a very long way in those days, and then  it's just washed out by the clouds.

1:27:31

You don't see anything, and it's very frustrating.

1:27:31

The next one was a German expedition sponsored by the arms manufacturer Krupp, who went to  the Crimea and tried to measure it there.

1:27:47

Just before the solar eclipse happens, World War I  breaks out, and now Germany and Russia are at war.

1:27:54

They're all arrested and turned for the  rest of the war, and so that also fails.

1:28:00

It actually turns out to be a good  thing for Einstein that they all failed.

1:28:03

It turned out that Einstein's original equivalence  principle argument—before he had full general relativity—was wrong and led him to predict that  the bending of light in general relativity would be the same as it was in Newtonian physics.

1:28:17

During the war, while everything is shut down and no one is thinking about eclipse  expeditions, he corrects this mistake and comes up with a new prediction that actually  it'll be double the Newtonian prediction.

1:28:30

And then in 1919, Sir Arthur Eddington  launches a British expedition to go and observe the eclipses all over the world and  successfully comes back and declares that indeed it was the Einstein prediction.

1:28:41

It was double the Newtonian prediction.

1:28:47

That's really what launches  Einstein as a global celebrity.

1:28:50

This British experiment confirming a German-origin  theory was part of the post-war reconciliation, and Einstein had figured out everything.

1:28:58

That is, I'd say, the point at which general relativity became the consensus view, and people  were super convinced by this very impressive test.

1:29:10

Nowadays, we've done hugely more tests  than that, very precise orbital dynamics.

1:29:16

You can see it in the orbit of Mercury  and indeed even in the other planets.

1:29:20

You can just measure the redshifting  of light as it goes, the gravitational effect on the propagation of light or  the energy of light, all over the place.

1:29:28

But historically, that was the most  impressive confirmation of general relativity.

1:29:33

One question you could ask is, we  are maybe spending, as a society, billions, maybe tens of billions of dollars  on building these huge physics experiments.

1:29:42

If you look at maybe the most beautiful, the  most important theory of physics ever conjured, it seems like a guy who's just thinking in a cave.

1:29:49

It seems like the empirical basis for that theory is maybe knowing that light has a speed, and  maybe you need to measure G experimentally. Not really.

1:29:57

G is a free  parameter in general relativity. It's not required.

1:30:01

You're right,  the empirical basis is pretty thin.

1:30:07

You don't need much, and theoretical  physicists are pretty cheap.

1:30:12

There's a great temptation.

1:30:12

Why don't we just  spend it all on theoretical physicists and not build these vastly expensive experiments?

1:30:16

Well, these AI companies are really increasing the demand curve for theoretical physicists.

1:30:22

That's right, not so cheap anymore.

1:30:28

But how far can that get you?

1:30:28

I would say that general relativity is perhaps one extreme of that.

1:30:31

That is not how it usually works in the history of physics.

1:30:37

This really is closer to some Ayn Rand hero just sitting alone, the product of a single mind.

1:30:45

He got a lot of help in various ways, but it really was a singular  vision that he pursued for years.

1:30:57

He wrote it down, and a lot of people  were very impressed almost immediately.

1:31:01

It did require launching a somewhat  expensive eclipse expedition to go confirm it before he really achieved global  celebrity and most people were sold on it.

1:31:11

But it's perhaps one of the most extreme examples  of this, where somebody just sits down and thinks very hard and writes down a true theory.

1:31:18

In some sense, physics has been chasing that high ever since.

1:31:23

People love that romantic vision of themselves just sitting down with very  few empirical insights and thinking very, very hard and doing thought experiments.

1:31:32

It's typically not worked out quite as well for everybody else as it worked out for Einstein.

1:31:37

In fact, it didn't even work out that well for Einstein in the later part of his career.

1:31:41

How far could you get just by thinking?

1:31:48

What do you need to do general relativity?

1:31:48

You need the finiteness of the speed of light.

1:31:52

You need to convince yourself not just  that the speed of light is finite, but that there's the symmetry that protects that,  which Einstein came up with in special relativity.

1:32:01

Then you probably want the equivalence  principle: it's an empirical fact that the inertial mass and the gravitational  mass are the same for everything.

1:32:09

But that's pretty sparse.

1:32:09

From just those two things… There's still a few options.

1:32:13

But if you have lots and lots of large language models and there's only a  limited number of options, you can just explore the entire tree and say, "Okay, focus on this.

1:32:21

The equivalence principle is something that's super significant, and this other thing.

1:32:26

Now abandon simultaneity and see how far that takes you."

1:32:31

There's only a finite number of things to explore there.

1:32:33

I think they got very, very lucky with general relativity, that it's quite  so powerful under those circumstances.

1:32:43

But if you just had lots and lots of Einsteins  and you gave each of them various options, you could presumably see them in parallel.

1:32:50

At the frontiers of physics today, in your experience, does it feel like if you  just have millions of them running autonomously you could have enormous discoveries, or  are we in a different era now, and really there's limited usefulness of that parallelism?

1:33:06

I think there is usefulness.

1:33:09

I do think that different parts of science  have different branching fractions, and how much experiment you need to cut off that branch.

1:33:14

I talked about chasing the high of Einstein.

1:33:22

Arguably, string theory has  really been going all in on that.

1:33:26

Einstein's theory is just general relativity.

1:33:26

There's also quantum mechanics.

1:33:26

Trying to marry those two in a consistent way—which  general relativity doesn't do at all, there's no quantum mechanics in general  relativity—has motivated a lot of people.

1:33:39

The problem is that in order to see that in  experiments, if you just do the dimensional analysis, you need ginormous particle colliders,  absolutely galactic-sized particle colliders.

1:33:48

It's just very hard to see any of that stuff.

1:33:48

But that doesn't stop people.

1:33:54

I mean, it stopped many people, but many  people didn't stop and keep trying to do it.

1:33:58

So there you just have to hope that it works  out sort of like it did with general relativity, where just by thinking very, very hard  with minimal input from experiment, you can feel your way to the right answer.

1:34:10

For that to be true, the tool you have at your disposal is mathematical consistency and  whether it reduces correctly in the known limits.

1:34:24

So you better hope that there's only one or  a very small number of possible consistent theories if you were going to do that.

1:34:30

If it turns out that there's an unlimited number of consistent theories, you're never  going to feel your way to the correct answer, because they're all consistent, and  the only tool you have is consistency, and perhaps some notion of aesthetics.

1:34:42

But if there's only a few, then maybe you could do it all the way.

1:34:47

So string theory has kind of gone all in on that, I would say.

1:34:49

Trying, with minimal experimental input, believing that there's only one consistent theory  of gravity and that just by doing sufficient consistency checks you can find it.

1:34:57

For other examples it's much harder.

1:35:04

In condensed matter physics, often  you simply need to go and do an experiment to find out which one is correct.

1:35:08

Whenever our future AI civilization does come up with more and more unified theories of physics,  or deeper theories that make better predictions, do you think that humans will be able to keep up?

1:35:18

Once this step is taken, will we actually be in a position to understand what  our AI civilization understands?

1:35:31

I don't know that we're going to be able to keep  up entirely, but I think we'll keep up much better than pessimistic forecasts would suggest.

1:35:36

Let's take mathematics as a simpler example than physics.

1:35:41

Many mathematicians are worried that these LLMs are just going to turn into proof machines.

1:35:47

Terry Tao has this phrase, "indigestion", he uses, in which these LLMs will produce billion-line  inscrutable Lean code that will serve as a certificate that a particular theorem is  true without providing any insight as to why that might be true.

1:36:05

Wouldn't that be a depressing world, say the mathematicians.

1:36:09

I think that is a possible future, but I actually don't find that to be a very likely future.

1:36:13

Because as well as being superhuman provers, we also expect these large language  models to be superhuman explainers.

1:36:24

Maybe they'll do the exact opposite of that.

1:36:24

Maybe they'll take proofs that are very hard to understand, and by doggedly trying and  trying and trying, they will be able to come up with ways that are human comprehensible.

1:36:34

They will take proofs that are difficult to understand and make them easy to understand.

1:36:41

I think the empirical evidence, it's early days, but it's pretty supportive  of that more positive vision.

1:36:52

There was an Erdős problem that was  proved a few months ago now, and it wasn't just an incomprehensible set of Lean.

1:36:57

In fact, it wasn't even proved in Lean at all.

1:37:00

It was proved informally.

1:37:00

There was a follow-up  paper by some human mathematicians that took these new, human interpretable ideas that the machine  had come up with to prove this Erdős conjecture, and used them to prove new theorems.

1:37:10

So that was the exact opposite of that case.

1:37:16

It came up with a very human interpretable idea,  and then humans were able to fully comprehend it, comprehend it so well they were  able to deploy it in a new scenario.

1:37:26

We've seen that throughout.

1:37:26

The unit distance  conjecture, I think, is a good example here for a number of the themes you've been discussing.

1:37:30

One is that it's totally comprehensible, the disproof of the unit distance  conjecture that it came up with. To you, perhaps. To some mathematicians. I'm not a mathematician.

1:37:44

Perhaps the reason that humans haven't disproved  the unit distance conjecture is because they erroneously believe the conjecture to be true.

1:37:50

The good thing about large language models is that they're willing to push through that  barrier and just waste their time, as a human would understand it, trying to disprove a  presumed true conjecture and reach the other end.

1:38:04

So that's another aspect of large language  models that makes me pretty optimistic.

1:38:08

They just have extreme patience,  even for doing things that perhaps look like a low probability of success.

1:38:11

Adam, thanks so much for coming back on and doing this while you could  be building superintelligence.

1:38:19

You're explaining 100-year-old  physics, but it was very interesting.

1:38:22

It's a super fun subject.

1:38:22

I'm super happy to share it.