"Today I have the pleasure  of interviewing Shane Legg,   who is the founder and the Chief AGI scientist of  Google DeepMind. Shane, welcome to the podcast.  Thank you. It's a pleasure being here. Firs..."

"then for all practical purposes, you have an AGI. Let's get more concrete. We measure the   performance of these large language models on MMLU  and other benchmarks. What is missing from the   benchma..."

"The thing you're referring to with episodic  memory, would it be fair to call that sample   efficiency or is that a different thing? It's very much related to sample efficiency.   It's one of the thin..."

"whether it's about delusions, factuality, the  type of memory and learning that they have, or   understanding video, or all sorts of things like  that. I don't see any big blockers. I don't see   big ..."

"A lot of your earlier research, at least the  ones I could find, emphasized that AI should be   able to manipulate and succeed in a variety of  open-ended environments. It almost sounds like   a video..."

"obviously, because it exists in the world.  We know that human intelligence is very,   very powerful because it's affected the world  profoundly in countless ways. And we know if   human level intelli..."

"you need to do this. They basically have a  context window, which is very, very fluid,   of course, and they have the weights, which  things get baked into very slowly. So to my mind,   that feels lik..."

"At the time, did it stick out to you as  an especially fruitful thing to train for?  Well, yeah. In the sense what's happened  is actually very aligned with what I wrote   about in my thesis. The idea..."

"is that something that needs to be added  to LLMs where they can actually interact   with their data or the world or in some way? Yeah, I think that's on the right track. These   foundation models are..."

"I think it's fair to say we're roughly doing the  sorts of scaling and training that you see many   people in the field doing but we have our own take  on it and our own different tricks and technique..."

"fundamentally a highly ethical value aligned  system from the get go. How do you do that?  Maybe this is slightly naive, but this is my  take on it — How do people do it? If you have   a really diffic..."

"thing. When you sample from a foundation model  at the moment, it's blurting out the first thing.   It's like System 1, if you like, from psychology,  from Kahneman et al. That's not good enough.  And..."

"in terms of the behavior of these AGI systems.  And then what you do is you engineer the system   to actually follow these things so that every  time it makes a decision, it does an analysis   using a..."

"Do you have some sort of framework  for that at Google DeepMind?  This is not so much a Google DeepMind perspective  on this. This is my take on how I think we   need to do this kind of thing. There a..."

"I've been worried about AGI safety for a  long time, well before DeepMind. But it   was always really hard to hire people to work  on AGI safety, particularly in the early days.   Back in 2013 or so, ..."

"The impact that DeepMind has had: I guess we  were the first AGI company and as the first AGI   company, we always had an AGI safety group. We've  been publishing papers on this for many years. I   th..."

"I first formed those beliefs around 2001 after  reading Ray Kurzweil's The Age of Spiritual   Machines. There were two really important points  in his book that I came to believe as true. One is   tha..."

"And then the second thing was just looking at  the trends. If the scalable algorithms were to   be discovered, then during the 2020s, it should be  possible to start training models on significantly  ..."

"then. You often hit unexpected problems  in research and science and sometimes   things take longer than you expect. If we're in 2029 and it hasn't happened   yet, if there was a problem that caused i..."

"anything is just loads of great applications  for the coming years. There can be some misuse   cases as well. I'm sure somebody will come up  with something to do with these models that is   quite unh..."

"to scale the alignment to increasingly powerful  systems. I think things of that kind of flavor   have quite a lot of promise in my opinion,  but that's kind of quite a broad category.   There are man..."

"limits their applications in many ways. The final question is this. You've been   in this field for over a decade, much longer  than many others, and you've seen different   landmarks like ImageNet an..."

"a very narrow thing whereas now they understand  when you talk to them and they understand images   and pictures and video and you can show them  things or things like that. And they will have   much ..."