"Mark, thanks for coming on the podcast again. Yeah, happy to do it. Good to see you.  You too. Last time you were here, you had  launched Llama 3. Now you've launched Llama 4.  Well, the first version..."

"I'm also excited about the Behemoth model, which  is coming up. It's going to be our first model   that's sort of at the frontier — more than  2 trillion parameters. As the name says,   it's quite big..."

"negative in others, but overall good — is that  it’s not just Llama. There are a lot of good   ones out there. I think that's quite good. Then there's the reasoning phenomenon,   which you're alluding..."

"One of the things we've generally tried to do  over the last year is anchor more of our models in   our Meta AI product north star use cases.  The issue with open source benchmarks,   and any given th..."

"However you define it, that's what  a lot of the labs are going for.   But there's no doubt that different folks have  optimized toward different things. I think the   Anthropic folks have really focu..."

"I got a chance to play around with both Orion  and also the Meta AI app, and the voice mode   was super smooth. It was quite impressive. On the point of what the different labs are   optimizing for — ..."

"of different labs doing leading work in different  domains. Some will be more enterprise-focused or   coding-focused. Some will be more  productivity-focused. Some will be   more social or entertainme..."

"it's not just, “Okay, cool, the thing  can write code, and now all of a sudden   everything is just improving massively.” There are  real-world constraints that need to be overcome.   Then you need to..."

"So if you buy this view, that this  is where intelligence is headed,   the reason to be bullish on Meta is obviously  that you have all this distribution. You can   also use that to learn more things ..."

"different things. Imagine you were sitting  at the beginning of the development of the   internet and you asked, "What's going to  be the main internet thing? Is it going   to be knowledge work or mas..."

"Look at the evolution of things like Instagram  and Facebook. If you go back 10, 15, 20 years ago,   it was text. Then we all got phones with cameras,  and most of the content became photos. Then the ..."

"talking through difficult conversations they  need to have with people in their lives. "I'm   having this issue with my girlfriend. Help me  have this conversation.” Or, "I need to have a   hard conve..."

"So I think a lot of these things — things that  today might have a little bit of stigma around   them — over time, we'll find the vocabulary as  a society to articulate why they are valuable,   why th..."

"at the breakfast table and on the periphery of my  vision is just a bunch of Reels that are scrolling   by. Maybe in the future, my AI girlfriend is on  the other side of the screen or something. So  ..."

"It's a real competition. You're seeing industrial  policies really play out. China is bringing online   more power. Because of that, the US really needs  to focus on streamlining the ability to build ..."

"So the Llama 4 models, when you compare them  to what DeepSeek is doing, are good. I think   people will generally prefer to use the Llama  4 models. But there’s this interesting contour   where it’s ..."

"So Sam Altman recently tweeted that OpenAI is  going to release an open-source SOTA reasoning   model. I think part of the tweet was that they  won’t do anything silly, like say you can only   use it ..."

"Now, if the whole open-source part of the  industry evolves in a direction where there   are a lot of other great options and the license  ends up being a reason why people don’t want to   use Llama, ..."

"have to deal with the model architectures.  And they make different size tradeoffs that   affect latency and inference cost. At the scale  that we operate at, that stuff really matters.  We made the L..."

"if it's dabbling, or fundamental for them the  way that it has been for us. A good example is   what's going on with Android. Android started  off as the open-source thing. There's not   really any op..."

"it's important that the standard gets built around  American models like Llama. I wanted to understand   your logic there. With certain kinds of networks,  it is the case that the Apple App Store just..."

"Reasoning, I guess, you could say has values too.  But one of the nice things about reasoning models   is they're trained on verifiable problems. Do you  need to be worried about cultural bias if your..."

"This is the beauty of distillation. It's one of  the things that I think has really emerged as a   very powerful technique over the last year, since  the last time we sat down. I think it’s worked   b..."

"That's something I'm pretty confident about and  something we've done a lot of research around.  But I think this is a very big question. How  do you do good distillation? Because there’s   so much va..."

"That just speaks to the diversity of  different things that need to get created.   There are going to be business models at  each point along the spectrum. At Meta,   for the consumer piece we definit..."

"Then there are a bunch of questions like, “do  you want the thread for Meta AI in WhatsApp   to feel like other WhatsApp threads, or do you  want it to feel like other AI chat experiences?”   There ar..."

"specific models that we design, to have the kind  of size and latency parameters that they do.  Speaking of politics, there's been this  perception that some tech leaders have been   aligning with Tru..."

"made were in the context of content moderation.  It's been an interesting journey over the   last 10 years on this. It's obviously been an  interesting time in history. There have been novel   questio..."

"a week? What are you doing in that hour? I don't know. Every week is a little bit   different. It's probably got to be the case  that the most leveraged thing you do in a   week is not the same thing ..."

"What would be possible if, say, software  productivity increased like 100x in two   years? What kinds of things could be  built that can't be built right now?  What kinds of things? That's an interest..."

"This isn't the 1-2 year thing of what happens when  you have a super powerful software engineer. But   over time, if everyone has these superhuman  tools to create a ton of different stuff,   you're g..."

"If you think about it, the Meta social  media view of the world is that yeah,   people are going to spend a lot more time doing  that stuff in the future. It's going to be a lot   better, and it's goi..."

"seriously been able to contemplate having  voice support where someone can just call in.   I guess that's maybe one of the artifacts  of having a free service. The revenue   per person isn't high enou..."