"all right hello everyone okay okay Sarah you're the queen of AI investing this is a phrase never ever to be used again but it's great to be here with both of you um so I had two different ideas for ou..."

"from you both anyway uh so this is actually a relatively new role for both of you Kevin let's start with you like you've done a bunch of really different interesting things like what was the reaction ..."

"so interesting uh and fascinating to see on the inside as AI gets developed but uh I've been having a blast Mike what about you I I remember hearing the news I was like oh I didn't know you could conv..."

"next um so we had dinner together with a bunch of friends recently and you I was like impressed by the childish Delight that you had around like yeah I'm learning about all this Enterprise stuff like ..."

"like the part that is fun is actually getting the feedback in the kind of Engagement where you're like once it gets the deployed you have somebody that can call you and you can call them and be like h..."

"works you know when you have when you have a sense of the product you're trying to build you know we're getting towards uh you know the end of shipping uh Advanced speech mode or something or you're g..."

"or 90% good or 99% good and the product that you would build that would make sense with something that works 60% of the time is Super different than 90 or 99% of the time right so you're kind of just ..."

"true with campus right like you're doing a like co-design co- research co- finetune and that's like I think a real privilege of getting to work at this company and getting to do design there and then ..."

"like GitHub co-pilot right that was kind of the first AI product that really open people's eyes to like this thing can be useful not just as you know Q&A but for really economically valuable work and ..."

"also find that 60% this magic 60% number like it's kind of lump I made it up five minutes ago that was a takeway 6% that is our new that's the Mendoza Line of uh of AI like I think it's often very lum..."

"in which models today are not intelligence limited they're eval limited yeah they can actually do much more and be much more correct on a wider range of things than they are today and it's really abou..."

"task and like 85% of task if you come interview at anthropic which maybe you should uh at some point maybe you're happy in your R maybe not um uh you'll see one of the things we do in our interview pr..."

"prompts and so like that PM like definition is definitely just mer now yeah absolutely I we we set up a boot camp and like took every PM through uh writing evals and like what it was like difference b..."

"again a little inside baseball you know like every model release has the model card and some of these model uh these eiles we've seen like even the golden answer I'm like I'm not sure a human would sa..."

"again I think a lot like when you think about and I think both Labs have some concept of like this is what capabilities look like as things evolve like it looks a little bit like a career ladder like ..."

"would also I you you sort of said this but I think it's also going to push PMS to go deeper into the tech stack yeah um because it's and maybe that changes over the years like that if you were doing l..."

"non-deterministic user interface ourselves uh and certainly people who are not you know tech people here in this room working on Tech products who are using AI are are definitely not used to it like i..."

"happening actually faster than that right and you know if if PMs and Technical people don't have that much intuition naturally for how to use them how do you think about educating end users at the sca..."

"changing is just tell Claude more about itself which was like you know it's in its training set that it's you know uh artificial intelligence created by anthropic whatever but now we're literally like..."

"usually power users internally and they're they're excited to teach the rest of people and you know like with open AI we have these custom gpts that you can make and organizations make thousands of th..."

"how do we do this as well the funniest use case like while we were beta testing it was like somebody was like I wonder if I can get it to order us a pizza and like it did and they're like great there'..."

"I talk about computer like can we automate the drudgery so you can focus on the creative stuff and not like the you know 30 clicks to do one single thing Uh Kevin I I think we have a lot of teams that..."

"like scaling pre-training concept you go gpt2 3 four five whatever and you're doing bigger and bigger runs on pre-training these models are getting you know smarter and smarter um like they or rather ..."

"you know we're at the like gpt1 phase of um of this new form of reasoning um but in the same way it's not you don't use it for everything right there are sometimes when you ask me a question you don't..."

"excited about on the product side yeah I completely agree with all of that that um and it's the models are going to get smarter at an accelerating rate I think which is also part of how all of that uh..."

"pocket you know and so experiences like that I think it's going to become commonplace fast but it's magical and I'm excited about that in combination with all the stuff Mike was just saying oh one of ..."

"revenge of the model and it's like they get the Nuance like it's like I guess the behavor behavior is like almost befriending or like really like developing a lot of like 2-way empathy around what's h..."