"we had actually created a snapshot of github's public code for what we call the arctic code vault right essentially this is up and like way in the northlands of finland there's a seed vault and we're ..."

"cool things ryan salva is vp of product at github where amongst other projects he incubated and launched github co-pilot which my opinion is one of the most magical products that you'll come across if..."

"conversation and so with that i bring you ryan salva if you're setting up your analytics stack but you're not using amplitude what are you doing amplitude is the number one most popular analytics solu..."

"amplitude.com to get started this episode is brought to you by athletic greens i've been hearing about eg1 on basically every podcast that i listen to like tim ferriss and lex friedman so i finally ga..."

"ryan welcome to the podcast thank you my friend i am genuinely very excited to be here lovely to geek out with you for a little while i'm excited as well we were chatting briefly before we started rec..."

"world to others and so i kind of i got started in software development and product management because i wanted to be in the business of creativity and like we're at a really really unique time in huma..."

"that could be that's right that's right github brand color so today your vp of product at github and before that you were a super senior product leader at microsoft and i'm always curious how that tra..."

"you know what's the order of a parameters that need to come into a particular api or hey what's the particular syntax in this thing that's supposed to do or oh i've got to create a bunch of like dummy..."

"what i'm most curious about and we're going to spend time on this is just like how a product like this comes to be at a larger company but before we get into that what's like the craziest story of som..."

"there are like there are so many of those i mean i'll just kind of give a couple of recent ones that um that i've heard so i was talking to one developer who was uh he's actually an educator and he's ..."

"that was a pretty cool reason one that i talked to that is very cool i didn't think about just education lever here just like making so much easier to learn to code not even just building code yeah i ..."

"one of the you know really magical pieces of copilot here is that that ai is collecting context of the application you're going into and so it can help you build that mental map and learn the code bas..."

"yeah yeah oh wow what a what a long and i don't know depending upon your point of view sorted or exciting story that is um so yes so microsoft and open ai have been collaborating for for quite a while..."

"clojure all of these are languages too in fact they're kind of nice from an ai perspective because they're relatively constrained in terms of their semantics right the the number of words and i put th..."

"what we did is just like the year before that we had actually created a snapshot of github's public code for what we call the arctic code vault right essentially this is up and like way in the northla..."

"well it turns out we can do some pretty cool things just like a translation tool that goes from english spanish spanish to german you can also go from english to python or python to c sharp we're like..."

"co-pilot as most developers experience it today that was now i want to say that was at least 16 months ago 14 16 months ago since then we brought it to developers as we just double click on that so yo..."

"to get a suggestion back when your entire goal is to stay in the flow and so we would run experiments to see like how many milliseconds are the right amount such that a developer doesn't feel like the..."

"idea and then they're like oh wow this is gonna work or is it always like we will bet on this thing this is such a big and great idea we're gonna invest resources for sure from the beginning yeah yeah..."

"actually turn into something meaningful is there a concrete definition of verizon two and three is it like number of years out like like amazon style not necessarily a concrete definition like for me ..."

"payment flows think digital wallets fiat crypto on-ramps ride-sharing marketplaces instant lending and more they work with high-growth companies like gusto pipe pass and marquetta modern treasury's ro..."

"definitely at github how we really contextualize it and not to say that there aren't teams at microsoft who might also kind of use kind of that methodology but where we've been really maybe explicit o..."

"new product experience team at facebook and google has one yeah i'm not sure how many successes have come out of these teams from what i've seen and i'm curious what have you and clearly you had a hug..."

"and also when you do get to you know a place where like that team has an idea that is clearly connected to like a representative set of customers who have a genuine problem and there is signal with at..."

"that's the time to start thinking about okay like let's actually put a little bit of um i'm gonna call this market testing it's nothing so formal as market testing it's really like let's start to actu..."

"customers are saying developers are saying this is magical this does something extraordinary that i could not do on my own that we started to think about okay how do we transition this over and so fro..."

"that process that took well we're actually still kind of at the tail end of it now here we are you know like i said roughly a year and a half after kind of the initial kind of creation of the of the p..."

"and a epd squad multiple epd squads actually are now taking the product forward and starting to respond to customer feedback to think about okay how do we now as a product team carry this road map for..."

"it needs to be based on a replacement in seat who's actually doing the job and has picked up all of the skills necessary and only then can the researcher move back so make sure that you've got continu..."

"the customer last i would say here is really that engineering fundamentals in a lot of ways are the contracts that differentiate an r d team from a operational product team and bringing that fundament..."

"it's going to feel a little bit unnatural to them and they probably won't have all the right skill sets in order to make that transition and so making sure that you've got a good mix of engineers who ..."

"ai candidly like i mean didn't we're getting a lot lot better at it especially in the last couple of years you know with things like dolly and co-pilot but it brings with it not only engineering chall..."

"talk to the ideas and you know make corrections that kind of thing well if copilot is your ai pair programmer and they're whispering crazy stuff in their ear and they're bringing politics into it or g..."

"like discussions with you and the legal team and i don't know like these ethical things are really tricky i imagine yeah how do you approach them like that as a product team it is conversations with a..."

"level it has to be done because otherwise you're going to create a bad developer experience yeah and and so you know often we would get feedback from developers of like hey this particular word was bl..."

"that a copilot would be like you would have to worry about it saying things that are uh that are crazy so that is wild that you guys have to deal with that and wasn't it was it a microsoft that had th..."

"it it does it like it enables even mediocre developers like myself to be able to do some pretty amazing things all right but where is it going like so first i think i hope it's obvious to most develop..."

"one is a problem that's very much of of our time in the world namely that supply chains have been disrupted dramatically over the course of the last years and it turns out that copilot for both traini..."

"where is ai stack is ai you know eventually going to be so back to your question about where will we be five ten years from now will it be writing ninety percent of the code we don't want copilot to b..."

"in so much more than esoteric uh armchair ponderings it's actually applicable to the real world maybe a final question before we get to our very exciting lightning round so just looking back at this w..."

"like the the allocation of time of focus energy and resources becomes a really challenging question the answer to which isn't always the same depending upon the time kind of world circumstances organi..."

"kind of my larger teams that works when you have larger teams though at startups you know where we were pretty much only a big bet obviously your percentage is getting very different and it becomes a ..."

"let's do it sound good okay uh what are what are two or three books that you recommend most to other people oh good question so one of them is a book on user experience called make it so it's a refere..."

"i love that reminds me of this book that is the interior design of dictators and they show you their like homes of like saddam hussein hitler and all these guys dude oh my gosh that's awesome i got i ..."