"the following is a conversation with Jeremy Howard he's the founder of fast AI a Research Institute dedicated to making deep learning more accessible he's also a distinguished research scientist at th..."

"experts this is the artificial intelligence podcast if you enjoy it subscribe on YouTube give it five stars and iTunes supported on patreon or simply connect with me on Twitter Alex Friedman spelled F..."

"the car well tempered as I say you know and basic on a Commodore 64 yeah where was the interest in music from or is it just I took music all my life so I played the phone and clarinet and piano and gu..."

"a brain that utilizes those that emerges with creative ideas so you've used and studied quite a few programming languages can you given an overview of what you've used one of the pros and cons of each..."

"loved relational databases but today programming on top of a relational database is just a lot more of a headache you know you generally either need to kind of you know you need something that connect..."

"pascal created by under sales berg who previously did to it by pascal and then went on to create dotnet and then went on create typescript delphi was amazing because it was like a compiled fast langua..."

"actually turned that into a programming language and because this was the early 50s although that's very late 50s although names were available so he called his language a programming language or APL ..."

"this path of programming languages it's just so much that are not so much more powerful in every way than the ones that almost anybody uses every day so though it's all about computation it's really f..."

"it's definitely not good enough what do you think the future programming looks like what do you hope the future programming looks like if we zoom in on the computational fields on data science on mach..."

"algorithm and it's just a huge problem and this happens all over the place so we hit you know research limitations another example convolutional neural networks which actually the most popular archite..."

"directions in the compiler technology so the place where that's particularly happening right now is something called ml ir which is something that ok I'm Kris lat know this rift guy is leading and bec..."

"vm there's all these various projects which are all about saying let's let people create like domain-specific languages for tensor computations these are the kinds of things we do are generally in on ..."

"you know it'll be so nice if we can get to that point that does it all eventually boil down to CUDA and NVIDIA GPUs unfortunately at the moment it does but one of the nice things about ml ir if AMD ev..."

"for their kind of enterprise class cards because there is no serious competition because nobody else is doing the software properly in the cloud there is some competition right but not really other th..."

"directly program the memory in a teepee you you can't even directly like create code that runs on and that you look at on the machine that has the GPU it all goes through a virtual machine so all you ..."

"meet that gap but I guess that maybe if we used deep learning for some of the analytics we could maybe make it so you don't need as highly trained doctors diagnosis diagnosis and treatment planning wh..."

"triage kind of on device so that if you do a you know test for malaria or tuberculosis or whatever you immediately get something that even a health care worker that's had a month of training can get a..."

"long time will they be able to have the expertise shortage of their sweeties okay and that's where the deep learning systems could step in and magnify the expertise they do exactly yeah so you do see ..."

"it's just to me that's not a useful way of framing the problem I guess just to clarify I guess I meant there may be some problems where you can avoid even going to the expert ever sort of maybe preven..."

"it's not you know it's fine why do you think we haven't quite made progress on that yet in terms of the the scale of how much AI is applied in the middle there's a lot of reasons I mean one is it's pr..."

"out but it's going to be a long process they regulators have to learn how to regulate this they have to build you know guidelines and then the lawyers at hospitals have to develop a new way of underst..."

"no they more want to not get in trouble for embracing the right but also it is also so slaves in a very abstract way which is like oh we've been able to release these hundred thousand and on most reco..."

"from data one of my areas of focus is on doing more with less data which so most vendors unfortunately are strongly incented to find ways to require more data and more computation so Google and IBM be..."

"to trust them to do things because nobody else can do it and Google's very upfront about this like Geoff Dana's going out there and given talks and said our goal is to require a thousand times more co..."

"the computation you have better so one of the things that we've discovered is or or at least highlighted is that you very very very often don't need much data at all and so the data you already have i..."

"collect data from everyone is like in the recommender system context where your individual Jeremy Howard's individual data is the most useful for freeing for providing a product that's impactful for y..."

"various workarounds to that like in a lot of music programs we'll start out by saying which of these artists you like which of these albums do you like which of these songs do you like Netflix used to..."

"places that they don't have to pay for them so when you actually see regulations appear that actually cause the companies that create these negative externalities to have to pay for it themselves they..."

"interesting tangent but to return back to uh the origin story of fast they act right so so before I started fast AI I spent a year researching where the biggest opportunities for deep learning because..."

"rather than me picking an area and trying to become good at it and building something I should let people who are already domain experts in those areas and who already have the data do it themselves m..."

"have so that yeah that was the thinking so so much a fast AI students and researchers and the things you teach are pragmatically minded right practically minded freaking figuring out ways how to solve..."

"do world-class work with less resources and less data and but almost nobody works on that or another example active learning which is the study of like how do we get more out of the human beings in th..."

"like 224 256 by 256 pixels you know why don't we try smaller ones and just elaborate there's a constraint on the accuracy that your training model is supposed to achieve yeah you got to achieve 93% I ..."

"multi-gpu or multiple machine training in general as as a way to speed code up I think it's largely a waste of time both multi-gpu on a single machine and yeah particularly multi machines because it's..."

"time and so now I'm starting to see some researchers start to use these holidays that's so deeply love the way you think because I think you might have written a blog post saying that sort of going th..."

"so like fetch norm well you drop out did you demonstrate to everyone of them yeah this is five multiple GPUs against the original Gans didn't require multiple ups well and and we've actually recently ..."

"done that and that feels like a learning problem alright so hopefully somebody can well I mean it's it's eminently doable and it should have been done by now I feel I felt the same way about computati..."

"like that yeah the data side how often do you work with data these days in terms of the cleaning looking at like Darwin looked at different species while traveling about do you look at data I have you..."

"thing we immediately do after that is we learn how to analyze the results of the model by looking at examples of misclassified images and looking at a classification matrix and then doing like researc..."

"yeah so yeah model looking at data particularly from the lens of which parts of the date of the model says is important is super important yeah and using kind of using the model to almost debug the da..."

"them so like that's the clear leader for me and where I would spend my time as a researcher and practitioner millington to the platform I mean we're super lucky now with stuff like Google TCP Google C..."

"on a link and you click start and and it's going it will you a go GCP I have to confess I've never used the Google DCP yeah JCP gives you three hundred dollars of compute for free which is really nice..."

"and everything you know about in Python is just going to work and we'll figure out how to make that run on the GPU as in when and necessary that turned out to be a huge a huge leap in terms of what we..."

"Python and particularly this problem with things like recurrent neural nets a where you just can't change things unless you accept it going so slowly that it's impractical so in the latest incarnation..."

"in a very disorganized way so like when you actually look in the code as I do it often I'm always just like oh god what were they thinking it's just it's pretty awful so I'm really extremely negative ..."

"this is taking so long yeah and also there's a lot of things which are just less programmable like TF data which is the way they do processing works intensive flow is just this big mess it's incredibl..."

"basil wing and the Swift community has a a total lack of appreciation and understanding of numeric computing so like they keep on making stupid decisions you know for years they've just done dumb thin..."

"years generally so for two months how many hours a day so I sound like a somebody who is a very competent coder can can do 70 hours per course and seventy seven zero yeah that's it okay but a lot of p..."

"usually except getting started and setting stuff up I would say coding just yeah I would say the best the people who are strong coders pick it up the best although another bottleneck is people who hav..."

"I I mean to see so many domain experts from so many different backgrounds it's definitely I wouldn't say taught me but convinced me something that I like to believe was true which was anyone can do it..."

"thing that matters the people a lot of people give up and but if the ones who don't give up pretty much everybody succeeds you know even if at first I'm just kind of like thinking like wow they're rea..."

"what's going on to get hooked do think you mentioned training do you think just running the models inference like if we talk about getting started no you've got to find cheering the models so that's t..."

"accuracy took me about four minutes to scrape the images from Google search in the script there's a little graphical widgets we have in the notebook that help you clean up the data set there's other w..."

"then study their inputs and outputs how much is fast there of course is free everything we do is free we have no revenue sources of any kind it's just a service to the community you're a saint okay on..."

"people particularly by combining it with your passion and domain expertise so that's really interesting even if you do want to innovate on transfer learning or active learning your thought is that mea..."

"thinks will then reach for anybody yeah I mean to me I would compare it to like studying self-driving cars having never looked at a car or being in a car or turn the car on right you know which is lik..."

"and save up some money beforehand so you can afford to have some time then just sticking with it it's one important thing doing something you understand and care about is important that by something I..."

"do you venture capital so did you were able to successfully run startups with was self-funded yeah my first two was self-funded and that was the right way to do it that's scary no species startups are..."

"server and when the server ran out of space I put a payments button on the front page and said if you want more than 10 makerspace you have to pay $10 a yeah and so run low like keep your cost down ye..."

"in yeah nevertheless is scary I mean yeah sure it's it's Gary before you jump in and I just I guess I was comparing it to this scariness of VC I felt like with VC stuff it was more scary you kind of m..."

"perfectly good outcomes so you're learning Swift now in a way I mean you were a writer and I read that you use at least in some cases spaced repetition as a mechanism for learning new things yeah I us..."

"your brain well so using like mnemonics and stories and context and stuff like that so yeah it's it's a super great technique is like learning how to loan is something which everybody should learn bef..."

"got into this but he started really getting excited about doing it for a lot of different things for me personally I actually don't use it for anything except Chinese and the reason for that is that C..."

"easy enough to look it up on google fit speaking Chinese you can't look it up on Google so do you have advice for people learning new things so if you what have you learned is a process does it I mean..."

"were still in there like yeah it was so much faster to relearn than it was to learn the first time yeah absolutely it's it's in there the same with with guitar with music and so on it's sad because th..."

"interesting question to even answer so in terms of societally important problems what's the problem well is within reached for it well I mean for example there are problems that AI creates right so mo..."

"there's all kinds of human issues which only data scientists are actually in the right place to educate people about but data scientists tend to think of themselves as just engineers and that they don..."