All Segments
MIT 6.S094: Deep Learning for Human Sensing
8 segments available
This is lecture 5 of course 6.S094: Deep Learning for Self-Driving Cars (2018 version). This class is free and open to everyone. It is an introduction to the practice of deep learning through the applied theme of building a self-driving car. OUTLINE: 0:00 - Intro 6:53 - Human Imperfections 22:57 - Pedestrian Detection 28:57 - Body Pose Estimation 35:40 - Glance Classification 47:13 - Emotion Recognition 53:24 - Cognitive Load Estimation 1:00:54 - Human-Centered Vision for Autonomous Vehicles INFO: Slides: http://bit.ly/2HbGuzx Website: https://deeplearning.mit.edu GitHub: https://github.com/lexfridman/mit-deep-learning Playlist: https://goo.gl/SLCb1y CONNECT: - If you enjoyed this video, please subscribe to this channel. - AI Podcast: https://lexfridman.com/ai/ - Show your support: https://www.patreon.com/lexfridman - LinkedIn: https://www.linkedin.com/in/lexfridman - Twitter: https://twitter.com/lexfridman - Facebook: https://www.facebook.com/lexfridman - Instagram: https://www.instagram.com/lexfridman - Slack: https://deep-mit-slack.herokuapp.com LINKS: Playlist: https://goo.gl/SLCb1y Lecture 1: Deep Learning - https://youtu.be/-6INDaLcuJY Lecture 2: Self-Driving Cars - https://youtu.be/_OCjqIgxwHw Lecture 3: Deep Reinforcement Learning - https://youtu.be/MQ6pP65o7OM Lecture 4: Computer Vision - https://youtu.be/CLOAswsxudo Lecture 5: Deep Learning for Human Sensing - https://youtu.be/Z2GfE8pLyxc Guest talk: Sacha Arnoud, Waymo - https://youtu.be/LSX3qdy0dFg Guest talk: Emilio Frazolli, nuTonomy - https://youtu.be/dWSbItd0HEA Guest talk: Sterling Anderson, Aurora - https://youtu.be/HKBhP9JISF0 2017: Guest talk: Sertac Karaman, MIT - https://youtu.be/0fLSf3NO0-s Guest talk: Chris Gerdes, Stanford - https://youtu.be/LDprUza7yT4
Segments Timeline
Intro
"today we will talk about how to apply the methods of deep learning to understanding the sense of the human being the focus will be on computer vision the visual aspects of a human being of course we h..."
Human Imperfections
"talk I like to talk about human imperfections and the various detection problems the pedestrian body pose glance and motion cognitive load estimation that we can use to help those humans as they opera..."
Pedestrian Detection
"where perhaps on the human sensing side it all began which is pedestrian detection decades ago to put it in con texe pedestrian detection here shown from left to right on the left is green showing the..."
Body Pose Estimation
"difficult task body pose estimation is also finding the joints the hands the elbows the shoulders the hips knees feet the landmark points in the image XY position that marked that those joints that's ..."
Glance Classification
"the most important things in driving is determining where drivers are looking it if there's any sensing that I advocate and is has the most impact in the driving context is for the car to know where t..."
Emotion Recognition
"emotion human emotion is a fascinating thing so the same kind of pipeline stabilization cleaning of the data raw pixels in and then the classification is emotion the problem with emotion if I may spea..."
Cognitive Load Estimation
"the eyes cognitive load is the degree to which a human being is accessing their memory or as Lawson thought how hard they're working in their mind to recollect something to think about something as co..."
Human-Centered Vision for Autonomous Vehicles
"examples of Chania neural networks can be applied and why is this important again is while we focus on the sort of the perception tasks of using neural networks of using sensors and signal processing ..."