Sacha Arnoud, Director of Engineering, Waymo - MIT Self-Driving Cars
Lex Fridman3 HN recommenders · recommended in 2 months, 2018–2023
lecture · intermediate · 2018–2023 on HN
Sacha Arnoud, Waymo's Director of Engineering, gives a lecture in MIT's 2018 deep learning for self-driving cars course on the rise of machine learning in autonomous vehicles. It covers how Waymo uses deep learning and how it handles tricky driving situations.
Pointed to during self-driving news threads as an insider view of Waymo's progress, deep learning's role and its limits.
Up next
12 mo on HNHow Self-Driving Cars will Destroy Cities (and what to do about it)
Not Just Bikes
17 HN recommender · 2024–2026
7 mo on HNGoogle Self-Driving Car Project | SXSW Interactive 2016
SXSW
2 HN recommender · 2016–2018
6 mo on HNAndrej Karpathy - AI for Full-Self Driving at Tesla
Matroid
4 HN recommender · 2020–2022
5 mo on HNGeorge Hotz: Comma.ai, OpenPilot, and Autonomous Vehicles | Lex Fridman Podcast #31
Lex Fridman
7 HN recommender · 2019–2026
6 mo on HNTraffic Has a Perfect Solution. Humans Are the Problem.
CGP Grey
6 HN recommender · 2016–2026
4 mo on HNGeorge Hotz: Hacking the Simulation & Learning to Drive with Neural Nets | Lex Fridman Podcast #132
Lex Fridman
6 HN recommender · 2020–2026
3 mo on HNai.bythebay.io: George Hotz, Self-Driving Lessons from Comma AI
FunctionalTV
3 HN recommender · 2018–2021
3 mo on HNAndrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI | Lex Fridman Podcast #333
Lex Fridman
3 HN recommender · 2022–2025
3 mo on HN[CVPR'21 WAD] Keynote - Andrej Karpathy, Tesla
WAD at CVPR
4 HN recommender · 2021–2023
3 mo on HNVeritasium: A Story of YouTube Propaganda
Tom Nicholas
3 HN recommender · 2021–2023
3 mo on HNTesla Autonomy Day
Tesla
3 HN recommender · 2019–2024
2 mo on HNTesla AI Day 2022
Tesla
2 HN recommender · 2022–2026
4 comments from Hacker News
I believe this talk will specifically and completely answer your questions: ▶ this video Short answer: Self driving vehicles do use deep learning, but they avoid some types not because it is unreliable, but it is processing power intense. Traffic lights, road signs, pedestrians etc.. That's a whole ball of wax to unravel. Check the lecture, its fantastic imo.
The second article I linked to also mentioned work on unmapped roads: link Waymo has solved problem after problem you think they haven't solved yet, for some reason. They've intentionally gone after unpredictable situations and dealt with them. Look at any video where they explain how it works, and you'll notice how many situations they can manage: ▶ this video And even if Waymo only works on well-mapped cities? That's still far from "can only work if they repurpose existing transportation infrastructure to only belong to self-driving cars" which is the comment I was replying to.
It is both an over and underhyped field depending on the area you are looking at. HUGE difference between consumer self driving car [Everywhere, at all times] and the Machines as a Service [Geo, time, weather-fenced operations][1]. Waymo appears to be at the head of the pack; Sacha Arnoud, Director of Engineering for Waymo gave a talk a few weeks ago at MIT[2] and gives a good idea. We are about 5 years out until these start rolling out as MaaS (machines as a service). Probably 10+ years for level 4 highway operations for consumer models according to Frazzoli. [1]Emilio Frazzoli, CTO of nuTonomy link [2] ▶ this video
Google/Waymo demo'd the AI driving in a snow storm and the method they used to see through the flakes and maintain object detection. Having trouble finding the video I'm thinking of. Here are some videos related to self-driving in snow and progress on weird edge cases. - link (snow, like the google demo) - ▶ this video | ▶ this video (snow, but not the one I was thinking of)