Autonomous Car - what goes into sensing for autonomous driving?
Mobileye1 HN recommender · recommended in 1 month, 2016–2016
talk · intermediate · 2016–2016 on HN
Mobileye co-founder and CTO Amnon Shashua explains what goes into sensing for autonomous driving and whether end-to-end deep learning can work for it. He argues for decomposing the problem.
Recommended as an accessible technical explanation of Mobileye's approach, and also cited in disputes over Tesla Autopilot.
Up next
12 mo on HNHow Self-Driving Cars will Destroy Cities (and what to do about it)
Not Just Bikes
17 HN recommender · 2024–2026
7 mo on HNGoogle Self-Driving Car Project | SXSW Interactive 2016
SXSW
2 HN recommender · 2016–2018
6 mo on HNAndrej Karpathy - AI for Full-Self Driving at Tesla
Matroid
4 HN recommender · 2020–2022
5 mo on HNGeorge Hotz: Comma.ai, OpenPilot, and Autonomous Vehicles | Lex Fridman Podcast #31
Lex Fridman
7 HN recommender · 2019–2026
6 mo on HNTraffic Has a Perfect Solution. Humans Are the Problem.
CGP Grey
6 HN recommender · 2016–2026
4 mo on HNGeorge Hotz: Hacking the Simulation & Learning to Drive with Neural Nets | Lex Fridman Podcast #132
Lex Fridman
6 HN recommender · 2020–2026
3 mo on HNai.bythebay.io: George Hotz, Self-Driving Lessons from Comma AI
FunctionalTV
3 HN recommender · 2018–2021
3 mo on HNAndrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI | Lex Fridman Podcast #333
Lex Fridman
3 HN recommender · 2022–2025
3 mo on HN[CVPR'21 WAD] Keynote - Andrej Karpathy, Tesla
WAD at CVPR
4 HN recommender · 2021–2023
3 mo on HNVeritasium: A Story of YouTube Propaganda
Tom Nicholas
3 HN recommender · 2021–2023
3 mo on HNTesla Autonomy Day
Tesla
3 HN recommender · 2019–2024
2 mo on HNSacha Arnoud, Director of Engineering, Waymo - MIT Self-Driving Cars
Lex Fridman
3 HN recommender · 2018–2023
4 comments from Hacker News
Here is a great, very accessible video where the CTO of MobileEye (which provides some of the components for Tesla's "autopilot") explains his views on the challenges of end-to-end learning for autonomous vehicles, and why it's preferable to decompose the problem instead (still using deep learning for the decomposed modules). ▶ this video I'm inclined to agree, especially because it helps in 1) providing diagnostic information (such as the great driving visualizations shown in the video), and 2) makes it easier to incorporate algorithms and sensors (like with Google's cars) as a redundancy in case the neural network hits a crazy edge case.
Those are good points. Here's some backup. Here's Mobileeye's CTO talking in detail about their technology.[1] They use a a deep neural network that recognizes cars. Just cars. Look at this point in the video.[2] There's a stationary obstacle on the left, and it doesn't recognize that. Maybe this is why Tesla, using Mobileye hardware, plowed into three different stationary vehicles at the left of a highway. They were all trucks (one was a street sweeper), and seen from the back while stationary, may not have matched the trained model of "car". Mobileeye's algorithms are good at recognizing moving cars from most angles, and that's valuable for feeding into the model of "what's the other player doing". But it's not enough for the "where are all the obstacles" and "where is the road surface" questions. Those questions have objective answers, which can be answered with a LIDAR, and maybe millimeter radar if it has the angular resolution. [1] ▶ this video [2] ▶ this video
ugh, more ME noise. so ME has a lot of evidence that they are lying through their teeth, if they were so worried why let all the other brands do the hands free thing? link * ME boasting about their tech making hands free possible ▶ this video
/r/TeslaMotors dug up this video[1] of MobilEye CEO talking about the Autopilot, so if they really disagreed with the usage of Autopilot, shouldn't they have brought that up prior, and not included it in promotional material. From all indications on their end, I believe that they said that the Tesla Autopilot shouldn't be driven hands-free. I have no qualms with that, but why then use the Autopilot as a promotional feature for their products? Not trying to fanboy with Tesla here, as I do think that MobilEye was right in pulling their products away from Tesla. [1]: ▶ this video