comma ai | Driving to Taco Bell with end-to-end ML | Harald Schäfer | COMMA_CON 2023 talk | CTO

Date of the stream 29 Jul 2023.

Harald Schäfer social media:
View original video on Youtube:
A drive to Taco Bell

Chapters:
00:00:00 intro Harald Schäfer, CTO: A Drive to Taco Bell
00:00:38 making a superhuman driving agent
00:03:14 three parts end-to-end lateral, longitudinal, navigation
00:04:08 taco bell
00:05:35 end-to-end lateral
00:06:50 end-to-end lateral done
00:07:15 end-to-end longitudinal
00:08:44 easy depth
00:10:40 plug into simulator and it works
00:11:25 fun sidenote, traffic code
00:11:50 is it really that easy?
00:14:50 so what did we spend time on?
00:15:10 the great refactor
00:17:15 rejected ideas
00:17:25 rabbit hole 1: stoplines
00:18:35 rabbit hole 2: depthnets
00:20:15 end-to-end longitudinal done
00:20:40 end-to-end navigation
00:21:10 end-to-end navigation in experimental mode
00:21:29 few more changes for taco bell
00:22:44 taco bell code
00:23:09 taco bell video
00:24:30 just a demo?
00:25:45 so when will this be good?
00:27:48 what's next?
00:28:00 needs to be more end-to-end
00:29:35 what's even more general?
00:30:57 billy and silly the bot
00:31:54 come to robotics hackathon
00:32:42 questions
00:33:03 lane changes blind spot sensors and interior camera
00:34:25 lane change indicator status
00:34:48 team vacation, end-to-end long speed limits
00:35:34 depth prediction in simulator, neural radiance field
00:36:18 model training simulated data, augmented real video data
00:36:53 production ready end-to-end applications for openpilot
00:37:37 technics for end-to-end navigation, zoom level
00:37:59 openpilot disengagement analysis
00:38:30 training data from cars that use openpilot longitudinal

Official communication channels:

How to get a job:
How to collaborate:

Are you interested in openpilot?
Knowledge base:
Check out the code:
Is my car supported?
Frequently Asked Questions:
How to setup openpilot:
Comma Secure Shell:
API Documentation:
CAN analysis tool:
Review and annotate your driving data:
Leaderboard:
Comma Connect App:
Research:

Official George Hotz communication channels:

Follow for notifications:
Unofficial communities and resources:

Thank you for reading and using the SHOW MORE button.
We hope you enjoy watching George's videos as much as we do.
See you at the next video.

[geohotarchive]

Thank you to the comma team for this amazing event and sharing the livestream and high-quality videos. All credits to them. Follow their official youtube.com/commaai for more livestreams.
A drive to Taco Bell drive -> youtu.be/SUIZYzxtMQs | from $1250 buy -> comma 3X comma.ai/shop/comma-3x | openpilot.comma.ai is the best ADAS system in the world | If you have skill apply on -> comma.ai/jobs | Join the community on github.com/commaai/openpilot & discord.comma.ai | Check if your car is supported -> comma.ai/vehicles | How to setup your car comma.ai/setup | Stay up to date by following twitter.com/comma_ai | Support comma.ai at comma.ai/shop
Chapters:
00:00:00 intro Harald Schäfer, CTO: A Drive to Taco Bell
00:00:38 making a superhuman driving agent
00:03:14 three parts end-to-end lateral, longitudinal, navigation
00:04:08 taco bell
00:05:35 end-to-end lateral
00:06:50 end-to-end lateral done
00:07:15 end-to-end longitudinal
00:08:44 easy depth
00:10:40 plug into simulator and it works
00:11:25 fun sidenote, traffic code
00:11:50 is it really that easy?
00:14:50 so what did we spend time on?
00:15:10 the great refactor
00:17:15 rejected ideas
00:17:25 rabbit hole 1: stoplines
00:18:35 rabbit hole 2: depthnets
00:20:15 end-to-end longitudinal done
00:20:40 end-to-end navigation
00:21:10 end-to-end navigation in experimental mode
00:21:29 few more changes for taco bell
00:22:44 taco bell code
00:23:09 taco bell video
00:24:30 just a demo?
00:25:45 so when will this be good?
00:27:48 what's next?
00:28:00 needs to be more end-to-end
00:29:35 what's even more general?
00:30:57 billy and silly the bot
00:31:54 come to robotics hackathon
00:32:42 questions
00:33:03 lane changes blind spot sensors and interior camera
00:34:25 lane change indicator status
00:34:48 team vacation, end-to-end long speed limits
00:35:34 depth prediction in simulator, neural radiance field
00:36:18 model training simulated data, augmented real video data
00:36:53 production ready end-to-end applications for openpilot
00:37:37 technics for end-to-end navigation, zoom level
00:37:59 openpilot disengagement analysis
00:38:30 training data from cars that use openpilot longitudinal

[isaacandrewdixon]

I agree. Taco bell delivery must be the most pressing issue

[NotAnonymousNo]

Can it get you from Taco Bell to the nearest toilet without disengagement?

[graham]

Surprised that disengagrments aren't used yet. Going to be amazing

[commonlogic]

Are you gonna post the Twitter spaces he did?

[semtex]

alright, grabbing bakies watching this. imagine what amazing things we'd be missing out on and the accompanying chaos that would ensue if ai pause is being imposed