comma ai | Human-Machine Cooperation in openpilot | Weixing Zhang | COMMA_CON talks | Research

Weixing Zhang social media:
View original video on Youtube:

Chapters:
00:00:00 intro
00:00:25 openpilot and driver
00:00:45 what we are going to talk about
00:00:55 learning about the driver
00:01:15 comma two driver facing camera
00:01:35 comma two model input
00:01:57 comma three driver facing model input
00:02:07 full frame DM model input
00:04:10 end-to-end driver monitoring
00:04:45 what is attention
00:05:45 defining attention
00:06:15 ground-truthing
00:07:41 refining ground truthing
00:08:35 end-to-end driver monitoring integration
00:09:30 driver behavior metrics
00:09:40 driver metrics aggressiveness
00:11:02 driver metrics engaged vs not
00:13:34 learning about the driving model
00:14:40 disengagement metrics
00:14:50 understanding disengagements
00:16:15 longitudinal personality
00:17:32 communication in UI
00:17:44 knowing uncertainty
00:18:25 communicating uncertainty
00:19:50 log term investment in driving monitoring
00:20:46 eye gaze and tracking
00:21:35 deep learning and declarative learning
00:22:55 chil drivers vs aggressive drivers, good drivers
00:24:11 giving feedback about uncertainty
00:26:15 attentive driver, using driver data as negative signal for driving
00:27:35 using driver monitoring for driver communicating intent
00:28:25 driver talking over reaction time after openpilot driving for a long time

Official communication channels:

How to get a job:
How to collaborate:

Are you interested in openpilot?
Knowledge base:
Check out the code:
Is my car supported?
Frequently Asked Questions:
How to setup openpilot:
Comma Secure Shell:
API Documentation:
CAN analysis tool:
Review and annotate your driving data:
Leaderboard:
Comma Connect App:
Research:

Official George Hotz communication channels:

Follow for notifications:
Unofficial communities and resources:

Thank you for reading and using the SHOW MORE button.
We hope you enjoy watching George's videos as much as we do.
See you at the next video.

[geohotarchive]

from $1250 buy -> comma 3X comma.ai/shop/comma-3x | If you have skill apply on -> comma.ai/jobs | Join the community on github.com/commaai/openpilot | Check if your car is supported -> comma.ai/vehicles | How to setup your car comma.ai/setup | follow the official youtube.com/commaai for more livestreams | Stay up to date by following twitter.com/comma_ai | Support comma.ai at comma.ai/shop.
Chapters:
00:00:00 intro
00:00:25 openpilot and driver
00:00:45 what we are going to talk about
00:00:55 learning about the driver
00:01:15 comma two driver facing camera
00:01:35 comma two model input
00:01:57 comma three driver facing model input
00:02:07 full frame DM model input
00:04:10 end-to-end driver monitoring
00:04:45 what is attention
00:05:45 defining attention
00:06:15 ground-truthing
00:07:41 refining ground truthing
00:08:35 end-to-end driver monitoring integration
00:09:30 driver behavior metrics
00:09:40 driver metrics aggressiveness
00:11:02 driver metrics engaged vs not
00:13:34 learning about the driving model
00:14:40 disengagement metrics
00:14:50 understanding disengagements
00:16:15 longitudinal personality
00:17:32 communication in UI
00:17:44 knowing uncertainty
00:18:25 communicating uncertainty
00:19:50 log term investment in driving monitoring
00:20:46 eye gaze and tracking
00:21:35 deep learning and declarative learning
00:22:55 chil drivers vs aggressive drivers, good drivers
00:24:11 giving feedback about uncertainty
00:26:15 attentive driver, using driver data as negative signal for driving
00:27:35 using driver monitoring for driver communicating intent
00:28:25 driver talking over reaction time after openpilot driving for a long time

[johanngerberding]

one of the coolest ai startups out there, keep up the great work!