Andrej Karpathy on Tesla AI data engine

Please support this podcast by checking out our sponsors:

GUEST BIO:
Andrej Karpathy is a legendary AI researcher, engineer, and educator. He's the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford.

PODCAST INFO:

SOCIAL:

[LexClips]

Guest bio: Andrej Karpathy is a legendary AI researcher, engineer, and educator. He's the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford.

[ReflectionOcean]

By YouSum Live

00:00:14 Data engine: Iterative improvement of training sets.
00:00:24 Enhancing neural networks through diverse data sets.
00:00:40 Importance of catching rare scenarios for network improvement.
00:01:50 Human role: Strategizing data collection and execution excellence.
00:02:36 Task prioritization based on system feedback and goals.
00:03:16 Individual experience as a source of truth and intuition.
00:03:23 Insight from personal interaction surpasses statistical analysis.
00:03:58 Elon Musk's hands-on approach for system understanding.

By YouSum Live

[rb]

My interpretation is the intel crisps are abstracting results in plots. My experience is what matters.

[curtaustin]

When a human is confronted with a previously unseen situation, he/she can quickly figure out what to do; they *think* of something. They generally require far less training - a much smaller data set. A few photos versus dozens. I've not seen a specific effort by Tesla to pursue whatever process humans use that accomplishes this ordinary magic. But the AI community must be working on it. Does it go by some inscrutable name? Or simply "artificial thinking"?

[martincday]

Deploy, Data Source, Notice a Problem, Boost, Label, this seems like a relatively crude way of learning as it relies on a problem to have occurred, before it can be addressed by human intervention and intuition.

That would be fine in a safe environment but self driving vehicles are not operating in a safe environment nor are they operating in an environment where it is only signed-up Tesla aficionados that will be affected.

AI needs to be able to complete the Boost and Label aspects of the problem solving process without human intervention. Until it can do that, the process is effectively building in an "acceptable" number of potential harm and deaths to Tesla drivers and more significant those who are non-Tesla customers.


A responsible company would take the first step and rename "Full Self Driving" to something like "Advanced Driving Assist". Only an irresponsible company's would market a product as one thing and then in the small print describe it as something completely different.

Level 5 autonomy is probably still a decade away, why not celebrate being among the most advanced level 2, although it is interesting that Mercedes' Drive Pilot has become the world's first fully certified Level 3 autonomous driving system and is now available in Germany.

[rb]

I wish it was in the error now. My impression is error is more like 10%. Still crossing my fingers that the training will use my car’s feedback soon.

[nicholasmarquez]

This is simple, necessary and very badass !!!

[KingKwaZulu]

Did anyone else check the speed because this dude speaks so fast

[chethanslthippeswamy]

the question which was missed from the interview was "How did they got rid of ultrasonic?"

[eleson]

So a Tesla needs to be exposed to scenario, and fail at it, to get data to learn from?

[darkmatter]

The content is great, but audio quality is crap. Everything is extremely compressed, dark, muddy.

[westsiyed]

am I the only one know noticed he wearing his Apple Watch wrong? Isn't the crown suppose to be outward facing?

[CoalOskold]

Data sets that look at the world threw all of the animals eyes

[intrametaarchi]

I think that Tesla represents the Military industrial complex, not everyone can see that.

[AussoOnePlus]

The scientific name is: Muskius Scammius Insidius Tradius.

[FredericJacquemin]

is it me, or LF is really, but REALLY bad with articulation? Hey Lexi, can you please pay attention to that? that would be great for everyone, you're like shooting off the content just by not articulating.