Advice for graduate students in AI | Andrej Karpathy and Lex Fridman

Please support this podcast by checking out our sponsors:

GUEST BIO:
Andrej Karpathy is a legendary AI researcher, engineer, and educator. He's the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford.

PODCAST INFO:

SOCIAL:

[LexClips]

Guest bio: Andrej Karpathy is a legendary AI researcher, engineer, and educator. He's the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford.

[johnmurphy]

I’m currently a graduate student going into AI/ML and I’ve been loving it!

[kmo]

In my opinion, a neural network is just a compressed and structured look-up table that is continuous.

[letsburn]

They also don't mention that Stable diffusion has had 1.4 and 1.5 open source. The open source forms of SD has been explosive. The scripts and versions already. Plus checkpoints. If you want Waifu diffusion you can. There is a model that creates new Pokemon...its insane.

[octaviodovalle]

Data processing and “if this, then this” functions are not reasoning. Reasoning is a conscious aspect of being able to be the observer of thought. Putting together logic is not completely reasoning

[sreejithp]

I think computers are good at coming up with solutions/reasoning by processing all the past data on a particular topic. What differs in human reasoning is taking decisions on emotions or what we call a hunch

[DanielJanzon]

You hear a lot that AI can only generate averages of past data, i.e. interpolate, but I can't see any reason a neural net or any other function of past data wouldn't be able to extrapolate beyond the data. Especially not in generative AI where you want a creative rather than a "correct" result. It all seems like wishful thinking to me, that humans still are ahead on creativity.

[quintrankid]

3:17 "What would illustrate to you: Holy shit, this thing is thinking!"? But what is thinking? And what kind of thing's thinking is being asked about? An earthworm's thinking? A dog's? A starfish? Do single-cell-organisms that have to find food think?

[rb]

Sure, NN today do some sort of “reasoning”. More work to align it to what we may think of as our type of reasoning. Novel- yes, Reasoning- yes. Conscious- not yet. Consciousness is more about integrating the state of our bodies. For us it is nerves all over our bodies and sensing of glucose, hormones, ATP levels, and much more.

[jackbauer]

on the reasoning part, I completely disagree ! he 's so wrong ...