Why Neural Networks can learn (almost) anything

A video about neural networks, how they work, and why they're useful.

SOURCES

Universal Function Approximation:

Turing Completeness:
Networks of infinite size are turing complete: Neural Computability I & II (behind a paywall unfourtunately, but is cited in following paper)

More on backpropagation:

More on the mandelbrot set:

Additional Sources:

Reviewers:
Connor Christopherson

TIMESTAMPS
(0:00) Intro
(0:27) Functions
(2:31) Neurons
(4:25) Activation Functions
(6:36) NNs can learn anything
(8:31) NNs can't learn anything
(9:35) ...but they can learn a lot

MUSIC

[Rivalius]

I been in this field for years and this is by far one of the best explanations I seen. Thank you for this.

[gerixxx]

This is the absolute best entry level explanation of AI an NN I have yet seen anywhere. This will surely get millions of views!

[NicholasRenotte]

This is such a brilliantly constructed explanation of NNs. Props to you man, this must’ve taken a ton of effort to create.

[ScottBrown]

I'm glad you brought up the caveats to the universal approximation theorem. Available data, compute, and architecture drastically narrow the scope of problems that we can approximate to any real degree of success. Approximation errors, estimation errors, and optimization errors all compound to drastically limit the expressive power of neural networks.

[Diamcreeper]

The part where you combined a bunch of line equations was interesting, I've always heard that activation functions are important but I never quite understood what their role is.

[marlin]

Such a good video mate, Hope your channel grows exponentially.

[user]

As technology advances, AI approaches neuroscience, which is what I find most fascinating about AI. Our brains are just sugar-driven neural networks, tuned to the inputs of everyday life on earth!

[officialbfi]

I’ve been binging your videos all night but this video has easily earned my subscription. An absolutely fantastic explanation that perfectly captures the essence of neural networks without being bogged down by the maths.

[Beerbatter]

I've recently become interested in neural networks, and AI in general. This video was spot on for providing a fundamental understanding. The piecewise activation function used to trace along the unknown function was eye opening. Really brought that idea home for me finally. Thanks. Your video is very nicely produced. Right at the top by today's YT standards.

[SO-thgc]

Just came across your video from the feed.
Dude, you've done an incredible job on propping up the basics. Huge appreciation. Waiting for your future videos.

[MoritzWallis]

Wow, this wasn't anything new to me, but you did an amazing job of explaning the background and building intuition. Truly one of the best youtube videos i've seen.

[naidoeshacks]

Absolutely love these 3blue1brown style videos!

Keep it up man your channel is amazing.

[RCFreibott]

What a marvelous video. I've been watching tutorials and reading books on machine learning for over a year, but I've never really understood the core concepts... Until now. Thank you

[derekcobo]

This was so well explained. I love how you briefly dipped into the deep math just giving a taste to do our own searching yet still explaining in depth what is going on.

[brian_kirk]

Excellent layout of the topic from basic first principles -- well done! Hoping to find more videos like this on your channel :)

[yusufsalk]

What a simplicity! Looking forward to watch more explanations.

[Antagon]

Just found this channel.
Quality of your videos is supreme, and you cover really interesting topics, which I've been studying myself for the better part of last year.
Thank you!

[cornevanzyl]

What you did here is nothing short of magical. Fantastic explanation, awesome visuals 👌

[eli]

High audio quality, slow and clear language, great presentation and most of all very informative! I'm glad this was recommended to me

[illustriouschin]

I was recommended this video and wow, great explanation. I hope your channel blows up because this is top quality neural network content.