Neural Networks in Scratch

Implementation of Neural Network in Scratch programming language.

Model includes 2 hidden (Dense) layers, 8 neurons each, ReLU activation functions, 10 neurons in output (Dense) layer with Softmax activation function, Cross-entropy loss, calculating of an accuracy, and full backward pass including derivatives, and loss minimization using backpropagation and simple SGD optimizer.

------

[susmitislam]

Madmen come in two flavours.
1. Those who write neural networks from scratch in C.
2. Those who write neural networks from scratch in scratch.

[gouravkolhatkar]

Who came here after watching Sentdex video...

[lucasfontes]

I've never seen something so amazing in coding as this.

[xpdx]

This is AMAZING! It was only a few days ago when I was thinking of how complex this would be and someone has done it! Kudos to you :)

[sachinsinkar]

It's Awesome Like I'm watching some kind of Movie Trailer on Neural Networks. Thanks for those Visuals.

[Skhulile]

This is so cool!!! Also thanks for the animations you doing for sentdex, it is really making the learning easy to understand!

[eleos]

When I first saw the title of "neural networks from scratch" this title is what I imagined. Even though it wasn't what I thought, I was never disappointed. It never occurred to me how insane and amazing it is to do what you've done until this video.

[farouku]

this is honestly one of the coolest things I’ve ever seen!

[Saletroo]

Thanks to you, this topic is closer to my little polish heart <3

[budhachandrayumkhaibam]

Bro you've done it.. I was doing a similar thing in python and was unsuccessful
now I feel like I've refueled 🤣

[MagicalSAMElectronics]

It felt awesome looking at the training process .

[alcha]

You are a genius, Man! Thanks for this!

[dairop]

Tbh the first NN I have done was on scratch, maybe harder to understand what you're doing but at least you don't have strange errors :D

[narudavidkun]

Dude that handmade style of graphs is so style

[navalsurange]

dude you are epic respect++
I am also doing same thing in cpp...hope it works

[staffankonstholm]

I goddamn commend you for the effort put into this

[chaks]

Now THIS is someone who could get a job at Google using Scratch

[jessepinkmansimp]

im pretty advanced at scratch but could never possibly make something like this. maybe i could try

[uncoded]

WOW! Awesome. Is it easier in Scratch or Python?

[blfabela]

is this shared? I want to look at the code more in depth.