I BUILT A NEURAL NETWORK IN MINECRAFT | Analog Redstone Network w/ Backprop & Optimizer (NO MODS)

#minecraft #neuralnetwork #backpropagation

I built an analog neural network in vanilla Minecraft without any mods or command blocks. The network uses Redstone wire power strengths to carry the signal through one hidden layer, including nonlinearities, and then do automatic backpropagation and even weight updates.

OUTLINE:
0:00 - Intro & Overview
1:50 - Redstone Components Explained
5:00 - Analog Multiplication in Redstone
7:00 - Gradient Descent for Square Root Computation
9:35 - Neural Network Demonstration
10:45 - Network Schema Explained
18:35 - The Network Learns a Datapoint
20:20 - Outro & Conclusion

I built this during a series of live streams and want to thank everyone who helped me and cheered for me in the chat!

Credits to Lanz for editing!

Links:

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n

[dylancope]

As someone who used to build computers in Minecraft, I really appreciate this.

However... Using grass blocks for everything hurts my soul.

[Michsel]

Finally doing something useful with your PhD

[TehCannonMan]

when you can't afford that MATLAB license

[dhiahassen]

In terms of "creating artificial intelligence from the physics of a simulated world" ... this is a chapter opener in our history, even tho it is not epically hard to implement, but you were the first

[YannicKilcher]

OUTLINE:
0:00 - Intro & Overview
1:50 - Redstone Components Explained
5:00 - Analog Multiplication in Redstone
7:00 - Gradient Descent for Square Root Computation
9:35 - Neural Network Demonstration
10:45 - Network Schema Explained
18:35 - The Network Learns a Datapoint
20:20 - Outro & Conclusion

[mabynke]

For me as a redstone and neural networks enthusiast, this was the most fun stream I have ever followed, and with the most interesting chat. Wish I could have been there for more of it!

[JamesAwokeKnowing]

This was a really good move, because a lot of smart young minds gravitate toward minecraft and this will introduce them to yannic's channel where they can see what their future beyond minecraft can be, as a neural net / AI researcher/engineer

[y__h]

Considering that you made backprop works in INT4 equivalent, this is pretty much amazing stuff.

[popwwy]

He did it! The MADMAN actually DID IT!

[RobotProctor]

Gotta get ilmango to make this ultra compact to have a machine learn how to identify an 8x8 image with named wool blocks or something

[linminhtoo]

if you're using redstone I guess you're also using Torch ;)

[connieeify]

Absolutly mindblowing!! Great work.

Maybe on suggestion though: Could you colour code the different parts next time, instead building just with dirt? Just increases readability of the wiring, and makes things easier to understand :-) Especially since you had predifined sections anyway :-)

[geraldkenneth]

Awesome. I didn’t know implementing backprop in minecraft was even possible, and instead just stuck to weightless neural networks and correlation matrix memories. This means that things like CMACs, ADALINEs, and other learning machines might be possible

[pauljones]

This is requires an understanding of how each part of a neural network is supposed to work and why. Besides that very very cool. Never thought such a complicated computation could be made in minecraft

[SmoothBeans]

When I started watching this I thought it was fake and now after watching the whole thing, you have a new subscriber

[miguelcarvalho]

Awsome. I'm doing my msc thesis in DRL and I'm watching this while procrastinating. But it actually helps in understanding better the networks x) thank you good job

[ladeacooltube]

It takes a true genius to actually pull this off, especially when you have so many math equations to replicate in Minecraft Redstone. Good job.

[Scier]

society: video games cause violence
him:

[yugupuguxd]

Me: didnt understand anything
Still me:intresting

[kl]

Here I have to think back to Yannic's video on how to survive a PhD.. "Spend all your time to focus on your project", Visit Seminars? - "You won't have time".
Well well Yannic..