Your Next CPU is Bigger Than Your HEAD 🤯 Cerebras Wafer Scale 2

There's a whole world of AI processors out there. This one is excitingly different.

0:00 Redefining Large Silicon
0:34 The world of AI Processors
2:13 Cerebras Wafer Scale Engine 2
4:02 Buying a Full System
4:45 HOW MUCH DOES IT COST
5:51 PyTorch, TensorFlow, and CFD?!
7:16 Reticles and Yield
8:47 Data Streaming of ML Layers
10:20 Competition and TCO
11:37 WSE-2 Timeframe
12:12 Congrats. Have an Award
13:05 Cat Tax

Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst

Also available through Patreon is special 1-on-1 consulting for the financial services industry!
Many thanks to our CPU CEO Patrons, including:
- Michael Spencer

Support the channel by hitting that subscribe button, or using our Amazon affiliate link. Please note that TTP may receive a commission if you purchase anything through these links

#techtechpotato #cerebras #ai
Your Next CPU is Bigger Than Your HEAD 🤯 Cerebras Wafer Scale 2

[yanniskouretas]

One chip to rule them all,
one chip to find them,
One chip to bring them all
and in the darkness bind them.
I don't know why this made me remember the inscription on Sauron's Ring

[blackasthesky]

I stumbled across your channel today. I am a CS student and I am mainly interested in that very low level stuff, barely above the electrical engineering level. This channel is just what I didn't know I was looking for. YouTube recommendations aren't always bullshit.

[BarryTheCougar]

"If a core has a defect on it, then it can just be bypassed". Reminds me of the 80's and low-level formatting a ST-506 interface HDD and flagging bad sectors.

[SteelSkin]

It took me a minute to realize that the corners of the die are rounded because it's reaching the edge of the wafer. That is insane.

[bobafruti]

I remember in the 80s when the media first started talking about making supercomputers parallel instead of just faster. People said one day you might have 4000 CPUs in a supercomputer....
We’ve had that for years now, but 4, 000 on a single wafer is next level

[henrysalayne]

If GPU prices rise even higher, this might be a valid option on the second hand market in a few years.
Love the new logo!

[keyserxx]

I love your videos, my IQ went up a notch. and now for balance I'm off to watch an LTT video.

[Apocalymon]

Finally, niche science-fiction stories from the 70s & 80s are becoming a reality.

[oiytdwugho]

5:24 "a few that cerebras don't wanna talk about" yeah, this stuff is always exciting and then I go "oh, someone is using that for spooky military things"

[liaminwales]

2:50 version 1 = 23KW!
4:20 version 2 = 23KW, amazing how they keep the same power use with a die shrink
WOW that brings a smile to my face.

[gulllars]

I first came across Cerebras at STH, and then i fell down the rabbit hole a bit. The amount of new and novel innovations they had to do to be able to run a wafer scale chip is extremely impressive. I'd liken it to almost an Apollo mission of silicon and systems engineering.

From what I've read, training models is extremely fast, but the size of the onboard SRAM is a constraint on the model size. I wonder if they will make versions later stacking some kind of memory under the compute cores, or using a more dense type of memory than SRAM. Alternatively an edition trading some cores for higher memory.

It is definitely a new paradigm of computing.
I'd be curious to hear more about non-ai use cases here as well, and how well it works for those compared to alternatives.

[mt-qcqh]

Great info as always. Glad I found your channel. Frankly I'm amazed at how well you know the chip industry and you presentations are spot on! Keep up the good work...

[nukedathlonman]

I find it impressive that they found a way to make the chip with out having to worry about yields.

[fotmheki]

Amazing work from them. 100% yield of those beast is wonderful! No silicon will be waste

[alexhaddock]

Great video and good to see Natalia flash up. She came to talk to us when she was in HPE Labs and my brain melted! Good to see we are working on Neocortex with them.

[shawncarroll]

"In a human, there are more than 125 trillion synapses just in the cerebral cortex alone, "
It also comes with liquid-cooling, though leakage of coolant in the CPU can lead to permanent damage. The fluid pump is good for approximately three billion cycles, and the system consumes give or take 2, 300 watt hours a day in the form of chemical energy, which is partially converted to pulsed chemo-electrical signals. MTBF runs about 60-70 years, and a new system typically takes about 20 years from inception to practical usefulness.

[johnluuee]

When both kidneys isn’t cutting it and you need a arm and a leg plus your first born.
This sounds like a tv drama.

[rougenaxela]

I have to give them points for the audacity of making such power-dense wafer scale monsters like that

[TauxWau]

I read your new Anandtech article on Cerebras and was quite amazed. Thanks for bringing people's attention to this really cool piece of tech :)

[Ben-rypy]

Great stuff, as always! I really enjoyed your broken silicon too. I listened to all of it and loved it.