CPU Cores are the new Megahertz

AmpereOne and AMD are duking it out for the most cores in a single socket.

Links to the things I mentioned in this video:

Contents:

00:00 - 192 Cores
01:07 - Massive core counts, and a strange era
02:46 - What's in front
04:20 - What's in back (only fans)
05:49 - What's inside
07:32 - What it's for (Edge ORAN)
09:31 - Racking and repairing RAM
10:30 - Benchmarking hits different (why not Geekbench?)
14:16 - An excuse for 25G on the Arm NAS
15:57 - Benchmarking 192 Arm cores
17:00 - Arm-native workloads
18:19 - Other benchmarks
19:04 - The only game in town
20:30 - Arm's all grown up
21:44 - Myths about x86 and Arm

[SpamWare]

The specs of this server will be the minimum hardware requirements for Windows 12

[LockonKubi]

Software Vendors with core-count based licensing: "breathing heavily"

[FlyingCIRCU]

Linus got a 192-core EPYC, you have a 192-core Ampere. These videos are reminiscent of a time when car reviews were taking on the McLaren P1, LaFerrari and Porsche 918 in a narrow time frame.

[seanys]

Finally, a sensible explanation of “edge computing.” Thank you.

[tayzonday]

Marketing should use teraflops going forward. Plus “Tflop” sounds like a new music genre.

[ServeTheHomeVideo]

I should have put something in the box as an Easter Egg for Red Shirt Jeff and JeffyG! That is a fun little server!

[rhysperry]

Couldn't find a comment mentioning it (although I admittedly didn't scroll far) but just as a note the front ports look like SFP not QSFP. If they're 25G they'll be SFP28. Love your videos Jeff <3

[tonyb]

If you sent this guy back in time to mid-2000, it would be the world's most powerful supercomputer. It would still rank among the top 500 as late as 2006.

[chrisdixon]

"Nobody puts baby in the corner", and nobody would leave a machine like this sitting idle. It's a total workhorse and probably intended to be maxed out its whole life.
Love the content! Great video!

[JoeBurnett]

IBM used to have a refrigerator-sized RISC server called the p690 Regatta. When I stood behind one on the data center floor it was like a full-body hairdryer!

[jackcoats]

Back when I did development, we talked about vertical MIPS and horizontal MIPS. Big fast machines were more 'efficient' but lots of 'cores' allow running lots of stuff, but think of them as threads. It is great stuff, but if you can take the MIPS and add it all into one it was 'more efficient' and more computer programming to use more 'cores' efficiently. ... Enough from old history (starting in the '80s when I got my hand on them).

[erickleefeld]

2:32: “Don’t think of this as a single 192-core server. Think of it more like 48 dedicated 4-core servers in one box.”

Waylon Smithers: “Now, I realize caring for Mr. Burns seems like a big job. But actually, it’s 2, 800 small jobs.”

[TheFullTimer]

I love turning on servers in my lab & hearing fans get up to 100%. Just sip a hot mug of coffee while they boot & then settle. Badass IT moments.

[PplsChampion]

i love that all my favorite youtubers are apparently buddies who casually compare benchmarks and do e/o favors

[deechvogt]

Nice work and collaboration, Jeff, Jeff, Wendel and Patrick! Already subscribed to all of you.

[Gamefreak]

0:10 Captain, Is there something wrong with the jet?

[fairmania]

This is a bonkers bit of kit, a truly mind-bending level of power. Loved Patrick's little piece, you have some cool friends Jeff. I will never have or need something like this, but it's great to have it explained.

[kennethmadsen]

The 25Gbps interfaces are SFP28, not QSFP. Just for reference :)

[Yuriel]

Always nice to have Patrick to help in any video! The tech Youtube is always on it. I really dont know what all of us techies would do with out all of ya!

[sinuscosinus-vu]

I love that companies like Supermicro started to adopt OpenBMC and getting rid of AMI’s bs / their own creation. On the other hand, it’s sad that they don’t publish the code / the layers so that I could build my own image (which is basically the philosophy of OpenBMC).