768 Threads Per Server AMD EPYC 9005 Turin is Here

If you want the highest core count and thread count CPUs, then the new AMD EPYC 9005 "Turin" generation has you covered. With up to 192 cores and 384 threads per socket, and up to 768 threads per server, the AMD EPYC 9965 is a BIG CPU. This CPU is so big, we needed to swap to faster Solidigm PCIe Gen5 D7-PS1010 NVMe SSDs and 400GbE Broadcom NICs to handle the CPU throughput.

Disclosure: AMD, Solidigm, and Broadcom all loaned hardware that was eventually used in this video. We have to say that AMD, Solidigm, and Broadcom are sponsoring this video.

----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------

----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------

----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
23:30 Key Lessons Learned

[kristoffersonaribal]

Congratulations Intel for renting the performance crown for two weeks, now AMD wants it back

[sativagirl]

"honey I over-provisioned the home server!"

[IAmPattycakes]

One dual socket could replace 16 of our older Xeon servers at work. That's absolutely mental.

[catsspat]

Man, it feels like it was just a couple weeks ago when Intel came out triumphant with their brand-new server chips.
Oh wait, it was just two weeks ago! Talk about a short lived spotlight moment.

[thatLion]

This is Patrick from STH, you will never be able to afford this.

[Ottetal]

Jesus christ, that's MENTAL! :) Seems like just yesterday we were excited for hex core chips with Nehalem, and look where we're at now

[JustSomeGuy]

Remember decades ago when we had the CPU MHz/GHz race where Intel and AMD were trying to one up each other on the advertised "speed" of their chips? I feel like "Threads" have been that the last decade.

[DrivingWithJake]

Quite amazing the amount of cores we're seeing.
It's been fun I just found a bill from 2008 from some of our servers we bought back then Q6600's :D

[stevekristoff]

Actually, personally am very interested in getting/seeing some performance numbers on the 9175F cpu. The 512MB L3 cache along with the good I/O options (memory and pcie lanes) think that would be a *VERY* nice fit for deep network inspection code (firewalls, network accelerators, etc) where you need the higher clock speed to handle the interrupts, but also higher cache to keep the matching logic (firewall rules, compression, inspection, etc) on package. Only issue is their proposed price being ~4x the 64MB L3 cache part. That is kind of steep (AMD obviously knows it has some value there) and would be very hard to justify until I see hard performance numbers.

[Brian-L]

It blows my mind how compact and powerful this tech is compared to the double rack $1.5M+ HP Superdome 128 core clusters I installed a maintained in the 2000s. 🤯

[EyesOfByes]

The 9175F peaked my interest! 512MB cache? Yes please!

[EdR]

I could do so many simultaneous 4K HEVC encodes on that thing 🤤

[Tarodenaro]

You know Patrick is very excited about this because he forget to say HEY GUYS at the beginning of this video.

[lil----lil]

iNTEL: wE DoN't NEEd No stinkin' threads!! (kills hyperthreading)
AMD: To the moon we go with THREADS!!! 🚀🚀🚀

[treyquattro]

in the key lessons learned segment, as I was listening to Patrick effusively (always!) propound on the benefits of the new AMD Epyc processors, I kept focusing on the prominent display of Xeon box and cushion...

[prashanthb]

The power requirements per rack will look crazy in the coming years.

[mikepasatieri]

Another way to look at this system is 768 Threads for a cost of 1000W is 1.3W/Thread. That's a good value.

[iankester-haney]

It's time to start testing Gentoo compile benchmarks. Test larger code bases than the kernel.

[hankhulator]

Hi, 384 threads, 6 TB of RAM, it is (almost) ready for the next Window$ \o/ 😛

With such CPUs, VM migration have chances to go obsolete rapidly, good thing.

[josemachado]

"640 threads ought to be enough for anybody." - Bill Gates