this server WONT break.... - Clustered Storage Server

Thanks again to Supermicro for sponsoring this video and helping us bring this project to life! Check out their AI Storage solutions and more, using the links below:

We’ve gone through many evolutions of our main video editing server Whonnock, but they’ve all shared a similar problem - there is only one of them. Today, we change that by deploying a high availability storage cluster powered by Supermicro’s GrandTwin multi node servers and Weka, a distributed NVMe-first clustered file system. It’s fast… very, very fast.

Purchases made through some store links may provide some compensation to Linus Media Group.

FOLLOW US
---------------------------------------------------

MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova

Outro: Approaching Nirvana - Sugar High

CHAPTERS
---------------------------------------------------
0:00 Intro
1:48 Meet the rack
6:53 We're gonna build it ourselves
7:29 CPU
9:38 RAM
10:05 Boot Drives
11:00 Cooling
11:28 Storage
12:12 The Switch
12:42 The Software
17:35 Why the overkill
20:14 AI?
24:29 Deployment
25:25 Final Results
27:35 Outro

[Gilanas]

Next video: "we lost all our data"

[Creeperboy]

“How’s the edit going? I’m holding your file server” was the best line 😂. And then when Jake walked over with a second node….*chefs kiss*

[davidthomas]

This is lowkey one of the most interesting videos they have done on this channel in a long time, in terms of tangible, world-changing technology. The utility of that AI search tool is so unfathomably insane

[willie]

"I'm holding your server"

"Is it on Wi-Fi?"

Absolutely amazing

[anvecom]

My home desktop cannot lose data as well - in the sense that if something were to fail, I'm too broke to afford redundant storage.
Enterprise reliability is nuts, it's great to watch :)

[HanTheGreatInventor]

I get it now. You need two of everything for proper redundancy.
Elijah can drop stuff when Linus isn't there.
Elijah can mess stuff up when Dennis isn't there.
Good hire, LMG.

[DooMRunneR]

As a senior data center engineer in a multi billion dollar enterprise I really enjoy such content (with a bit of envy), while we still have to deal with the old school netapp metro clusters, HPE XP8 or IBMs SAN volume controllers you guys can play with the innovative stuff, even if its totally overkill for your usecase.

[jasonkramer]

This is easily one of the most beneficial and practical uses of AI I've seen. Eliminating the tedious work of sifting through thousands of hours of content to find something relevant? Yes, please.

[quattro_vp]

cannot lose data, until Linus somehow manages to drop it eventually

[timeimp]

THE INTRO HAS RETURNED. Thank you Dan.

[Mtlstorm]

As someone who built software like Weka for ~8 years, I appreciate how excited you are about these insanely complex systems and the performance they bring.

[ambulenciaga]

I must say, Linus Tech Tips has truly outdone themselves this year! The improvement in content quality is simply outstanding. It's incredibly noticeable how much work you've put into enhancing everything from writing to video production. The videos now are on a whole new level of coolness! Guys, you were good before, but now you're next-next-next level! Kudos to the LTT team for continuously raising the bar and delivering top-notch content.

[matthewjalovick]

Okay… the server was neat but HOLY COW that sorta AI search program thing at the end was unbelievable. One of the coolest products I’ve ever seen. That’s an actual game changer for folks who have a of data and through which it’s not easy to search.

[frankie]

My favorite LTT videos are the ones with Jake explaining networking that I do not understand at all

[Respectable_Username]

"What could go wrong?"
"I mean, a lot."
Ah, it's always a good sign when those words are being said on the _other_ side of the screen 😂

Glad to see Jake back again! Had been thinking it's been a while

[clarkcaraway]

Jake looks fantastic and I'm so proud of him and the effort he has clearly put in. Good on you man.

[nocloo]

Videos like this are proof that Jake is a very valuable employee. Guy knows his IT stuff.

[jordanhildebrandt]

That Epyc CPU could hold the entire system memory of a Win 2000 machine in its L3 cache. Can you even imagine how fast it would be if your entire kernel AND workload is in CPU cache, and main memory isn't even being used!? That's wild.

[snowblind]

See you guys in a year when the server loses data

[jpulley]

That axle AI is crazy! Can't wait to see more historical clips showing up in new videos!