ULTIMATE 40Gb Homelab Networking - UNRAID NETWORK SETUP

Get 40GbTransfer speeds for the price of 10Gb! If you are doing a new install of a 10Gb Home Network right now, you might want to evaluate setting up a 40Gb backbone that can provide a lot of additional throughput to really max out any machine's storage subsystem. Perfect for #homelab setups, video editing on super-fast shared storage, and virtual machines that perform lightning fast. Be sure to check out some of the hiccups I hit along the way on my Ryzen 5950x Windows 11 machine. I got it to work in the end! #Unraid, easy.

👇NETWORKING + HOMELAB GEAR (#ad)👇

SERVER RAILS + CABLE MANAGEMENT

RAM

DISK SHELF (JBOD) + CABLE

SERVER

HBA

ENCLOSURE

SWITCH

UPS

Be sure to 👉Subscribe👈 for more content like this!

Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching!

🛒Shop

DSP Website

Disclaimers: This is not financial advice. Do your own research to make informed decisions about how you mine, farm, invest in and/or trade cryptocurrencies.

*****
As an Amazon Associate I earn from qualifying purchases.

When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.

Other Merchant Affiliate Partners for this site include, but are not limited to, Newegg, Best Buy, Lenovo, Samsung, and LG. I earn a commission if you click on links and make a purchase from the merchant.
*****

#homelab #fs

[DigitalSpaceport]

Join this channel to get access to perks:

[ewenchan]

I run 100 Gbps Infiniband in the basement of my home.

It was mostly used for HPC applications (CFD/FEA -- that sort of thing). Within those IB/RDMA/MPI aware applications, I was getting somewhere between 80-90 Gbps throughput (depends on the problem and the application, and also the size of the problem that it was solving).

Using the IB bandwidth benchmarking tool, I can get up to around 96-97 Gbps.

For me, using said 100 Gbps IB network for storage is really just a fringe benefit as it wasn't deployed with that in mind.

Having said that, I don't have like a pool nor an array of NVMe SSDs (in fact, I try to avoid using SSDs because SSDs are the brake pads of the computer world in that the faster they are, the more you're going to use and more likely you're going to use them, which just leads to wear out.)

So instead, I use 36 HDDs, and as a result of that, my throughput is limited anyways.

But it is nice that I CAN max out at roughly 24 Gbps with eight HDDs, with the nominal average closer to around the 4 Gbps range. But my LTO-8 tape drive can really do only about 200 MB/s (~1.6 Gbps sustained) so the fact that I have so much networking bandwidth/headroom - again -- storage part of this was just a fringe benefit as a result of the HPC micro cluster deployment that I had.

On a $/Gbps basis, 100 Gbps IB is cheaper than even 10 Gbps, even if the NICs, cables, and switches have a higher absolute cost.

(I run it through a Mellanox MSB7890 externally managed 36-port 100 Gbps IB switch.)

[electronicparadiseonline]

mmmm.... 40Gb. Spicy!!! Yes please, ill take some of that!!

[DeLoreansgarage]

I just ran a 10gig Fiber line between my Mikrotik router and Switch and it's awesome!

[WoTpro]

really sweet tutorial, i didn't realize CPU speed had such a big impact on 10/40 gbps ethernet, kinda odd that it doesn't utilize multithreading on the cpu.

[ConfidentGrips]

Damn this is a serious build your making even Dave's garage look slow lol

[gustavocadena]

my network is junk, need a L3 ROUTER that can handle traffic and vlands. my plans are to join the 10 gb club but now after watching this video, i need to step it up to the 40 gb =) waiting for the DYI video/buy sheet

[ryanmalone]

Such a cool video. I adore this shit. I’m gonna build something similar with TrueNAS, gaming PC’s local, remote bare-metal gaming PC, and 3 gaming VMs using a shared Tesla and a dedicated RTX 3060, just for the fun of it and to learn. iPerf is fine for testing, but good luck getting anything remotely close from an UNRAID array unless you carefully lay out the data across all the disks and then query them consistently. Unraid is slow, even with NVMe, for numerous reasons.

[derekleclair]

Looking forward to rdma info with nfs or samba if it’s now available on Linux vs just windows.

[CDAWWGG]

Great video! Love to see more people getting into "Big boy" networking 40G and up! 2 things, have you considered the jump to 100 with Mikrotik's new $999 4 port 100G switch and do these brocades need any special licensing or anything for L2.5/L3 features? Looking at the POE version of what you got. Thanks.

[simonemastellonephotography]

Nice video, i bought two card Mcx354A -FCBT but my unraid is not able to discover in network setting, can you suggest how to make it working

[billygoatbilbs]

@DigitalSpaceport I recently bought a SX6036, could you help me configure the switch for ethernet license generation? i have been researching the guide server the home but i am short on time and would like a jump start.

[chionyenkwu]

Some motherboards (msi trx40 creator for example) allow you to fix the 2nd pcie slot at X8 and only drop it down if you explicitly set it to bifurcate ....

[madhupjoshua]

Can we connect the QSFP orange cable directly between two servers bypassing the brocade switch? I should work I think

[nsanerydah]

Great info and an idea to think about before using 10GB only. I know that my Synology can only do 10GB at the moment, but having the ability to upscale as components increase will allow for up to 40GB to future upgrades. Thanks for the information!!

[sfsfsdfsdification]

Great video! Were you able to connect this through Brocade icx6610? I'm getting only 10Gb (I have dual cards) and not sure if there is 40Gb license.

[smalltimer]

Would it be correct to say that the Brocade 6610 can only provide 40gbe to one client when connected to Unraid?

[activate__motivation]

what about unraid to pc ... no video about this, ppl not gonna buy that, , they will use what the motherboard came with, ,, highest is thunderbolt....

[ryanmalone]

What’s the point with Unraid? I have 2 servers running 2 x 10GbE each. Even when I was first copying data where all the disks were being used, I saw a max just over 1.5Gbps. Pointless. Unraid is SO SLOW.

[derekleclair]

Looking forward to rdma info with nfs or samba if it’s now available on Linux vs just windows.