HomeLab MEGA Storage - Home Data Center Guide | 60 Bay JBOD Disk Shelf | NetApp DE6600 / MD3060e

FEATURED GEAR

HOMELAB GEAR

DISK SHELF (JBOD) + CABLE

RAM

SERVER

SERVER RAILS + CABLE MANAGEMENT

HBA

ENCLOSURE

SWITCH

UPS

Be sure to 👍✅Subscribe✅👍 for more content like this!

Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching!

DSP Website

*****
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****

******
As an Amazon Associate I earn from qualifying purchases.
******

[ernestoditerribile]

Love that old style NetApp disk shelf on the left of that DE6600 so many Datacenters still use them. Those SFF 8088 connections on the back are rock solid.

[pavoutsinas]

Great content! This was actually on my wish list. Thank you!

[garrettcasada]

Excellent video, thanks for all your hard work.

[BloodyIron]

4:20 THANK YOU FOR DOING dBa VOLUME MEASUREMENT! (not enough equipment demos do this)

[RexMk]

Worked a lot with things like dell ISCI, eg. MD3220i and you actually need 3 things to get those if-6 working, first is out of band management going (special software, somewhat easy to find), then because they're pulled from god knows where you need to telnet and do a "lemClearLockdown" on each module, finally you need to let the controllers know there are 2 of them and that's "redundancyMode=duplex". You need the so called "root" password (it's not gonna be called root just fyi), which I can not share (but you do find it on the internet with enough searching). If you're really interested, you're going to find the answers. After that, you need to actually go in the management software, define your FC or IB, make same modifications on switches and be sure you configure the FC or IB adapters accordingly in linux (multipath is a b***h on linux). Heck of a headache, but the speeds are just like running the drives locally... PS: if the controllers still have passwords on them for the out of band management you're going to need to reset them "sysWipeAllConfigData"

[sysop]

Thank you. Always look forward to your content.. ...

[leo_craft]

16:50 that expander is for their san systems. Netapp DE like stands for disk expansion so that is made for their own san systems so the fiber optic connects to the san box and it controls the disk arrays (wich are raid controllers) and they connect to eac other using the qsfp connections so they require their san to work. Tho netapp made some expanders to work on normal pcs, it is not really ment to do that. The DS line stands for disk shelf and it is for connecting as das to a normal pc. That's why they can also be used as san expansion.

[JaCkFlApPiNg]

Hey buddy, well done on a run through of the magnificent DE6600 :)
Just a FYI, there is no measurement called "Amperage", the correct term is current.

[AviDarks]

Something is not clear to me, all this in your house? How much electricity do you pay?

Have you tried to look under the copper heatsink in the "active" EMM/IOM ? Also have you tried to see what does comes from it's IOIO (miniUSB) connector? I guess it could be some sort of service port meaning serial console. I think, it could be x86 based (socketed Intel CPU) and you probably could install different OS on it.

Few years ago I got my HB-1235 JBOD and as I was working a bit around Dell Compellent storages at that time, I got myself Dell SCv2020 controller marked as "for parts" (it got only broken SAS connector, that was probably causing POST issues and not passed manufacturing control)... and I knew, that especially Dell Compellent line is Intel CPU based (SCv2000/SCv2020 or SC4020 are E3-1265L v2 with 8 or 16 GB DDR3L RAM respectively in 2 slots and "management" ports are actually Intel X540-T2 10GbT chipset, it also has PCIe 3.0 x8 slot for different I/O types).
I managed to thinker with it a bit, as I saw at my job, how they update SCOS in SC4020, it has IPMI built in - yaay and also adapter from 3, 5mm jack to serial console was handy. I wasn't able to successfully install SCOS on it without original drives, but I managed to install TrueNAS and even VMware ESXi on it :D (it has 32GB SATA DOM inside), I just needed to reflash the firmware on the integrated LSI 2308 controller to non-OEM one to see the drives in the HB-1235 shelf. Now few years later, I still run it as off-site backup unit.


My observation is, that most of those Dell Compellent / MDxxxx / EqualLogic / NetApp / HPE 3Par / IBM and probably others (except EMC afaik) disk enclosures/controllers are OEM/ODM manufactured by former Xyratex (now Seagate) and use same Xyratex SBB format of controller I/O (as you mentioned one missing pin array in the controller I/O, I guess it could be for inter-controller communications e.g. cluster link).

Another interesting controller to look for is Flextronics SATIT2 (for Microsoft StorSimple arrays), I was looking for it for a while, but not needed to purchase one yet. It looks interesting as it is Intel socket 2011 based (=E5 v1 or v2 CPUs), has 4 memory slots and ConnectX-3 onboard with QSFP+ (probably 40Gb, but marked as 10GbE and not mentioned anywhere what are the real speed capabilities).

[gustavocadena]

Hey, that's a cool shirt, bro 😎

[DMN]

So with the I/F-6 IOM/EMM, they are the raid controller / brains of the SAN. They do run Santricity or whattever rebanded version your vendor calls it. They are basically full servers running VxWorks. The extra connector on them just links to the second module for failover / sync purposes. I've been working on getting the different versions working with different shelves, it takes some doing but it can be done. It's much easier if you have drives with firmware from the same vendor as the software running on them - eg if its a Netapp E5600 like what looks like you have, by default you need to run Netapp branded disks with the netapp firmware. You can bypass this check tho (bit more tricky). You can also flash eg a Netapp E2700 EMM to run the Dell MD3800 firmware, which dell makes publicly available, but didnt update it as much as the netapp firmware. Still locked, but dell is more laid back on flashing drives etc. Im currently working on putting together a big document of all part numbers of the LSI/Engenio shelves and controllers and firmwares from all the vendors and what works with what so you can build your own SAN's.

Personally my favroite at the moment is probably the Netapp E2700 / Dell MD3800 since they are more recent, more powerfull, and more popular to find, but I'm really wanting to get my hands on some Netapp E5600 which can have 96GB cache/DRAM instead of the 8GB from the E2700.

The newer ones are the E2800, which can support 25gbit ethernet, but seems like netapp may have made some physical changes to the pinouts, and they are still quite expensive, but thats next on my list to try and make work. Ping me if you want me to send a heap more info, and if you're open to id love to get remote access to some of what you have to validate my findings on my equipment

[vincentsieliakus]

Great video! Especially the part about the EMMs came in quite handy as the last video about these JBODs left me wondering. The only thing that isn't quite clear to me yet is the exact power consumption. Do you have some in depth numbers like: what's the power consumption using a singe power supply and a single EMM without any drives? How much additional power consumption for adding the redundant power supply, or for the redundant EMM?

[gxti]

That damaged power supply is an industry standard "quarter brick" module - you may be able to replace it. It may be press-fit or soldered, but in any case it's a much easier repair than the fiddly transformer bit by itself.

[InsaiyanTech]

I’m new to this stuff can I get one of these and fit it in any server rack ? Wanting to get one of these to just fill for my plex or storage in general

[kmyx]

Hi Buddy, thanks for the excellent tutorial, Please can u clarify for me if the ''Dell PowerVault MD3860f'' will work with Truenas?

[PrimalNaCl]

Wrt your stated minimum 20 drives for operation. Is that a "McSpecial NetApp" fw thing? I have a few MD3060E units and before I knew anything about them I used a single drive in the front top tray just to test and it worked fine.

Also using them without trays seems like begging the universe to wreck your life. On the 3060E units there is a switch the trays depress. Further it makes replacement a bit of a pita when any of the central drives need swapped and vibrational backing out is more likely to occur.

[UmbertoAmante]

All your drives show as sold out :( Any idea of when they will be back?

[charlesturner]

The modules with the RAM and heatsink in them are basically just Intel Servers, they do iSCSI/FC generally, meaning that if you could get your own OS installed on them you could use the array completely standalone.

[jameskrolak]

Wow. Super detailed video. I didn't catch if you stated what the power usage tended to be for 1 fully loaded unit. Those power connectors on the back of it are C19/C20. Those are more and more common in datacenters now, but usually are plugged into C19/C20 sockets on the PDUs to make sure it can handle the heat and current. I don't often see them cabled up to standard C13/C14 plugs. Not sure that there is any actual risk to doing it the way you did. (as long as the current doesn't exceed the cord or the plug)