World Record Backup Speeds: 2TB MS SQL Database with Glenn Berry

Join Wendell and Glenn Berry as they chat about Microsoft SQL Server discussions and tests!

*********************************
Check us out online at the following places!

-------------------------------------------------------------------------------------------------------------
Intro and Outro Music: "Earth Bound" by Slynk

Edited by Autumn

[MatthewSwabey]

I hope Microsoft and Intel are really grateful. I suspect that the engineers involved in the products are simply not supported to test these larger configurations.

[hectorvivis]

I have absolutely no business watching this, I'll probably never work on hardware dedicated for a SQL server, but goshdarnit do you make it enjoyable to watch.

[SuperMari]

Getting spoiled with 2 vids today! Awesome to see your enthusiasm Wendell!

[wizpig]

THANK YOU FOR GIVING MY SOLO SYSADMIN JOB DIRECTION

[ChrisJackson-jsrd]

i picked up at qat 8950 recently, i would love to see more coverage of pcie accelerators its not necessarily the easiest thing to take advantage of effectively depending on ur software/hardware stack. but with these older cards going for 30$ or so on ebay theres absolutely advantages over buying more cpu or ram on some workloads

[wyattarich]

Great video with a great guest! Love to see this content!

[NateWheeler]

Great conversation, guys. Fun project 😀

[adventuretai]

I'm normally a postgre guy but this is pretty interesting seeing how far Microsoft has come with SQL over the years. The licensing is still gonna drive me away every time but still, improvement is improvement

[wskinnyodden]

AMD must get their Xylinx FPGA HW embedded on the EPYC cores and then have dinamic softdrivewares (read QAT enabled by driver which implements it in FPGA logic) then they can have hardware QAT which at that is upgradeable and can also do other HW acceleration functions if QAT is not needed.
Been waiting for that for a while now!

[TayschrennSedai]

Really happy to see more enterprise content on here. I'll not show this to my dba as I don't want him to ask for a single bare metal server per sql system we have 😂

[samiraperi]

9:24 1026 cores? That's a weird number.

[urmastertech]

Wow! That is incredible to backup 2tb in under 1 minute! It has been a long time since I have user MS SQL Server, usually I just use MySQL or MariaDB. After transitioning over 2tb from MariaDB at work, I'm curious how long the backups take in AWS. I do not remember what we have setup on the RDS instance, but I thought it was all SSDs. I'll have to look on Monday.

[robertbruce]

I am going to play the clip with the rack showing the test system on a loop 😆😕

[JonathanSwiftUK]

It's not about how big your database is, it's about how many blocks changed since the last backup. We back up 40TB of file data in 30 minutes or less because we use change block tracking (CBT). I've backed up 300gb systems in 30 seconds, but it depends on how many disk data blocks have changed. If I backed up that 40TB file data (~50m files) file by file it might take days. Drive speed is largely immaterial when using CBT, our file data is on Azure HDD storage - the point is we're only backing up changed disk blocks. Pr1me Computers were testing this type of technology in PRIMOS 22, back in mid 1990s. CBT backups have minimal CPU, I/o, network use.

[bakedpatato]

edit: also it's pretty lame hardware acceleration is only available on Enterprise, hopefully it trickles down to Standard like how OG compression did back in the day
was pretty surprised to see Glenn on this channel! his blog is pretty informative and scripts are pretty slick (and so is Ola Hallengren's scripts too)
hopefully one day I'll be able to actually get SPR servers so I can utilize this at work, even if it's only for my non prod environment

[JmbFountain]

Could you also make a video showing the difference in performance of SQL Server on Linux and Windows on this kind of hardware?

[pnield]

People bag old white guys as knowing more than they do due to ‘entitlement', but sometimes old white guys just rock!

[locusm]

Shout out to Ola - his solution is comprehensive & bulletproof.

[TheLaurentDupuis]

In my experience, Windows Server doesn't work well with large number of cores. I also had some weird reset because of "hardware error" that I don't have under Linux. You should try SQL Server for Linux. You will be able to use all the cores.

[Wesrl]

Man if only I could get ECW/CPS to back up and run that fast. Hospital IT people know my pain