How fast is an RTX A5000? - Cloud Gaming Server Pt.22

It is almost 5 years to the day since I published my first video about Cloud Gaming, and wow, have things changed since then. Official GRID-supported GPUs from the Maxwell and Pascal lineups are less than $150, but their performance is far from ideal when it comes to modern games. If only there were some GPU out there that could run modern titles, cost right around $1000 used, and was unlocked for vGPU support...

Everyone... Meet the Nvidia RTX A5000.

But first... What am I drinking???

Lassen Aleworks, Eagle Lake IPA (Susanville, CA) 5.7%

Parts from today's video:

Support me on Patreon and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.

Timestamps
0:00 - Intro
2:37 - The story so far...
5:09 - Meet the RTX A5000
6:52 - Meet the hardware
8:33 - Meet the SSDs
10:20 - Synthetic Testing
12:39 - Tiny Tina's Wonderlands
13:39 - Starfield
15:10 - Wreckfest
16:00 - Grand Theft Auto V
17:34 - Cyberpunk 2077
19:09 - Conclusion
21:53 - Beer Review

[Kasrkn]

im a simple nerd. i see a cloud gaming server - i press like.

[_Turbocat]

"Some may look at this and say that I have an unhealthy obsession with Enterprise graphics cards, this isn't even half of my collection"

Has the same energy of "You're not wrong. you've just underestimated me...." 🤣🤣🤣

[ProfTheorie]

Just wanted to give my heartfelt thanks to you Jeff. A while back I discovered your channel and have binge-watched most of your videos regarding cloud gaming, virtualisation and server hardware since then. Your videos (especially the Hyper-V paravirtualisation) allowed me to get my sort-of gaming-server (Im still sitting on it bare-metal but also hosting VMs and streaming all over the place) using Hyper-V GPU Paravirtualisation going, something I wanted to do for over a decade. 2 simultaneous games? No problem. Streaming an emulator running in a vm to a computer 300km away? Works just fine. Incidentially this has also revitalised some old laptops that can now be given some computing power.

Ill be testing out 3x Baldurs Gate on one 6900XT + 7900X3D this weekend, lets hope it works. If it does 2 people will be saving quite some money not having to buy a computer.

[saberknight]

Yes, please cover virtualization on consumer Ampere, that would be sick! The RTX 3090 is typically hundreds of dollars cheaper on the used market than its A-series VRAM equivalents, but with even more cores!

[Combatwhombat]

I was able to OC my pair of A4000s by 24% while dropping their draw down to 118W completely stable. Yeah, workstation cards are pricey but you're also getting some of the highest binned chips. It's my home ML rig for a few projects so the design goal was to max VRAM and tensor cores under a low power envelope.

Games pretty well when it's not crunching numbers.

[codeman-dev]

"...this isn't even half of my collection"

My genuine response that intro: "(chuckle) I love you dude"

[TurboJailer]

I love your gaming virtualization videos. All I want is an XP VM to play my old games. 😥

[CharlesofState]

Any chance for a budget oriented follow up video? Id like to have a single virtual gaming vm as part of my proxmox stack. A guide and hardware list might be a good video for the future.

Great video though! Its cool to see these types of configurations even if the licensing and cost put them out of homelab reach.

[paul-ti]

As someone that also have expensive ideas but no money, this channel it's a godsend lol

[dionelr]

I started a home lab because of your channel. I love what I can do. Thank you.

[Kamology_]

I have 2 P40s that I was intending primarily to use for LLMs and cloud gaming and I’m having a really hard time justifying keeping them seeing their market value double in the last 2 months lol

[greenprotag]

This is great. I feel like the secret to the old budget "CHAD-well" system to get slightly better individual VM performance would likely be to use MULTIPLE P4s instead of fewer more powerful cards... individual SSDs for OS, then perhaps a POOL for slower bulk storage for older smaller games. The Epyc and A5000s are definitely pie in the sky territory. It looks like Crazy fun, but I would be lucky if I saw that kind of GPU hardware in a work setting. But you know that. We will continue to be scrappy on the budget end and give Haswell/Bradwell & Pascal the BEST opportunities we can to optimizing the storage and VM resources.
I may also be exploring cheap used gaming PC hardware as a "stack"
Ryzen 3600/5600 and i7 8700/9700 gaming PCs with GTX 1650/ RTX 3050s or A2000s might give VMs on the HIGH end a run for their money... they would be expensive potentially, but they could be bought and assembled one good ebay/FB marketplace deal at a time. That or perhaps Erying 12th/13th gen micro ATX DDR4 boards...

[Anatolihan]

The video is excellent but you are leaving out so much content that needs answers!
- Are GRID drivers overall worth it over passing through a consumer GPU in proxmox ?
- Were you able to get max GPU utilization under load (in benchmarks i'm at 100% but in cyberpunk virtually caped at around 60% on 4090)
- Is the head dissipation / power utilization better on A5000 vs 4090 ?
- What's the proxmox config

SO MUCH QUESTIONS !

[sientdave]

Gotta admire a sponsor that's prepared to fund a video describing how to replace their product 😀

[johnathonnow]

As someone who lives near Lassen, you're saying it right.

[iantiller-mohr]

I am driving through Susanville, California right as you mentioned your beer selection.

[Antassium]

0:00
Nah, you have a problem of not ENOUGH! 😂

[southofgrace]

Im really excited you mentioned using this for workstation. This is exactly the type of system I have been dreaming of. Multiple instances of VMs to avoid dual boot. Running CAD for engineering business. I never want to worry about software updates on those VMs and launch multiple instances for different projects. Thanks

[GunrHook]

Pretty slick. I'm still rocking a P4 myself after watching some of your videos. R720 Poweredge with a P4 running HyperV 2022 and GPUP to a Win11VM, also running InvokeAI and Ollama off that card as needed. I can't tell you how much I have loved your videos and I have wanted to 3D accellerate VMs since we started using them!

[HiTechLoLife]

The dedication to your cloud gaming project is commendable.

Probably would've driven me crazy before the first year ended lol