PC Hardware Upgrade For Running AI Tools Locally

#stablediffusion #ai #hardware #blackfriday

With the holiday season approaching, this video summarizes the system requirements of popular AI tools to run them locally and presents a recommendation for an entry level PC (separate components or prebuilt) that can run most AI tools without limited functionality. I also show you which PC I am using and give the reasoning why I needed the specific hardware.

BTW I have been completely knocked out by a flu for the past weeks and it took a while to feel better. This is why I haven't uploaded any videos recently but I plan to make new tutorials more regular again now.

Links:

(Disclosure: As an Amazon Associate, I earn from qualifying purchases. Clicking on and purchasing products through these links won't cost you any extra. They help support this channel and allow me to continue providing valuable content)

My PC components:

Prebuilt PC similar to mine:

$1000 AI Entry Level PC Components:

Prebuilt Entry Level PC:

Chapters:
00:00 Intro
00:50 Stable Diffusion System Requirements
01:19 AI Audio System Requirements
01:52 AI Chatbots System Requirements
02:26 Other Use Cases
03:00 GPUs for AI tools
04:28 CPUs for AI tools
05:02 Storage for AI tools
05:50 Entry Level PC Components
06:03 Prebuilt Entry Level PC
06:09 Premium PC Components
06:25 Prebuilt Premium PC
06:37 Pros and Cons of prebuilt PCs
06:57 Summary
07:39 Pros and Cons of using AI tools locally
08:30 Gaming

[fulldivemedia]

will you make an update of this extremely helpful hardware combos for Pc running Ai ? its now july 2024 ....things have changed most likely, right ? would You still today in july 2024 do the same upgrade you did here 7 months ago ?

[abbath]

Thanks for the information, and the comparison between ssd and m2 speed! I'm subscribed!

[taylorfrancis]

Might should have mentioned that if you don’t follow his instructions on the 4090/4080 cable your very expensive gpu is gonna burn to a crisp

[fofoqueiro]

Thanks for sharing. I built a pc for local AI training and inference of similar setups. Besides, I also purchased an upgraded PSU to ensure enough power supply.

[vulcand]

I bought a supermicro x299 board because with the 9000x cpus you get enough pcie lanes to power 4 pcie x16 GPUs at least at x8 speeds. Also this board slots allow for 4 dual slot GPUs. You can gey faster systems even modern ones but you will get crap 20 pcie lanes.

[FrostDagger]

Thanks. Local ai is better because its free and unrestricted. The corpo ai restrictions handy cap them selfs.

[pointlesspos]

Did you test how RAM speed impacts things? I have 2 3090's and 128GB ram, but not the newer faster ram.

[Beauty.and.FashionPhotographer]

will you make an update of this extremely helpful hardware combos for Pc running Ai ? its now july 2024 ....things have changed most likely, right ? would You still today in july 2024 do the same upgrade you did here 7 months ago ?

[MichaelBTryn]

I realy want a couple of 4090s to run a gpt3 😢

[izkopz]

I want to build something AI focused, what could I buy mainly for 1000-1200$?

[GrecoFPV]

What is the average price of power consumption electricity per month with this accessible 24/7 ?

[parthwagh]

Can you please provide a specification for PC build of $2400, which will run ai models locally in fastest way possible at this price. What things we should consider when building PC solely for running ai models locally and rarely gaming? What really helps to run this model fastest locally? please provide related information also. I want to build a PC with budget of $2400. Thank you.

[leopoldomolina]

I thought that AI for chatbots require less PC power than for images or video generation but you mentioned almost at the end of your video, that a $1000 cheap option will be fine for starting in AI but not for chatbots. I got confuse. Could you explain please?

[FederickTan]

Great video!I am really confused on which package & model of gpu & cpu to buy.I have seen these recommended package:

AMD Ryzen 7 7800X3D Processor



Deepcool AK400 DIGITAL - AFTERSHOCK Edition



Gigabyte B650M Gaming Wifi



Gigabyte RTX 4090 Windforce V2 - 24GB



32GB Team T-Force Delta RGB 6000mhz (16x2)



2TB Lexar NQ710 Gen4 SSD



850W Deepcool 80+ Gold ATX3.0 (ZC850D)



AX Wireless + Bluetooth Included

Is this package powerful & fast enough to run majority of AI applications & video rendering?Does the number of cores and threads in CPU affect the performance & speed of AI workloads?Should i buy intel or AMD processor?
I would like to hear your recommendation 😍

[jayanthl]

2 rtx 3060 for llms, what do you think bro ?

[zeldars]

Does a cpu with npu not help much in an llm model?

[nishilbhave]

sometimes your AI voice is too quick. not able to get some words

[ceryx]

Dude your audio edit is horrible. Like probably one of the worst i'v ever heard.

thank you for this video anyways. Information wise it was very helpful to me.

[juicycs]

What about for amd card or is ai tools only Nvidia