#Deepseek R1 671 local #ai running soon!

[nvadito]

In 20 years, someone’s gonna use your video with the title: This is how enormous computers were just to run a small 671b model.

[Qbit.kuwait]

Thats awesome, waiting for the breakdown of this deepseek setup👍

[joji]

DSP... The way you undo those memory cartridges... I bet you were pretty popular in your younger days 😉🎉

[DvACtOid]

Can’t imagine how big is the bottleneck is the bandwidth from ram to CPU.

[spencersmith]

Bro lets go! Im pumped for this video! Im currently contemplating buying a few mac studios in a exo hive lolol

[ModusAdroitOfficial]

Ok...i need to know how these memory cartridges work lol

[prozac]

I wish someone fixed this llm crap so it runs on a toaster

[Raimas]

No need for all that ram. I’ve got 671b running with 145gb of ram sharing with 20gb vram

[crazykkid]

So i found the server is Dell r930. But man the E7 seem newer than the E5 but they seem even worse. Be cool if you could provide some cpu performance numbers. Couldn't imagine going backwards from E5 though.

[meguzhev]

DDR4 in non GPU server O_O ... Good luck with the first Deepseek's answer in mid 2027.

[kiwiki]

I have the same exact server config but with less ram, i will try it to

[complexity]

You need GPUs or APUs -- not CPUs.
You can do it on CPU or ARM or amd64, but that wouldn't be as energy/time efficient.