The AMD Instinct MI300X GPU can handle the Meta LLaMa 60B parameter model on a single GPU. #amd

preview_player
Показать описание

Рекомендации по теме
Комментарии
Автор

A single GPU that can beat two of the fastest Nvida H100 GPU's, where MI300X raw computer power is 5, 218 TFlops. This is a Beast!

duladrop
Автор

Interesting form factor. Apparently called OAM(OCP Accelerator Module).

whyjay
Автор

Mi300x has 16 matrix cores per SM compare with only 4 matrix core per SM inside Mi250x.

It has supperior 5 PETA OPS INT8 compare with nvidia h100 &h200 only 4 PETA OPS. Also mi300x has higher fp16 and bfloat 16 compare with competition

kusumayogi
Автор

If it doesn't play Doom, it sucks!

Steven
Автор

Y’all know mofos gonna game this this shit for better looking water

elmoterminator
Автор

At what point are we going to stop calling these GPUs.

TSRB
Автор

is there any possibility to connect the part to a normal mainboard? 🤔

pawelheller
Автор

AMD has taught us not to believe in their performance claims for GPUs, so I won't believe Nvidia isn't going to humiliate this with something that pulls like 0.25x power.

ahmetrefikeryilmaz
Автор

fp16 is 653.7 TFLOPS, H100 nv is 4X that. and lisa can still lie and said they are faster, LOL

MARKXHWANG