Test 01- Testing Meta Llama 3.1 405B, 70B, and 8B: Bare-Metal Setup with GeForce 3090 on Windows 11

preview_player
Показать описание
Test 1: I ran a bare-metal Windows 11 setup with Ollama, Docker, and OpenWebUI installed, along with a GPU (Geforce 3090 24GB).

Рекомендации по теме
Комментарии
Автор

thank you for testing, but I would recommend to measure tokens per seconds instead of measuring time manually

gurkal