Run your own Local ChatGPT on your PC: LM Studio (Linux, Windows & AMD GPU, LLM)

preview_player
Показать описание
Video on how to setup your local ChatGPT on your own PC using LM Studio.

Tested on:
Fedora Workstation 39
AMD Radeon RX 7700 XT
pytorch on ROCm 5.7
Llama model

🔗Links:

Chapters:
0:00 Intro
0:11 Install LM Studio
0:31 Add execution permissions
0:49 Start LM Studio
0:58 Download LLM Models
1:24 Model Selection and Configuration
1:57 Ask a question like you do on ChatGPT
2:18 Output of your LLM Model
Рекомендации по теме
Комментарии
Автор

Super useful video, man! Please, keep going! One thing, you forgot to press "reload" button after tweaking a gpu settings

Vostok_M
Автор

I can't see GPU option in lmstudio, I have Installed rocm exactly as in the medium article

abdullahzafar