How to Run 70B and 120B LLMs Locally - 2 bit LLMs

preview_player
Показать описание
This video shows step by step process to locally install big AI models like 70B, 120B or above locally on windows. This video installs Kafka 70 LLM locally.

#2bitllms #kafka70b

PLEASE FOLLOW ME:

RELATED VIDEOS:

All rights reserved © 2021 Fahd Mirza
Рекомендации по теме
Комментарии
Автор

what is minimum system requirement? I mean RAM, VRAM etc.

Eldiablo-iwnb
Автор

Does it work with ram 16 i3 one vige1000mega

QorQar
Автор

great vid! can you make a video on how to install llama.cpp on windows? I followed the documentation but it works very slowly (1 token per second) I don't know what I am doing wrong

ajwashahid
Автор

Great video! Is it possible that the model contains virus?

rinternet