Start Running LLaMA 3.1 405B In 3 Minutes With Ollama

preview_player
Показать описание
Meta just released an upgrade from LLaMA 3 to LLaMA 3.1 with a whopping new 405B parameter model variant! Thank Zuck for GPT-4o level intelligence that is open sourced. In this video, I'll show you how to deploy a multi-GPU cluster and how to set it up with only a few terminal commands. I hope this video helps and I appreciate you for watching!

► Allyson AI - Your AI Executive Assistant:

► FREE Guide For This Video:

►Tools Featured in This Video:
Ollama
Vast

► TIMESTAMPS:
0:00 - Intro to LLaMA 3.1 405B
0:23 - Start a Multi-GPU Cluster on Vast AI
1:34 - Install Ollama CLI on Linux
1:56 - How To Install LLaMA 3.1 405B
2:04 - LLaMA 3.1 405B Demo on Ollama
2:54 - Testing LLaMA 3.1 Jailbreak Prompt

► All My Links:

► VIDEOS YOU DON'T WANT TO MISS:
  1. Isaiah Bjorklund
  2. llama 3
  3. llama 3.1
  4. llama 3.1 405b
  5. llama 405
  6. llama 405b
Рекомендации по теме
Start Running LLaMA 0:03:38

Start Running LLaMA 3.1 405B In 3 Minutes With Ollama

How To Run 0:06:21

How To Run Llama 3.1: 8B, 70B, 405B Models Locally (Guide)

Llama 405b BEAST 0:06:12

Llama 405b BEAST already exploited | Here’s how

'I want Llama3.1 0:25:34

'I want Llama3.1 to perform 10x with my private knowledge' - Self learning Local Llama3.1 ...

Llama 3.1 is 0:07:05

Llama 3.1 is ACTUALLY really good! (and open source)

Zuck's new Llama 0:04:13

Zuck's new Llama is a beast

Llama 3.1 405b 0:11:59

Llama 3.1 405b model is HERE | Hardware requirements

LLaMA 405b Fully 0:10:02

LLaMA 405b Fully Tested - Open-Source WINS!

Run Llama 3.1 0:10:19

Run Llama 3.1 locally using LangChain

EASILY Train Llama 0:14:51

EASILY Train Llama 3.1 and Upload to Ollama.com

Build Anything with 1:00:31

Build Anything with Llama 3.1 Agents, Here’s How

This Llama 3 0:14:58

This Llama 3 is powerful and uncensored, let’s run it

How to Use 0:02:35

How to Use Meta's LLaMA 3.1 405B Model AI for Free | No Chat Limits, No Deployment Needed

Llama 3.1 405b 0:32:49

Llama 3.1 405b Deep Dive | The Best LLM is now Open Source

Llama-3.1 (405B, 70B, 0:05:48

Llama-3.1 (405B, 70B, 8B) + Groq + TogetherAI + OpenWebUI : FREE WAYS to USE ALL Llama-3.1 Models

Llama-3.1 (405B, 70B, 0:10:21

Llama-3.1 (405B, 70B, & 8B) + ContinueDev FREE Copilot! Fully Locally and Opensource!

LLaMA 3 Tested!! 0:15:02

LLaMA 3 Tested!! Yes, It’s REALLY That GREAT

'I want Llama3 0:24:02

'I want Llama3 to perform 10x with my private knowledge' - Local Agentic RAG w/ llama3

Llama 3.1 better 0:13:18

Llama 3.1 better than GPT4 ?? OpenAI vs Meta with Llama 3.1 405B model

LLAMA-3.1 405B: Open 0:13:55

LLAMA-3.1 405B: Open Source AI Is the Path Forward

Llama 405b: Full 0:26:50

Llama 405b: Full 92 page Analysis, and Uncontaminated SIMPLE Benchmark Results

Llama 3.1 | 0:14:41

Llama 3.1 | Meta is leading Open Source AI

Llama 3.1 Is 0:16:08

Llama 3.1 Is A Huge Leap Forward for AI

LLaMA 405b is 0:15:51

LLaMA 405b is here! Open-source is now FRONTIER!

Комментарии
Автор

Your AI Executive Assistant - Hire Today For Only $49/mo

isaiahbjork
Автор

If this is what we get with 8 Gpu, then I am sticking to 70b for now.😢

abhijitramin
Автор

Thanks for the concise explaination. Simple and clear! (Comment for the algorithm).

TacticalCastle
Автор

I got a question, when I look in ollama the model requires aprox 335gb storage room but when I try to download it directly from meta the say it needs 750gb, why do you think is this difference?

king-zk
Автор

That's slow and not quite usable, what vast cluster should be faster and cost effective ?

carlosap
Автор

You said you would have the "jail break" prompt below.. I don't see it?

TacticalCastle
Автор

That's so slow, seems unusable in this way!

xcviij
Автор

Why is so Can you do something to spped up this??,

allo.allo.