Use Ollama to test Phi 3 on your local PC

preview_player
Показать описание


Microsoft's new language model (SLM), Phi 3, is so small you can run it locally on your device. So, in this video, let's learn how to do that, and why you might want a small language model running locally. We'll install Ollama, download the model Phi 3, run it through its paces, and talk about why you might want this option.

Links:

Chapters:
0:00 Introduction
1:33 How to get Phi 3
3:02 Testing Phi 3
3:45 What is the point of using this locally?

Apart from publicly accessible information, all user data or other related information shared in this video is created for demonstration purposes only. User accounts, passwords, or other data used as part of any demonstrations shown in this video have been created specifically for that purpose and are not any individual or company's private information or data.

  1. Bright Ideas Agency
  2. artificial intelligence
  3. run llm locally
  4. large language model
  5. llama 3
  6. phi 3
Рекомендации по теме
Use Ollama to 0:07:21

Use Ollama to test Phi 3 on your local PC

Function Calling with 0:17:29

Function Calling with Local Models & LangChain - Ollama, Llama3 & Phi-3

Hands-on: Spring AI 0:18:07

Hands-on: Spring AI with Ollama and Microsoft Phi-3 🚀 🦙 | Run LLMs locally and connect from Java...

LLaMA 3 Tested!! 0:15:02

LLaMA 3 Tested!! Yes, It’s REALLY That GREAT

Using Ollama to 0:09:30

Using Ollama to Run Local LLMs on the Raspberry Pi 5

How To Use 0:08:27

How To Use Meta Llama3 With Huggingface And Ollama

Phi-3+ContinueDev+Ollama: STOP PAYING 0:03:54

Phi-3+ContinueDev+Ollama: STOP PAYING for Github's Copilot with this NEW, LOCAL & FREE Alte...

How To RUN 0:08:47

How To RUN ChatGPT Like LLMs On Raspberry Pi 5 With OLLAMA (TinyLLaMA, PHI & More)

This new AI 0:04:37

This new AI is powerful and uncensored… Let’s run it

Ollama Phi 0:01:22

Ollama Phi 3 vs Llama 3 Test on Apple M2

A Quick Guide 0:02:30

A Quick Guide to installing Microsoft Phi-3 (using Ollama)

Easy 100% Local 0:06:50

Easy 100% Local RAG Tutorial (Ollama) + Full Code

Shocked at the 0:03:48

Shocked at the results Meta Llama 3 vs. Microsoft Phi-3 vs. OpenAI ChatGPT 3.5

Using ollama and 0:16:37

Using ollama and phi3 in VS code as an github copilot alternative

Getting Started on 0:11:26

Getting Started on Ollama

Llama 3 8B: 0:17:32

Llama 3 8B: BIG Step for Local AI Agents! - Full Tutorial (Build Your Own Tools)

Fine Tune LLaMA 0:09:44

Fine Tune LLaMA 2 In FIVE MINUTES! - 'Perform 10x Better For My Use Case'

Build Anything with 0:12:23

Build Anything with Llama 3 Agents, Here’s How

Python RAG Tutorial 0:21:33

Python RAG Tutorial (with Local LLMs): AI For Your PDFs

Phi-3+Streamlit+Ollama : STOP 0:04:50

Phi-3+Streamlit+Ollama : STOP PAYING for ChatGPT with this NEW & LOCAL RAG Chatbot! (PDFs, DOCs)

LLaMA 3 “Hyper 0:12:51

LLaMA 3 “Hyper Speed” is INSANE! (Best Version Yet)

Local Function Calling 0:19:31

Local Function Calling with Llama3 using Ollama and Phidata

Phi-3 BEATS Mixtral 0:21:48

Phi-3 BEATS Mixtral AND Fits On Your Phone!

LLaVA 1.6 is 0:05:41

LLaVA 1.6 is here...but is it any good? (via Ollama)

Комментарии
Автор

Hi Nick,
I have experimented with local access to LLMs, I have a PC that has a GPU and have set up LM Studio and docker to run models, My aim was to ingest my own documents and enable summarisation etc, reasonable success once I worked out how to get it to read my own docs in dropbox, I'd appreciate more videos on LLM on PC
🙏

DavidWhite-citc
Автор

Great so now we can install fully trained - uncensored AI, on our local machines and ask it any illegal question, such as: how to build a weapon of mass destruciton. Isn't this exactly what AI developers said they would protect us from being able to do?

chillzwinter
Автор

Hi Nick,
Great Video! Just had a question what is the specs of your local PC? Does It have any GPU? I'm asking it to understand thoughtput of this model using CPU only

debarghyamaity