filmov
tv
How I Ran an LLM on a 5-Year-Old Android Phone with LLaMA.cpp
![preview_player](https://i.ytimg.com/vi/v7lBubmyj3Y/maxresdefault.jpg)
Показать описание
In this video, I show you how to run large language models (LLMs) locally on your Android phone using LLaMA.cpp, a framework that simplifies LLM deployment. I demonstrate this by running an LLM on a Xiaomi Redmi 8, a 5-year-old low-end phone with 4 GB RAM and Snapdragon 439 SoC. You will learn how to set up LLaMA.cpp, choose the right model for your device, and interact with the LLM using the LLaMA.cpp WebUI. By the end of this video, you will be able to run LLMs on any Android phone without relying on the cloud or internet connection.
How I Ran an LLM on a 5-Year-Old Android Phone with LLaMA.cpp
[1hr Talk] Intro to Large Language Models
I Ran ChatGPT on a Raspberry Pi Locally!
Launch an LLM App in One Hour (LLM Bootcamp)
How to Fine-Tune an LLM with a PDF - Langchain Tutorial
Building Real-World LLM Products with Fine-Tuning and More with Hamel Husain - 694
UNCENSORED Mistral v0.2 Dolphin LLM - Won't Refuse Anything!
Finetuning Open-Source LLMs
LLama3.1 - First Impressions
Phidata: Build An LLM-OS! AI Assistants with Memory, Knowledge and Tools!
5 Levels Of LLM Summarizing: Novice to Expert
Run ANY Open-Source LLM Locally (No-Code LMStudio Tutorial)
How to Choose an LLM
A language for LLM prompt design | Guidance
Running Generative AI & LLM on a Kubernetes Cluster | Cloud Institute
Intro to LLM Security - OWASP Top 10 for Large Language Models (LLMs)
Building an LLM Application with Gradio
How to Install a Local LLM for Free (No Coding Required)
LLM Contamination 🪲 How LLaMA 13b 'BEAT' GPT4
Creating a Plant Care Computer Vision and LLM Project from Scratch Running Locally with Viam
LLM Project | End to end LLM project Using Langchain, Google Palm in Retail Industry
Meta drops new LLM based testing
LLM Evals and LLM as a Judge: Fundamentals
Your LLM, Your Data, Your Infrastructure
Комментарии