Run AI language models locally on your phone - MLC LLM

preview_player
Показать описание
Supported platforms include: Android, iOS, MacOS, Windows

Music - Michael Wyckoff - It Do Be Groovin (Bonelab OST)
Рекомендации по теме
Комментарии
Автор

There is a model called by ethzanalytics. It's just 2GB and did pretty good on my tests. Perhaps the best of the small models, not available yet for web-llm. If they make that model available and on CPU then it'll run on almost any device.

jamesjonnes
Автор

This needs to be popularized by AI channels so that people fan optimize models for it.

On iOS it seems the download model option only works with their specific converted models.

Love this

Null-Red-Blue
Автор

Heloof eiend, thanks for your video, its possible you upload your mlc app because official link is down.
Thanks
Regards

Architecte_Q
Автор

Nice video but the app is absolutely horrible. No way to download other instances and the ones that you can download are just broken.

salvadorfonseca
Автор

What are you using to make the thumbnail? Is it custom pic and paid?

TheRealCaelestium
Автор

this does not work on mediatek processors

hiver
Автор

Hi i want to build this locally can someone please help ?

prateekdubey
Автор

Can smartphone use text generation webui in risu ai?, an how to get url

smut