Local AI models in JavaScript, with Xenova of Transformers.js

preview_player
Показать описание

Show Notes

00:00 Welcome to Syntax!
01:05 Who is Xenova?
02:08 What is Hugging Face?
06:16 How was the library developed?
09:04 How is it able to run?
10:09 Do they have to run in Python and how does Onnx work?
14:19 What are some things you can do with this tech?
16:15 Vision tools.
17:38 This is actually running locally.
18:35 Doodle Dash
21:09 They currently run on CPU, what is required to make it run on GPU?
24:44 Can you run in JavaScript?
28:32 How it works with image vectors.
34:23 Why would people want to run it in another language?
35:55 Resizing images in the browser instead of on the server.
38:55 Applications distributed on the web vs running locally.
46:30 Object Detection.
48:33 What is the easiest way to get started?
51:26 Real-time speech recognition on the horizon?
52:08 Will we ever be able to run Stable Diffusion via JavaScript?
56:10 The Web LLM.
57:22 Practical applications for YouTube.
01:06:43 Mean pooling, why it's necessary.
01:09:30 Stopping YouTube spam comments.
01:10:34 K-Means Clustering.
01:13:49 Quantization.
01:17:35 Sick Picks + Shameless Plugs.

------------------------------------------------------------------------------
Hit us up on Socials!

#webdevelopment #webdeveloper #javascript
Рекомендации по теме
Комментарии
Автор

TransformersJS is so awesome. I would love to see more practical demos and examples. Definitely need a follow up from CJ.

jonathankurtis
Автор

would love to see some visuals, when some of these demos were mentioned. we are very visual oriented lol

solidkundi
Автор

Thank you! It's very interesting, especially the last problem you presented.

korendani
Автор

Insane stuff. You think this is going to be a repeat of the Javascript story ? As in the early 2000's JS was used to do simple stuff, while all the UI was mostly build on web servers. Fast forward today, and all the UI is being built in JS/TS be it in the browser or the webserver :) Would the puck move towards ML models of smaller sizes running locally within JS runtimes instead of on the cloud ?

nikilk
Автор

I like transformers js, it will be cool to see how they solve the speech issue with whisper. I am especially interesting in nodejs side not browser side.

RyeinGoddard
Автор

Sponsor Block!? Scott must be fuming 😤

brokeloser
Автор

Upcoming Transformers.js tutorial with CJ?

juanmacias
visit shbcf.ru