Build your own LLM on Google Cloud

preview_player
Показать описание
Custom large language models (LLMs) can be fine-tuned and deployed using Google Kubernetes Engine (GKE) and Cloud Run. Watch along as Ali Zaidi, Solutions Architect Google Cloud, demonstrates the architecture of a custom LLM on Google Cloud as well as how to get started today. Check out the GitHub code repository below to get started.

Chapters:
0:00 - Meet Ali
0:31 - Demo architecture
1:29 - How to fine-tune LLMs
2:07 - How to deploy LLMs on GKE & Cloud Run
2:51 - Chatting with the LLMs
4:14 - Wrap up

Resources:

#GoogleCloudNext #GoogleGemini

Event: Google Cloud Next 2024
Speaker: Ali Zaidi
Products Mentioned: Google Kubernetes Engine, Cloud Run, Gemma
Рекомендации по теме
Комментарии
Автор

Can someone without any experience execute an LLM?

thetroytroycan
Автор

Can anyone explain how to run this project step by step its an emergency.

smilingstars
Автор

update Google account all details vivo y31

sithirasarava
Автор

Why would I not just deploy an open source quantized model using WebUI and then use MagickML (which you sponsor, poorly) to add recursive self awareness to a model cobbled together from garbage that runs better than anything your corp has ever made?

Atmatan