Training Billions of Parameter LLMs with MosaicML

preview_player
Показать описание
Featuring Hanlin Tang, CEO and Co-Founder of MosaicML and dives into how MosaicML can facilitate when training billions-of-parameter large language models.

This talk was originally delivered at Arize:Observe 2023, a conference on the intersection of large language models, generative AI, and machine learning observability in the era of LLMops.

  1. Arize AI
Рекомендации по теме
Training Billions of 0:24:35

Training Billions of Parameter LLMs with MosaicML

Parameters vs Tokens: 0:01:31

Parameters vs Tokens: What Makes a Generative AI Model Stronger? 💪

Introduction to large 0:15:46

Introduction to large language models

[1hr Talk] Intro 0:59:48

[1hr Talk] Intro to Large Language Models

Falcon LLM : 0:01:38

Falcon LLM : The 40 Billion Parameters LLM

Fine-tuning LLMs with 0:15:35

Fine-tuning LLMs with PEFT and LoRA

Fine-tuning Large Language 0:28:18

Fine-tuning Large Language Models (LLMs) | w/ Example Code

Fine Tuning LLM 2:37:05

Fine Tuning LLM Models – Generative AI Course

Llama 3.1 - 0:08:26

Llama 3.1 - 405B, 70B & 8B: The Ultimate Open Source LLM - Unmatched Power and Performance!

Training LLMs at 0:55:59

Training LLMs at Scale - Deepak Narayanan | Stanford MLSys #83

Training & Fine-Tuning 0:57:50

Training & Fine-Tuning LLMs: Techniques

MoE LLMs with 0:10:26

MoE LLMs with Dense Training for Better Performance

What are Large 0:05:30

What are Large Language Models (LLMs)?

Large Language Models 0:25:20

Large Language Models (LLMs) - Everything You NEED To Know

LLM Fine Tuning 1:21:01

LLM Fine Tuning Crash Course: 1 Hour End-to-End Guide

How ChatGPT Works 0:07:54

How ChatGPT Works Technically | ChatGPT Architecture

Building with Instruction-Tuned 0:59:35

Building with Instruction-Tuned LLMs: A Step-by-Step Guide

Fine-Tuning Generative Models 0:56:26

Fine-Tuning Generative Models | Foundational LLMs for Generative AI

How to Build 0:35:45

How to Build an LLM from Scratch | An Overview

QLoRA - Efficient 0:00:44

QLoRA - Efficient Finetuning of Quantized LLMs

Textbooks Are All 0:13:40

Textbooks Are All You Need

Fine Tune LLaMA 0:09:44

Fine Tune LLaMA 2 In FIVE MINUTES! - 'Perform 10x Better For My Use Case'

How to Train 0:00:43

How to Train Your Own LLM - Mike Conover of Databricks

What is generative 0:46:02

What is generative AI and how does it work? – The Turing Lectures with Mirella Lapata