filmov
tv
LLM economics The Cost of leveraging Large Language Models
Показать описание
Speaker:
Nikunj Bajaj
CEO & Cofounder, TrueFoundry
Abstract:
Most of us are using LLMs and some of us are getting to the point where LLMs are going to production. Honeymoon phase is going to get over soon and practical realities like cost & maintainability are going to become mainstream.
However, the cost of running LLMs is not well understood or often not put in perspective. In this talk we will dive deep into what type of costs are involved in building LLM based apps. How do these compare when you run RAG vs Fine tuning, what happens when you use Open Source vs Commercial LLMs?
Spoiler- If you wanted to summarize the entire Wikipedia to half its size using GPT-4 8k context window, it would cost a whopping $360K!
Nikunj Bajaj
CEO & Cofounder, TrueFoundry
Abstract:
Most of us are using LLMs and some of us are getting to the point where LLMs are going to production. Honeymoon phase is going to get over soon and practical realities like cost & maintainability are going to become mainstream.
However, the cost of running LLMs is not well understood or often not put in perspective. In this talk we will dive deep into what type of costs are involved in building LLM based apps. How do these compare when you run RAG vs Fine tuning, what happens when you use Open Source vs Commercial LLMs?
Spoiler- If you wanted to summarize the entire Wikipedia to half its size using GPT-4 8k context window, it would cost a whopping $360K!
0:31:04
LLM economics The Cost of leveraging Large Language Models
0:31:23
$360k Question - Understanding the LLM Economics // Nikunj Bajaj // LLMs in Production Conference
0:35:30
Building an LLM Cost Calculator App: Unit Economics of LLM
0:08:35
LLM Avalanche: Nikunj Bajaj: The $360000 Question:Understanding the LLM Economics
0:05:41
Ep. 507: Who Will Fund A $1 Trillion LLM? #ai #llm #technology #artificialintelligence
0:01:29
Avoiding LLM-induced bill shock by understanding the unit economics behind it.
0:10:45
Is a master's degree worth it? | My LLM experience
0:17:35
Frugal GPT 3 Strategies or Steps to Reduce LLM Inference cost
0:25:47
Economics Teaching & Learning with AI: Tools for Students & Teachers!
0:31:09
ChatGPT/Generative AI LLM Models – Some Cost & Risk Considerations
0:01:23
LLM in International Economic Law at the University of Warwick
0:08:33
Why China is racing ahead in AI, and in everything else: their whole economy is open source
1:14:48
Sergio Correia on Unlocking Economic Data with LLM
0:02:18
What is the cost of an LLM at Cambridge?
1:02:59
FrugalGPT: Better Quality and Lower Cost for LLM Applications // Lingjiao Chen // MLOps Podcast #172
0:12:12
How much does it cost to Fine-Tune Flan-T5 LLM models?
0:05:05
What is the cost of an LLM at NUS?
0:00:56
Why Harvard Graduates Chose Lesser Economics - Robert Grant
0:00:50
How I spent my $200k lawyer salary #shorts
0:02:07
Sam Zell: Get a Law Degree
0:00:19
Most Useless Degree? #shorts
0:07:20
Should I get an LLM (Masters of Law)
0:02:18
Kaoru, LLM in International Economic Law, 2019
0:04:02
EC'24 Workshop Talk: Auctions with LLM Summaries
Комментарии