The 5 Types of LLM Apps

The 5 Types of LLM Apps
#llm

My Links:

Github:

[maxiimillion]

Whenever you release a vedio, honestly it narrows down the understanding of base case use of these LLM. Things I've been searching for the last years summarised in just 15min. Wow

[catchychazz]

If you read the NYUtron paper, they are using LLMs in healthcare to replace survival analysis, and other traditional ML models. Their LLM beats their boosted trees and other SOTA models.

The thesis is that a lot of time-stamped healthcare data is interpreted and summarized by an expert into human language, which can be picked up and analyzed by a language model.

[ikituriflash]

Very good. Totally my impression as well. Building with an agent that assists customers and checks the logfiles to troubleshoot their issues.

[silvacarl]

Sam is a genius. Sam fine tune a Sam LLM so we can ask it LLM questions

[dawid_dahl]

This video made me turn on the notification bell. Excellent value of content and I would love to hear more on this kind of practical AI topic. 🙏🏻

[Aidev]

Great video. You asked for engaging comments, so let me try.
1. To me, categories 1 and 3 are the same. It's à chatbot. With or without RAG...
2. I think that there is room for RAG apps, especially SQL based. It's not trivial, and customers won't upload their databases to chatgpt. So, for example, I've created a langchain app for my customer. On top of their DB. It does have value, and it's not trivial.

3. Automation and self learning systems, yeah, but again, it's only for big firms. And they won't take a freelancer for that in general.

[yazanrisheh]

Hey Sam. Thank you so much for this video and I actually didnt know about the 4th Point which is the NLP Tasks. I was wondering could you do videos on how can we do that? For example, do you use langchain, llama index or how exactly? Thanks again!

[singvijaya]

This is categorization quite useful to see, how other applications gets clustered

[KimSiaSim]

Do create a YouTube playlist dedicated to Autonomous Agents. I prefer to focus on that area. Thank you, Sam

[ibrahimnasser]

Wow, excellent video. I am starting to piece things together. It would be great if you can make a video in which you can summarize the current approach for each of the five types of large language models that you mentioned, and what open source models are available for each type.

Thank you so much!

[markomilenkovic]

Thanks Sam for another great video! More autonomous agents please :)

[andrewbednar]

Don’t forget that a traditional ML company expanding into these GenAI apps are going to have an advantage over the start up. They already have customers, and they have a history long enough to suggest they will still exist a year from now.

[zoombapup]

I use LLM's for embedding things like planning in autonomous systems outside of the language domain. You can see some papers on using language as an augmentation to things like robotic helpers (lots of the intelligent agents stuff at deepmind). My own work uses language as grounding for instruction following and extraction of behaviours for AI characters. So maybe there's actually another app type that isn't directly an LLM app but uses it as a foundational model? I do enjoy coding the other types, but they're a bit cheesy :)

[aaroldaaroldson]

wonderful and intriguing times, indeed. Before, in the field of AI, demand for hard skills were predominant, but now, I think, imagination and creativity are getting more and more important.

Kinda reminds me the early 00’s when we thought that the ability to rotate and having millions of basically “unnecessary features” - were the purpose of cell phones.

but then iPhone came up and literally changed everything. I believe the same thing is happening right now with the AI

[shyama]

This ia a great summary. thanks Sam. Can you share more on the autonomous agents part? I'm assuming you don't just mean software tools that are already making ML decisions?

[souvickdas]

Hi! thanks for your nice videos. I wanted to know that how we can evaluate the performance of LLM in terms of text generation like how factual they are how easily understandable they are and so on. If we do not have the reference text to calculate the BLEU score or ROUGE score, what could be the possible parameters or method to automatically evaluate or compare the performance of the LLM? This question is for other viewers as well. Please share some ideas.

[rajeshkz]

@sam, Very information video. Are there any github projects or tutorials you recommend to learn a moderately complex autonomous agent.
I'm looking at use cases where the LLM App listens to chat conversations between multiple users of an ERP application and interjects autonomously if the LLM can carry out tasks that it can perform with-in the context of that conversation. For example, Rerunning an account reconciliation task, if the conversation between the two accountants has messages such as "I've updated the debit entries and ready for reconciliation"
Specifically, how can i enable the LLM to continuously listen to the conversation and only jump in and perform the task if the task is relevant to the content of conversation and ignore all other conversations.

[zainabfahim]

Would appreciate videos on autonomous Open Source agents

[picklenickil]

We often forget the real power of LLMs

Which is text generation.

It's a shame why there isn't much going on for automation in docs management, compliance or other mundane tasks..that LLMS can really take over by doing the "heavy lifting"

[waynejackson]

What are the prerequisites to learning how to build autonomous agents