Constraining LLMs with Guidance AI

preview_player
Показать описание
In this video, we'll learn how to use the Guidance library to control and constrain text generation by large language models, specifically integrating it with the llama CPP library and the Mistral 7B model.

We'll build an emotion detector with help from functions like select which restricts generation to an array of values and gen, which can be controlled by regular expressions.

We'll also learn how to create reusable components and output results in JSON format.

#LLMS #Mistral7B #Guidance

Resources
Рекомендации по теме
Комментарии
Автор

Fantastic, just the library I needed! Thanks

Max-zyie
Автор

Great video! Can we have a video on similar framework called LMQL??
I have seen people talking about it in terms of it's simplicity & closer to SQL than guidance.

ravishmahajan
Автор

More on guidance! And Guidance + Autogen!

Karl-Asger