Retrieval-Augmented Generation chatbot, part 2 - LangChain, Hugging Face, OpenSearch, AWS

Показать описание

We'll walk you through the creation of a Retrieval-Augmented Generation (RAG) chatbot using open-source tools and AWS services like LangChain, Hugging Face, Amazon SageMaker, and Amazon OpenSearch Serverless.

We start by deploying Mistral 7B, a cutting-edge open-source LLM, onto a SageMaker endpoint. Following this, we work with the Reuters dataset, a Hugging Face dataset comprising 20,000 news articles. We break down these articles into smaller sections and apply bge-small, a compact open-source embedding model, to them.

Next, we proceed to index these sections into an Amazon OpenSearch Serverless vector index, which we then query through LangChain.

Additionally, aside from the RAG demonstration, we delve into some vital yet often overlooked steps related to authentication and security for OpenSearch Serverless.

Рекомендации по теме

Комментарии

great, I agree sometimes you have to spend a lot of time on IAM than the original problem what a mess

bhanuchirutha

this is great, my son and I have both been working on something similar, each for different use cases, this is going to help both of us, salut!

pfunnell

Excellent to bring out IAM issue, I am experiencing it. I am runnig program in Jy.notebook, not ec2. As admin user, how can I attach role (aoss) to achieve this. Thanks.

ravindranshanmugam

Julien, if we have a document in S3 that when deleted, i want to trigger a lambda to delete the chunks and embeddings in opensearch belonging to this document. How do I do so ?

Ben-gpty

This is really great! Thank you! If I want to add this RAG-augmented chatbot to my personal website, how would I do that?

TheMrGoodkind

Hi Julien, your video is excelente. I have a question, with this solution (using opensearch service) is possible to deploy thought Lambda Service too?

WagnerHeleno

Thank you Julien! Will there be a tutorial deploying this in a front end chat interface ?

XShollaj

Hi. Can you explain a little more about the cost of this PoC ? Thanks

sergioquintero

Retrieval-Augmented Generation chatbot, part 2 - LangChain, Hugging Face, OpenSearch, AWS

Retrieval-Augmented Generation chatbot, part 2 - LangChain, Hugging Face, OpenSearch, AWS

Build a Large Language Model AI Chatbot using Retrieval Augmented Generation

Retrieval-Augmented Generation chatbot, part 1: LangChain, Hugging Face, FAISS, AWS

Build a Retrieval-Augmented Generation Chatbot in 5 Minutes

Chatbots with RAG: LangChain Full Walkthrough

Local Retrieval Augmented Generation (RAG) from Scratch (step by step tutorial)

Build your own RAG (retrieval augmented generation) AI Chatbot using Python | Simple walkthrough

Better Llama 2 with Retrieval Augmented Generation (RAG)

Indirect Prompt Injection | How Hackers Hijack AI

What is Retrieval-Augmented Generation (RAG)?

RAG + Langchain Python Project: Easy AI/Chat For Your Docs

Implementing RAG with Amazon Bedrock and Amazon Titan - Part 2

Retrieval Augmented Generation (RAG) Chatbot mit OpenAI programmieren!

How RAG Turns AI Chatbots Into Something Practical

Retrieval Augmented Generation with OpenAI/GPT and Chroma

Live code review: Pinecone Vercel starter template and Retrieval Augmented Generation (RAG).

Build a RAG Based LLM App in 20 Minutes! | Full Langflow Tutorial

Learn RAG From Scratch – Python AI Tutorial from a LangChain Engineer

Build Gen AI ChatBot For Your Website: Tutorial Part #2 | Embedding | RAG | Faiss Vector db | Memory

How to Build an AI Chatbot: RAG with LangChain & Streamlit. LLM chatbot tutorial for beginners

Python RAG Tutorial (with Local LLMs): AI For Your PDFs

A Helping Hand for LLMs (Retrieval Augmented Generation) - Computerphile

How to build Multimodal Retrieval-Augmented Generation (RAG) with Gemini

Build your own data-driven AI chatbot with JavaScript (Retrieval Augmented Generation Tutorial)