End To End LLM Langchain Project using Pinecone Vector Database #genai

In this video we will be creeating an end to end LLM Project with vector.Pinecone makes it easy to provide long-term memory for high-performance AI applications. It’s a managed, cloud-native vector database with a simple API and no infrastructure hassles. Pinecone serves fresh, filtered query results with low latency at the scale of billions of vectors. database

Timestamp

00:00:00 Introduction To LLM Project
00:01:56 Setting up LLM Project
00:06:18 LLM Project Architecture
00:09:15 LLM Project Read the Data
00:16:05 Convert Data Into chunk And create vectors
00:21:40 Creating,Initializing,Inserting In Vectordb
00:27:58 Retrieving Results From VectorDB Similarity Search
----------------------------------------------------------------------------------------------------
Start Contributing in Open Source Projects
The-Grand-Complete-Data-Science-Materials
------------------------------------------------------------------------------------------------------
Complete Langchain Playlist:
--------------------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
------------------------------------------------------------------------------------------------------------------------------
►Data Science Projects:

►Learn In One Tutorials

►Learn In a Week Playlist

►Detailed Playlist:

[krishnaik]

Check out other Langchain Projects below

[Nothing_but_NavEEEn_Official]

First like and Comment
So Grateful for your guidance and contribution to the open-source community at the very need of Hour @KrishNaik Sir 🙏🏻❤️

Love from Bangalore ✨

[vivekanand]

Amaizing Knowledge - Thanks Krish for your guidance !!

[nooraftab]

@krishnaik06: Thanks for the valuable resources. Couple of changes as I was running the code: 1) the model davinici-002 is deprecated. Instead OpenAI advises to use 'gpt-3.5-turbo-instruct'. 2) Pinecone initialization is also changed. For anyone following and coding from here, it was two breaking changes for me.

[linuxmanju]

19:12 you need to return doc from the function not docs ( which is the raw input before chunks )?. Nice video and tutorials, thanks

[sangeethag]

def chunk_data(docs, chunk_size=800, chunk_overlap=50):
text_splitter=RecursiveCharacterTextSplitter(chunk_size=chunk_size, chunk_overlap=chunk_overlap)

return docs
In this part you are not using chunked_data ..need to return - return doc...Is it right?

[kxllgju]

Hi Krish, Bigg thanks for all your contributions, I just have a doubt How to retrieve all docs that has been injected to elastic db?

[MansiKale-mrng]

This is outstanding please share me some videos related to this Build one Q&A bot using open Al and Vector DB provide a couple of docs which should be stored in a vector db and when the questions asked to LLM model the LLM model should retrieve the answer from the vectors stored

[krishnaprasadsheshadri]

The similarity_search function is not defined? Any ideas how to define it cause I dont get how it works without the function being defined

[user-vx]

Hey Krish that was a great video indeed just to let you know some of the functions related to PineCone Vector db are deprecated had to do a bit of googling from my side to connect to the database.

[quengelbeard]

Hey Krish, great video!
Do you know if it's possible to automatically create a pinecone db index from code?
So that you don't have to create them manually

[hoiwcgc]

@krishnaik06, can we do the same with csv's having some kind of predictions from another ML model? Also, can we do some kind of weather report generation from IMD reports - I did try this, but it was not responding accurately. How to ensure the precision?

[tamilselvan]

26:28. We should give the chunks as an input to the function 'from_documents' but not 'doc'

[soumyaranjansahu]

Hey Krish, Could you please create a video on the setilup of pgvector

[ShubhajitDutta-vebb]

Please consider to build an application based on this LLM model

[digwijoymandal]

Thanks Krish for the wonderful contributions.

Can you please suggest if we could use tabular data with vector db. If any sample code available, can you please share

[tanmayjagtap]

Can anyone explain what is the difference between FAISS and Pinecone? In multiple PDF video he used FAISS but here Pinecone. Is there any specific way to use them?

[AIdevel]

If I have many files in the same directory how to upload them ? thank you for your amazing vidoes

[Stacks-cek]

Sir I have a error of NoneType object is not callable in retrieve query vectore.similarity search line how to overcome with it

[ozfdocj]

What is difference between loader vs parser in langchain?