BEST OPEN Alternative to OPENAI's EMBEDDINGs for Retrieval QA: LangChain

In this video tutorial, we will explore the use of InstructorEmbeddings as a potential replacement for OpenAI's Embeddings for information retrieval using LangChain. This will be the first step in using Open Source ChatBot on your data. The results will surprise you!!!

LINKS:

-------------------------------------------------
-------------------------------------------------
All Interesting Videos:

[parmesanzero]

Your videos are amazing and informative and you are providing so many tools and bits of knowledge to the community. Thank you for being dedicated to open source

[atultiwari]

Thank you very much for this video. Early waiting for the next one.

[rickie_]

This is amazing! A completely free open source knowledge engine would be a fantastic goal!

[meinbherpieg]

Amazing video. Thank you so much for being clear, detailed, and holistic.

[BamiCake]

Really happy with this! I keep asking myself "What is the best alternative for OpenAi?"

[VastIllumination]

You are amazing, this is beyond helpful. ty

[Allteamcaptain]

Looking forward for your next Video (i want to use this with "Wizard-LM13B or Mtb-7b locally" but I'm not able to do that myselve :)) Thank you for you guides

[swishrsplitr]

@Prompt Engineering great video, thanks! Can these embeddings be upserted to pinecone? What dimension needs to be used? Thanks!

[atultiwari]

Hi, Thank you for your tutorials. I am following your tutorials for quite some time now. However I am unable to figure out best economic approach for my use case.
I want to create a Q & A chatbot on streamlit which answers only my custom single document of about 500 pages. The document is final and won't change. From my understanding so far, I should either choose Langchain or LlamaIndex. But, I will have to use OpenAI api to get best answers, but that API is quite costly for me. So far I have thought of using Chroma for embedding and somhow storing the vectors as pkl or json on streamlit itself for re-use, so I don't have to spend again for vectors/indexing. I don't have enough credits to test different methods myself.
Kindly guide me. Thank you.

[lbasavaraj]

Good one man, when’s the next video coming out? Eager to know the model you have chosen to use with this open embedding

[hazn]

Can you guide which is the other option for OpenAI to use while retrieving information.

[njypshy]

is this the best open source embedding available or are there any others that are better than this? Have you tested any others comparing them to this one

[ducdh]

good stuff. Hey, just wonder what diagram software did you use? tks!

[weigthcut]

Hey there, thanks for the video! Does this embedding model support different languages (in the paper they say its only trained on english data)? Also, where can I find the video where you explain how to use a open source LLM instead of davinci? <3 all the best

[eduai-]

You and your channel is awesome. I want to make just one comment regarding the videos. Please check why the volume is very low. Maybe due to microphone far from the face? Everything else is just next level.

[Cedric_]

I want to use jina embedding locally which has 8k sequence, how can I do that, thanks

[RajemaTech_Tamil]

Hi, thanks for this!... I want to know how to return output response with the source files name using openai langchain conversational retrieval q&A.

[alizhadigerov]

what about speed? Are opensource self-hosted models faster? Considering I don't have a gpu

[JohnJohn-tnlc]

What is a good way to deal with token limits on large files?

[Data-yf]

in place of openAI devinci, which open source model we can use?