Local Vector DB, from user input, from urls, from files

preview_player
Показать описание
We will build a local vector db using OpenAI ADA-002 embeddings from user input, from a list of urls and from files in a folder. We will use langchain for text splitting and embedding

Code files are available to download for Patreon members along with 100+ other projects' files:

Search 140+ echohive videos and code download links:

LLM Paper Summaries:

Try the GPT-4 Auto Coder app:

Chat with us on Discord:

GPT-4 web UI:

CHAPTERS:
00:00 intro
00:16 vectordb from user input
01:18 vectordb from urls
02:28 vectordb from files
02:40 code review of tools
05:08 echohive stuff

#openaiapi #vectordb #gpt4 #pythonprojects #langchain
Рекомендации по теме
Комментарии
Автор

Code files are available to download for Patreon members along with 100+ other projects' files:

Search 140+ echohive videos and code download links:

LLM Paper Summaries:

Try the GPT-4 Auto Coder app:

Chat with us on Discord:

GPT-4 web UI:

echohive
Автор

This is awesome! So let me get this straight! You can use chat history, external files and website urls, embed them all into the same database and then query that database if needed for the relevant info using cosine similarity? Is there a way to separate the chat history, aka the episodic memory trace, from the text and/or website info, the declarative or semantic memory, and then attach this to a broad tool set, aka the procedural memory, to create a more general agent? Thanks again and look forward to playing with this one!!!🥳🤪🤩🦾

klammer
Автор

Next step... add a local LLM for a completely local solution.

nuclear_AI
Автор

Is this a local persistant vectorDB or in-memory vectorDB? Do you recommend using a local persistent vectorDB on PC setups?

SuryaNistala-ejjd
join shbcf.ru