PostgreSQL as VectorDB - Beginner Tutorial

🔗 Links in this video

👤 Connect with me on LinkedIn

👋🏻 About Me

[binry_dstructr]

One of the things I learned in the past few months working with RAG-based LLMs is that it's definitely not one size fits all. The quality of inference depends on the embedding algorithm as well as the indexing and retrieval mechanism of the vector database.

This was a great video!

[JonBrookes]

Im like number 560, thanks Dave, this is exactly what I was looking for right now. I'm a big fan of MySQL, Postgres and in particular the latter where you can use it more to write apps with, something I think Supabase has realised also. With vectors built in is a win win to me and not surprising that the Postgres folks have the performance nailed, it is after all a database challenge anyways right ?

Very glad to have come acorss your channel. Im also subb'ed as a result.

[ConnorLeech]

in the video you are creating the data from text files, but it seems like a main advantage of having it on your postgres db is being able to use / query the data in your tables.

i'd love to see how to build a full text search or something from data stored in regular postgres tables!

[gonzalea]

Hey man, thank you very much. I have to build a POC with PGVector, and your video just nailed my gaps in understanding the basics. Also, the repository was quite useful. You are awesome. Keep up the good work.

[grtbigtreehugger]

Thanks for this! I was leaning towards pgvector and your video convinced me so!

[jennymelia]

LOL dave i was googling if i can use postcres somehow instead of pinecone and your video popped up 🤣🤣👍🏽👍🏽👍🏽 Love it!

[abhishekchopda]

Great Video! Helped me in my work! Thanks :)

[aimattant]

I am working with PGvector extensions with PG databases with my current AI python project. Querying Postgres database with nlp - natural language processing - when i go to the html app and enter the search under NLP query - if just the database items mentioned - such as women'S jackets and then limit - I get the results on screen and csv download, but if i add i would like to get a list of womens jackets, I get a error. Is there a way around this? Would appreciate your help.

[EmilioGagliardi]

THis was super interesting. Do you have a video that explains your PGVector setup (do you install the database locally or do you have a cloud account)? I'd love to have a setup where I can view my document collections and embeddings in my editor like that. I use VSCode right now, so not sure ... good stuff!

[SigAiOC-kess]

I didn't fully understood it from the video but are you comparing times between using Pinecone on a remote host vs Postgres ran locally?

[Michael-jlwn]

How would this work if you were using more structured data that needed to be stored in columns and rows?

[eyemazed]

thing that bothers me about using postgres for RAG is that the vector search works fine, but its full text search capabilities are severely handicapped. it doesn't support partial or fuzzy matching, so you can't really do a nice reciprocial rank fusion between resources retrieved by multiple channels (vector + full text). i'm going to try ElasticSearch next, as i've previously worked with it and its really good at full text search (TF/IDF, fuzzy search, partial search, stemming...), and the newer versions also support vector search. the downside is having to sync elastic with your main db all the time...

[erwinl]

What about an open source vector store like qdrant?

[fabsync]

A new fan here! It will be great to see a video where you use streamlit or something else to create a search with pgvector (full text search)

[DanielWeikert]

How do you update the vectorstore (e.g. replace outdated data?
br

[wcdev]

But you tested it with a small dataset, most relational databases go slower as they grow.

[izzatirfan]

Greatt!! I enjoy watching your video. I have tried to hands-on the code from your GitHub but i am facing an error ModuleNotFoundError: No module named 'pgvector_service'. Then, I tried to pip install pgvector_service but this occured. ERROR: Could not find a version that satisfies the requirement pgvector_service (from versions: none)
ERROR: No matching distribution found for pgvector_service
Do you have any ideas how to overcome this?

[krunkey]

Thanks for the video. I'll be trying PGVector! Do you know of any good alternative to OpenAI embeddings that can be run locally?

[tushaar]

Hi Dave, this is great video thanks for sharing the knowledge, i really liked the idea of using postgres sql, can you pls make one video on setting up postgres on azure

[MichaelHoughton_]

Could you put the vectors inside fire base ? That’d be epic