Use AI to query your own data, like multiple pdf files using chatgpt and openai type of technology.

Query data using AI, query your pdf files using AI technology. I walk through all the main technology used to make this a reality. I use OpenAI, pinecone vector store database, langchain framework, typescript, react, css, tailwind css, and nextjs.

This is a really big deal I feel for the future of one of many useful ways that everyone will be using AI.

In this video, I show a new react page in my project that allows the selection of a long list of pre-made prompts - using a single click, prompt engineering and such.

Using a command line script, I can ingest multiple pdf files into the pinecone vector database. I am working on making it possible to dynamically import as many pdf files as needed, and group them into namespaces using an HTML select element in the GUI, that will link to a matching namespace in the vectorstore database.

I used a github project that helped jump start this effort:

About langchain

About pinecone

[RonBarrett]

An outstanding video and explanation. Thank you!! Saved your video in my AI folder on YouTube.
I got lost in the explanation a couple of times due to my lack of knowledge. That only means I'll be watching and following along multiple times. :)

[GustavoMartinezgus]

Thank you for your detailed video! this is awesome

[attainconsult]

great video, you may want to add that the data uploaded to chatGPT is available for them to train models on and may lead to information leakage, can't wait to try this on mine and my clients doc collections but ATM security is a worry

[SimonAlan-smvv]

Really amazing thanks so much!! Stupid question - can anyone tell me what language this demo is coded in, and what is the development environment?

[JP-uril]

Outstanding video and code !!! I am working in Financial context but with privacy data. How does it cost to deploy this internally and connected with local document data (onedrive, sharePoint, local storage) with high protection/compliance context ? I think this will be gamechanger in assisting operationnal tasks !

[AaronCarlsson]

I am a civil engineer and what you have shown here is a game changer for the field of engineering. How can we connect to discuss this further?

[mirzank]

Can this or something similar be used with PowerPoint files ?

[michaelb]

ive gone thru several times cant seem to find out what should be installed and such im sorry just a lot of issues looks good for you but ...

[michaelb]

i got real lost like got error about npm couldnt run the ingest im missing something here

[gschnuuget]

ChatGPT, can you make a short and easy to undestand instruction out of this 42 minutes video?

[michaelb]

this is my error: (venv) PS npm run ingest

> tsx -r dotenv/config scripts/ingest-data.ts

'tsx' is not recognized as an internal or external command,
operable program or batch file.