Feed Your OWN Documents to a Local Large Language Model!

preview_player
Показать описание


Follow me for updates!
Twitter: @davepl1968 davepl1968
Рекомендации по теме
Комментарии
Автор

I appreciate the practical hands-on approach to your AI videos. So many AI presentations are 90% hype (or more).

bwcbiz
Автор

I've started playing around with a local LLM based on your other video. This was very helpful. Thanks!

KerboOnYT
Автор

This is awesome, what a time to be alive! Much appreciated, thank you Dave!

MarkoVukovic
Автор

Dave, you've been reading my mind lately on topics I want to know more about. Thanks for making this!

RegalEase
Автор

Dave, this is great! I walked through everything this weekend, but my web-ui looked different. I didn't have a scan button under documents, but under workspace I had a "knowledge" tab where I would upload documents to my custom model. I think they must have just changed this functionality to make it easier to upload documents without copying to the backend because I could upload the documents from the web-ui and it automatically put them in an "upload" directory and used the document as a reference the same as your video. Overall, I think the change is a huge improvement. Thanks for putting this together, because I was able to use it to host my own AI at home using ollama and web-ui and build custom models using my own reference document. Keep up the great work!

jonw
Автор

LOL, white text on blue background, watching the 70B model generate was like a total flashback to the bulletin board days on dialup/early isps.

rgsiiiya
Автор

Thanks Dave! RAG now makes a lot more sense to me. This sounds like a way that would actually make AI LLMs useful to me.

javabeanz
Автор

Dave: you can "bind mount" the documents directory into the container FS. Bind mount is docker-speak for "reflect a piece of the host FS into the container FS".

davidboreham
Автор

Thanks for the friendly introduction to this topic, Dave. Quite keen to try this stuff out now.

annaczgli
Автор

Great demo. It shows that you had the knowledge to know when it gave a subpar answer. People going in without that knowledge won't have that ability though. It again shows that these are assistants that may need help, not replacements, as some are pitching LLMs as

bobdemp
Автор

It is insane how fast AI is moving. Since you made the video Open WebUI have released an update for knowledge and document management, making it easier (you can now upload directly from the web interface)!!
Thanks for making these videos, I love how clear and concise they are, as well as just entertaining!

lmath
Автор

Absolutely awesome content you are pushing out on this Dave, thank you so much!
Im a little worker bee at Apple with 0 programming skills and im using what im picking up from you to try and make our department a custom IA for some things.
Thank you!

MichaelCoIIins
Автор

Love this - I'm hoping to set up my own in the next year!
I'll need to watch this back and take notes! Cheers!
I also loved the part when your blinds momentarily lost connection to wifi at 11:12.

_pixelpicnic
Автор

@Dave's Garage i'm playing with this myself now. i'm having success adding docs via the Knowledge section for the workspace. then, when making a new model, it can reference that doc the same as when you scanned the folder. i did that because i am running the ui in a docker container. i know how to find and populate the volume mount, but i wasn't seeing a button to scan the directory. but the Knowledge section is another way to add the docs! great video!

Agililord
Автор

You can also map a local directory into a docker container at a specified path with the --volume flag.

terrysimons
Автор

Dave... greetings from Uruguay! I must say... you're the man! Thanks for this one!!!

CristianAcosta-iv
Автор

Hey Dave, your vids are value packed - so much good info in under 20 minutes. I'd love to see a similar vid on AI image analysis - perhaps for use with security cameras, or with 3D printers to detect foul-ups etc.

TheZimberto
Автор

Re: RAG - This is the first time anyone has shown me an actual USEFUL reason to use AI (aside from "Wow! It's really neat!) Thanks Dave!

stevebarnes
Автор

This is where I wanted AI to be two years ago. Great video.

Once Sales directors, Project Managers and Product Owners realise that their company needs reliable and reviewed documentation to leverage LLMs, the nightmare of technical documentation will begin. I'm pro manuals and pristine technical documentation, but the majority of engineering teams NEVER document knowledge: I guess Knowledge Management will have a resurgence.

josuevivas
Автор

Dave I asked for this exact setup your talking about, dont know if you saw my comment but either way I REALLY appreciate this video.. It will help my create my own custom base of information for computer parts for gaming office and server ect.. SO GRACIOUS!!!

caspersmith