Create a RAG based Chatbot with Databricks

Step by step instructions and code to make your own RAG based Chatbot with Databricks.

[reyhanehhashempour]

Great video! Clear, straightforward, and right to the point!

[ashishlohra]

great video Jason, helped me unlock Chatbot technical architecture in much greater detail

[trevorwills]

Great video Jason, Thanks for putting together. Would you be able to share the notebooks as well.

[sheridan]

Great video Jason...thank you! I think you forgot to add the link in the description for how to setup the access key and secret scope. thanks!

[Meghachaugule-oy]

It was a clear and sorted demo for RAG. Thanks!!

[vahidvajihinejad]

Hey thanks a lot this was great and clean demo on RAG that I was able to run end to end. Excellent job

[pj]

very well put together & super informative...thanks a lot!

[okube-ai]

Awesome demo!

I one thing I wanted to do and could not quite figure out if it was possible is to to add the serving endpoint you created to the list of available models in the AI playground section. I would be nice to directly chat with our custom model without having to build a separate GUI.

[sheridan]

@jason what changes need to be made to this solution in order to take advantage of Databricks Apps?

[JacoboCeballos-kj]

Thank you for the video. One question, the gradio UI wasn't working for me, is there any other potential changes one needs to make other than the ones mentioned?

[chemayshola]

Wow, can't do this on a free trial. C'mon guys. Guess I will have to go the local llm way.

[cwynsurf]

great video. thanks so much! quick question :
so when we add new documents to the volume all we have to do is resynch the vector index ? we don't have to create another new version of the model to access the new data from the new files?

[ramstube]

At 09:18, the "create vector search index", has been moved to create button instead of the 3 dots.

[CosmosTraveler]

Thank you. It really is a great video, But question I have is, you are manually tracking the changed files. Can you help me understand the use of `enablechangeDataFeed = True`. And also the use of Delta Sync Index if we were to add new files into the Catalog. Can you make a video on this please.

[rebeccaamador]

Getting an issue when trying to create the serving endpoint. It's saying Served entity creation aborted for served entity `audio_transcription_chatbot_model-1`, config version 1, since the update timed out. Have not been able to figure out why.

[laobaba]

In the very last step of the last notebook when you go to run the demo, I get the following error:

Method public java.lang.String is not whitelisted on class class

How do you fix this?

Anyone else getting the error: raise ValueError("Must specify a chain Type in config")?

It looks like Langchain version im working on doesn't like "stuff"

[sheridan]

@jason I made it to the end of the video but when trying to launch Gradio (4 Chatbot GUI notebook in your solution), I get an issue with whitelisted java methods. you have any workaround for that?

[pedrocavalcanti]

oi got stuck because I'm only receiving 3 rows of responses. but my table have 800

[bryancrigger]

Great video! Was able to get a RAG model working with the first document I added, however when I went back later to add another pdf, the model did not seem to acknowledge any new documents to reference. They were added to the docs_track table, but none of the text chunks ended up in the docs_text table... Anyone know why this may be?