Create ChatGPT-like UI Using Falcon, LangChain and Chainlit

In this video, I am demonstrating how you can create a simple ChatGPT like UI in GitHub Codespaces. You can follow along with me in GitHub Codespaces or clone the repo locally and follow.
Open Source in Action 🚀
- Falcon-7B-instruct is used as Large Language model.
- LangChain is used as a Framework for LLM
- Falcon model is taken from Huggingface Website
- Chainlit is used for deploying.

NOTE: The code has been updated and you can find it from the github link.

👉🏼 Links:

🔗 Other videos you might find helpful:

🤝 Connect with me:

#langchain #falcon #llm #chainlit #huggingface #datasciencebasics #opensource

[DevonAIPublicSecurity]

This was the best instructions thus far ... thank you

[omaribrahim]

Thanks a lot to you, I couldn’t figure out the LangChain, but given how you tell it, I was able to find where I did it wrong

[vhater]

Thanks You for sharing and explaining stuff, i have download the 7B and searching how to build with a chatbot anyway thanks for all your work

[AdeAulya]

Thank you so much for sharing your knowledge

[suprateeksarkar]

In the "langchain_falcon.ipynb" it is not able render the code block, is there any solution to that??

[henrickleonardmwasita]

Please help, I compiled to end but I am getting this error instead:
Error
04:14:32 PM
Error raised by inference API: Authorization header is correct, but the token seems invalid

[rakly]

How do you use VSCode with conda env?
When working from VSCode, everything I do is run and installed on the host system. But I find Conda extremely easy for working with different CUDA LLM environments.
To clarify, I want to use my existing Conda environments I already have.

[venci]

Hey @datasciencebasics, how can we do the answer not appear as whole, but to streams?

[manishtripathi]

Thanks for amazing instructions, what was the reason to use Falcon 7 B model and not the better one? how does it affect the resources? Also is there a way to finetune the model with proprietary data and create a chatbot on it? if you can share few resources on that as well

[juandavidpena]

How would you apply custom css? where would you put the stylesheet file

[LifeTravelerAmmu]

can we connect our own database with the chatbot ??

[yashsrivastava]

sir please make video on how to make an web-app using --> LMQL, Langchain, and Chainlit

[CesarVegaL]

Thanks for the video. I tried in cloud but the codespace notebook does not open. It says the url violates the Content Security Policy.

[redgenAI]

How would we go about loading falcon locally instead of using the API?

[CharanjitSingh-lbqq]

Great video great help but can we do the Same by adding own document that is pdf and text files and answer from that along with metadata

[PhoenixRiseMotivation]

Great video, any idea on how we can make it into a functioning website instead of just local?

[sks_DS]

As we can see it doesn't remember chat history, so it fails on follow-up questions. How to reslove this, maybe you can add memory from langchain. Can you please make a video on this or share the implementation that works on follow-up questions.

[parthjhunjhunwala]

hello great video, Can we use this code with some other model like Pygmalion13b without any changes

[dmistclesgee]

bro, can u do one for uncensored Wizard Vicuna models? thanksagain

[lpedvxz]

Awsome explaination. Please can you explain how can we implement history in this.
Also if possible can you make video on gradio.