filmov
tv
Chat with Docs using LLAMA3 & Ollama| FULLY LOCAL| Ollama RAG|Chainlit #ai #llm #localllms
Показать описание
Welcome to our latest YouTube video! 🎥 In this session, we're diving into the world of cutting-edge new models and PDF chat applications.
Join us as we harness the power of the new Llama3 model, developed by Meta Inc., and the nomic-embed text model from Ollama to create a seamless chatting experience with PDF documents with 100% privacy.
Powered by Ollama and Chroma as the vector store using the Chainlit framework, this application allows you to upload PDF chat documents and engage in conversation within them.
Discover the magic of Llama3, available in two sizes: 8 billion and 70 billion parameters, either pre-trained or instruction-tuned. These instruction-tuned models are finely calibrated for dialogue and consistently outperform many existing open-source chat models.
Nomic-embed text surpasses OpenAI's text-embedding-ada-002 and text-embedding-3-small in both short and long context tasks.
If you're eager to explore further, we've previously showcased PDF chatbots utilizing different models, so be sure to check those out too!
Before diving in, ensure your local machine is equipped with a minimum of 10GB RAM to run this application smoothly. And don't worry, we've got you covered with a step-by-step guide on installing Ollama.
Get ready to explore the architecture of our application, followed by an exciting demonstration. Let's get started! 🚀
#ai #generativeai #langchain #llama3 #ollama #localllms #chatbot #llm
#largelanguagemodels
LINKS:
Join us as we harness the power of the new Llama3 model, developed by Meta Inc., and the nomic-embed text model from Ollama to create a seamless chatting experience with PDF documents with 100% privacy.
Powered by Ollama and Chroma as the vector store using the Chainlit framework, this application allows you to upload PDF chat documents and engage in conversation within them.
Discover the magic of Llama3, available in two sizes: 8 billion and 70 billion parameters, either pre-trained or instruction-tuned. These instruction-tuned models are finely calibrated for dialogue and consistently outperform many existing open-source chat models.
Nomic-embed text surpasses OpenAI's text-embedding-ada-002 and text-embedding-3-small in both short and long context tasks.
If you're eager to explore further, we've previously showcased PDF chatbots utilizing different models, so be sure to check those out too!
Before diving in, ensure your local machine is equipped with a minimum of 10GB RAM to run this application smoothly. And don't worry, we've got you covered with a step-by-step guide on installing Ollama.
Get ready to explore the architecture of our application, followed by an exciting demonstration. Let's get started! 🚀
#ai #generativeai #langchain #llama3 #ollama #localllms #chatbot #llm
#largelanguagemodels
LINKS:
Комментарии