Building a RAG LLM Clinical Chatbot with John Snow Labs in Databricks

Показать описание

In the era of rapidly evolving Large Language Models (LLMs) and chatbot systems, we highlight the advantages of using LLM systems based on RAG (Retrieval Augmented Generation). These systems excel when accurate answers are preferred over creative ones, such as when answering questions about medical patients or clinical guidelines. RAG LLMs have the advantage of reducing hallucinations, by explaining the source of each fact, and enabling the use of private documents to answer questions. They also enable near-real-time data updates without re-tuning the LLM.

This session walks through the construction of a RAG (Retrieval Augmented Generation) Large Language Model (LLM) clinical chatbot system, leveraging John Snow Labs’ healthcare-specific LLM and NLP models within the Databricks platform.

The system leverages LLMs to query the knowledge base via vector database that is populated by Healthcare NLP at scale within a Databricks notebook. Coupled with a user-friendly graphical interface, this setup allows users to engage in productive conversations with the system, enhancing the efficiency and effectiveness of healthcare workflows. Acknowledging the need for data privacy, security, and compliance, this system runs fully within customers’ cloud infrastructure – with zero data sharing and no calls to external API’s.

Amir Kermany

Amir is the Technical Industry Lead for Healthcare & Life Sciences at Databricks, where he focuses on developing advanced analytics solution accelerators to help health care and life sciences organizations in their data and AI journey.

Veysel Kocaman

Veysel is a Lead Data Scientist and ML Engineer at John Snow Labs, improving the Spark NLP for the Healthcare library and delivering hands-on projects in Healthcare and Life Science.

John Snow Labs

Рекомендации по теме

Комментарии

I started researching RAG a week ago and was fortunate to find this video today
Thank you from the bottom of my heart for your very rich content

alimahmans

Great level of detail in overview and coverage of scale and production-deployment issues (and costs). Many thanks! John Snow Labs does it again.

geoffreygordonashbrook

It's nice to know what a great project we are involved in, congratulations Veysel!!!

dr.ahmetkorkmaz

Thank you for great presentation. Are you going to share the notebook?

KemalCanKara

AttributeError: 'NLUPipeline' object has no attribute 'predict_embeds' when running FAISS.from_documents(pre_processed_docs, embeddings).as_retriever(), what may be the problem?

leauyn

both folks English is to hard to understand

kali

Thank you for this. It was very informative. What are your views on using FactScore?

misterloafer

Building a RAG LLM Clinical Chatbot with John Snow Labs in Databricks

Building a RAG LLM Clinical Chatbot with John Snow Labs in Databricks

Build a Large Language Model AI Chatbot using Retrieval Augmented Generation

What is Retrieval-Augmented Generation (RAG)?

Build a FREE Medical RAG Knowledge Base - Next.js & LangChain Tutorial

Building a Multimodal RAG App for Medical Applications

End to end RAG LLM App Using Llamaindex and OpenAI- Indexing and Querying Multiple pdf's

Build a Medical RAG App using BioMistral, Qdrant, and Llama.cpp

How to build Multimodal Retrieval-Augmented Generation (RAG) with Gemini

Building a RAG application from scratch using Python, LangChain, and the OpenAI API

RAG Implementation Medical Chatbot with Mistral 7B LLM LlamaIndex GTE Colab Demo

Build your own RAG (retrieval augmented generation) AI Chatbot using Python | Simple walkthrough

LLM App: Building a RAG Q&A System with Streamlit, FAISS, and Hugging Face

Build and Run a Medical Chatbot using Llama 2 on CPU Machine: All Open Source

Oncology RAG App - Powered by Meditron 7B Medical LLM

I Built an AI Doctor that Gives Personalized Answers!

Local Retrieval Augmented Generation (RAG) from Scratch (step by step tutorial)

Retrieval-Augmented Generation chatbot, part 1: LangChain, Hugging Face, FAISS, AWS

You Need Better Knowledge Graphs for Your Graph RAG

Graph RAG: Improving RAG with Knowledge Graphs

Building a LangChain Custom Medical Agent with Memory

GraphRAG: LLM-Derived Knowledge Graphs for RAG

LLM Explained | What is LLM

Integrating Multi-Modal Data with LLM and RAG for Clinical Decision Support.

Build Streamlit HealthCare Chatbot with Llama 2&Langchain on CPU Machine with MEMORY|All OPEN SO...