Leveraging Unified Framework for Evaluating the Accuracy of LLMs in Clinical Practices w/ SNOMED CT

Recorded October 25, 2024 at SNOMED CT Expo 2024 in Seoul, Korea.

Leveraging a Unified Framework for Evaluating the Accuracy of Large Language Models in Clinical Practices with SNOMED CT - Fuad Rahman (US) (202498)

Large Language Models (LLMs) fine-tuned to answer medical domain questions often lack transparency in the training process, leaving uncertainties about their capacity to address clinical queries. Our study employs the structured knowledge from the graphs from SNOMED CT to evaluate the performance of Large Language Models (LLMs) in healthcare. Our goal is to provide a comprehensive assessment of LLMs' performance in the healthcare industry.