Meditron SOTA medical open source LLM 7B , 70B models EPFL LLM

Meditron is a suite of open-source medical Large Language Models (LLMs) Developed by EPFL LLM Team
They have released Meditron-7B and Meditron-70B, which are adapted to the medical domain from Llama-2 through continued pretraining on a comprehensively curated medical corpus, including selected PubMed papers and abstracts, a new dataset of internationally-recognized medical guidelines, and a general domain corpus.

Meditron-70B, finetuned on relevant data, outperforms Llama-2-70B, GPT-3.5 and Flan-PaLM on multiple medical reasoning tasks.
If you like such content please subscribe to the channel here: