Unleashing the Future: Meet Nova, the Top AI Model!

Here, I run a 3-bit quantized version on my M3 MacBook and ollama, with a couple of creative writing and multi-step reasoning prompts. Excellent results and very decent speed for a model this large!

00:00 Introduction
00:25 Introducing Arcee-Nova
03:10 Running Arcee-Nova locally with ollama
05:25 Trying a few simple questions
07:25 Looking at the MUSR benchmark (Multi-Step Reasoning)
09:15 Trying a sample question from the MUSR dataset

Merging the shards into a single GGUF file:

Configuration file for ollama:
FROM ./Arcee-Nova-Alpha-GGUF.Q3_K_S.gguf

#SmallLanguageModels #Arcee #HuggingFace #MachineLearning #DeepLearning #AI #opensource #python #coding