Scaling Retrieval-Based Language Models with a Trillion-Token Datastore

preview_player
Показать описание
This paper explores how increasing datastore size enhances retrieval-based language models' performance, demonstrating that smaller models with large datastores outperform larger models in knowledge-intensive tasks.

Рекомендации по теме