filmov
tv
Scaling Retrieval-Based Language Models with a Trillion-Token Datastore

Показать описание
This paper explores how increasing datastore size enhances retrieval-based language models' performance, demonstrating that smaller models with large datastores outperform larger models in knowledge-intensive tasks.