ELLIS Stuttgart - Distinguished Lecture Series - Talk by Jonathan Berant

"Retrieval in the age of large language models". Talk by Jonathan Berant from Tel Aviv University/Google DeepMind. November 07, 2023, online.

"The recently demonstrated impressive capabilities of pretrained language models has whet the appetite of many, and generated wide interest in models that can consume and generate long texts. This interest has raised many questions around modeling of long documents and document collections, as well as around their proper evaluation. In this talk, I will discuss developments in this area, including evaluation of models that consume long texts and the role of retrieval-augmented models in this area. In particular I will characterize some of the difficulties that arise when naively augmenting a language models with retrieved information, and present some recent work on joint training of retrievers and language models."