'Is my Large Language Model a Strange Loop?' by Zac Hatfield-Dodds (Strange Loop 2023)

preview_player
Показать описание
Large Language Models aren't just the new hotness - they also offer fascinating glimpses of an alternative approach to software which is evolved instead of written. We'll explore emergent representations and composition of concepts from the inside outwards; and then turn around and consider some emergent behaviors and feedback loops from the outside of the training process. Whether you're curious about superposition, induction, self-evaluation or self-correction... by the end of the talk you'll have more questions than you started with!

Zac Hatfield-Dodds
Assurance Team Lead @ Anthropic

----
Recorded Sept 21, 2023 at Strange Loop 2023 in St. Louis, MO.
Рекомендации по теме
Комментарии
Автор

Fascinating. Really interesting and thought provoking. Way to pull it off on last minute request.

RobArnoldSD
Автор

Maybe AGI derived from LLMs is what creates/created the universe in the first place and the whole universe is a strange loop.

cmw