What is multiset-equivariance? [ICLR 2022]

preview_player
Показать описание
Multiset-equivariance: what it is, why it's more suitable than the set-equivariance used in transformers & slot attention, and how everything comes together in a model using gradients in its forward pass. (captions available)

Full title: Multiset-Equivariant Set Prediction with Approximate Implicit Differentiation
Published at International Conference of Learning Representations 2022.

Chapters:
00:00 Intro
02:09 Set prediction uses multisets, not sets
05:10 Set-equivariance is too restrictive
08:06 Multiset-equivariance
12:16 Implicit deep set prediction networks
15:36 Experiments
17:03 Conclusion

All music is from the Baba Is You soundtrack, composed by Arvi "Hempuli" Teikari:
- Level Editor
Reed Is Sad - Rain
Keke Is Party - Jamming
Fruit On Grass - Garden
Crystal Is Still - Crystal cave
Рекомендации по теме