Workshop on Foundation Models: Day 2

preview_player
Показать описание
The Center for Research on Foundation Models (CRFM), a new initiative of the Stanford Institute for Human-Centered Artificial Intelligence (HAI), hosted the Workshop on Foundation Models from August 23-24, 2021. By foundation model (e.g. BERT, GPT-3, DALL-E), we mean a single model that is trained on raw data, potentially across multiple modalities, which can be usefully adapted to a wide range of tasks. These models have demonstrated clear potential, which we see as the beginnings of a sweeping paradigm shift in AI. They represent a dramatic increase in capability in terms of accuracy, generation quality, and extrapolation to new tasks, but they also pose clear risks such as use for widespread disinformation, potential exacerbation of historical inequities, and problematic centralization of power.

Experts from a diverse array of perspectives and backgrounds convened to address the opportunities, challenges, limitations, and societal impact of these models.

Day 2:

Session III: Industry and Applications

Is Scale All We Need?
Slav Petrov, Distinguished Scientist and Senior Research Director, Google

The Economic Implications of Foundation Models
Erik Brynjolfsson, Jerry Yang and Akiko Yamazaki Professor and Senior Fellow, HAI; Director of the Stanford Digital Economy Lab; Ralph Landau Senior Fellow, SIEPR, Stanford University

Breaking the Systems Bottleneck: Faster and Cheaper Model Training
Matei Zaharia, Assistant Professor of Computer Science, Stanford University

Towards Transparent Foundations -- Building Accessible Infrastructure for Training Large-Scale Language Models
Siddharth Karamcheti, PhD Student in Computer Science, Stanford University
Laurel Orr, Postdoctoral Fellow in Computer Science, Stanford University

Joint Q&A

Panel
Slav Petrov, Distinguished Scientist and Senior Research Director, Google
Michael Carbin, Associate Professor of Electrical Engineering and Computer Science, MIT
Pascale Fung, Director, Center for Artificial Intelligence Research; Professor of Electronic and Computer Engineering and Professor of Computer Science and Engineering, Hong Kong University of Science and Technology
Ilya Sutskever, Co-Founder and Chief Scientific Officer, OpenAI
Jakob Uszkoreit, Co-Founder and Chief Technology Officer, Inceptive
Thomas Wolf, Chief Scientific Officer, Hugging Face
Chris Ré (moderator), Associate Professor of Computer Science, Stanford University

Break

Session IV: Harms and Society Presentations

Cementing a Foundation of Inequity in AI
Margaret Mitchell, Research Scientist, Ethical AI, Hugging Face

Anti-Muslim biases in large language models
James Zou, Assistant Professor of Biomedical Data Science, Stanford University

How Foundation Models will Shape Disinformation, and Implications for Human Detection
Shelby Grossman, Research Scholar on Disinformation in Africa, Stanford Internet Observatory

Homogenization and the Ethics of Scale
Katie Creel, Postdoctoral Research Fellow of Philosophy, McCoy Family Center for Ethics in Society; Embedded EthiCS Fellow, HAI, Stanford University

Joint Q&A

Panel
Margaret Mitchell, Research Scientist, Ethical AI
Angèle Christin, Assistant Professor of Communication, Stanford University
Sarah Kreps, Chair and John L. Wetherill Professor of Government, Cornell University
Sameer Singh, Associate Professor of Computer Science, University of California, Irvine
Rob Reich (moderator), Professor of Political Science; Director of the Center for Ethics in Society; Co-director of the Center on Philanthropy and Civil Society; Associate Director, Stanford Institute for Human-Centered Artificial Intelligence, Stanford University

Closing Remarks
Percy Liang, Associate Professor of Computer Science, Stanford University

Рекомендации по теме