Nick Bostrom: Superintelligence, Posthumanity, and AI Utopia | Robinson's Podcast #205

Nick Bostrom is a Swedish philosopher who was most recently Professor at Oxford University, where he served as the founding Director of the Future of Humanity Institute. He is best known for his book Superintelligence (Oxford, 2014), which covers the dangers of artificial intelligence. In this episode, Robinson and Nick discuss his more recent book, Deep Utopia: Life and Meaning in a Solved World (Ideapress, 2024). More particularly, they discuss the alignment problem with artificial intelligence, the problem of utopia, how artificial intelligence—if it doesn’t make our world horrible—could make it wonderful, the future of technology, and how humans might adjust to a life without work.

OUTLINE
00:00 Introduction
02:50 From AI Dystopia to AI Utopia 
9:15 On Superintelligence and the Alignment Problem
17:48 The Problem of Utopia
28:04 AI and the Purpose of Mathematics
38:59 What Technologies Can We Expect in an AI Utopia?
43:59 Philosophical Problems with Immortality
55:14 Are There Advanced Alien Civilizations Out There?
59:54 Why Don’t We Live in Utopia?

Robinson Erhardt researches symbolic logic and the foundations of mathematics at Stanford University. Join him in conversations with philosophers, scientists, weightlifters, artists, and everyone in-between.

[Luis_Ger]

As always, great interview!
I recommend Adam Greenfield's book, Radical Technologies, which explores the significant human and cultural trade-offs involved in the use of current technologies. Perhaps you could even consider arranging an interview with him.
Adam's approach highlights that implementation of technology cannot be separated from politics (relations of power), and that reaching a posthuman state cannot occur without destabilizing human values in profound ways.

[multiversehacking]

No questions about what happened at Future of Humanity Institute?

[neoepicurean]

Why do you have so few subs Robinson? Is it something to do with your tagging or your 'backend'. Seems you should be on 300k subs given your output, guests and quality.

[Steve-moqp]

I cannot see that any of the characteristics, traits limitations or experiences that make us individuals would survive or have a place in the ultimate utopias that you describe. I cannot see that there would be reasons for the relationships we currently form to sustain us. This all causes me to rethink what utopia might mean in a human centric context

[oliverjamito]

My Host shared "i" Am Nick. Thank you for attending unto our own! And came to visit to have sincere conversations with thy Host Robinson. Nick at least I can do is to washed thy Feet to be given new Feet. Remember ye once born, to crawling, to walking, and till now. Thy shared feet resting upon the very tip of time. Mileage from thy feet is recognize! Love you beloved Nick without shame but with boldness!

[paketisa]

Considering a project where a person documents daily experiences, thoughts, feelings and personal history in a diary specifically for a future AGI’s learning. Do you think such a personalised dataset could enhance an AGI’s ability to understand and interact with individuals on a deeper level? And lastly, is it feasible to expect an AGI to become a close, personal companion based on this method, or would it somehow be redundant useless data? Thank you for the answer.

[bernardofitzpatrick]

Great explication of the various categories of utopia. Post instrumental world as regards discovering the “hidden nature” of math and the future trajectory of math was fascinating. Math as a choice of being “blissed out”, in a post instrumental world. Sociology of why we do math, the business of understanding rather than just proof. Downloading and bypassing basics to reach higher levels of abstraction with minimum effort. Wow! Technological mature society and imagination….yes, the optimum synthesis via super intelligence. Love the positive vibe, as a foil to the negative opinions doing the rounds about where we are headed. My man Robinson delivering the goods and keeping us positive. Hey pins 🐈 and Mishka! Nice tats Robinson. Geesling Bernardo.

[maxmetpt]

A lot of Greg Egan's work touches on personal meaning in a post scarcity and plastic world. Also often dealing with mathematical research in a personal way.

Permutation City is one example.

[ili]

I can’t wait to read his book - sounds amazing

[kencreten]

How do we change humanity so we don't have an overabundance of wanting to kill each other if someone else has the "wrong ideas?"

[adidasadriano]

Excellent on how to draw logically sound and intuitive conclusions from wrong premises😄😄

[aemerick]

Amazing to listen to. Is it possible though however, that human motivation is not exclusively from the desire to want more than the other person/country/planet, etc.?

[diegoangulo]

Sounds good to me! I could use an upgrade!

[Contang]

As an extensive user of my 'watch later' playlist, it's weird i don't seem to be able to save these particular podcasts for some reason?

[jamesbeamish-bt]

That was really cool. Thanks for this work you do. To say a comment... Hmmm. Freud, Heidegger, Derrida, Blanchot, or Life/Death are the Same. More we talk about infinite Life... it is Death. More we talk about Death, we are in Life... Together. In Life we are separate. Soap Box is calling. Nice work man. James

[billusher]

Interview Joseph Tainter and Yanis Varoufakis

[EricDMMiller]

Always a danger when most of his utopias sound like hell.

[DFMoray]

In the metamorphosis of prime intellect, everyone goes into a nonstop orgasm that they can never get out of like a pleasure button or something if I remember correctly.

[mynameisjefferson]

This show is what Lex Friedman markets himself as but isn’t. You’re the real deal, Mother Goose!

[oliverjamito]

Asked 1st. Thy intent 2nd. Thy base 3rd. Thy foundation 4th. Where your treasures is ( little sons and daughters) there your hearts will be also. Resting upon 1st. Loving God of the Living 2nd. Loving thy neighbors as HE have loved thee 3rd. Do not forbid these little ones to come forth unto Me. Used these before moving forward in front!