Crazy AI Learned Minecraft - Try It Out For Free!

Oasis: A Universe in a Transformer - try it out now:

More info:

📝 My paper on simulations that look almost like reality is available for free here:

Or this is the orig. Nature Physics link with clickable citations:

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Gaston Ingaramo, Gordon Child, John Le, Juan Benet, Kyle Davis, Loyal Alchemist, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Sundvall, Taras Bobrovytsky,, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.

[thk_]

Craziest part for me will always be that this is in real time. Truly insane

[STaSHZILLA]

When you go to sleep in Minecraft, it should put you in here.

[jaiveersingh]

Major correction: it does NOT run on the Sohu card. It actually runs on a standard NVIDIA H100 with some optimizations! They have optimized it to "theoretically" run on the still-not-produced Sohu card too. Big publicity/marketing stunt

Dr., Please correct this misunderstanding! We all hold you to a very high standard out of respect for your work

[protocol]

I use to play Quake excessively back in the late 90s and this reminds me of what I'd see on the inside of my eyelids when I'd close my eyes after a full day of tournaments. 🤣

[musangu]

This actually does mimic the underlying neurophysical explanation for some of the phenomenology of the dream state.

The recurrent networks that produce the stability of the present moment by giving it temporal extension/duration, are mostly shut down during REM. Your dreams therefore have little temporal stability. It's also why you have difficulty recalling them - they don't undergo nearly as many refresh cycles, so do not imprint on the network.

[RinoaL]

Oh wow, that minecraft demo is wild. When you let something get out of view, it will never be seen again. Also random achievements and text boxes appear sometimes.

[bmw]

At 1:51 he talks about looking away and looking back and it being completely different. This very very often happens in my dreams. I remember parts of my dreams every morning because I wake up so often and its more entertaining and fun than people realize. I like dreaming and look forward to it every night.

[MMaximus]

It’s interesting to consider that, in the future, we might look back on these “limitations” as a unique art style—similar to how pixel art, once a technical constraint, became a beloved visual style.

[felipefe]

With real-life videos, an Apple Vision Pro, and a Neuralink, it would be possible to create a simulation.

[cheydinal]

Tbh I actually LOVE the idea that it feels like a dream with no object permanence, when do you get that, an actual dynamic dream but as a video game?

[winShelestov]

1:19
Now comes the bad part:
"Dear fellow scholars, this is 2 minute papers with dr. Károly Zsolnai-Fehér"

[zifnab]

This is like a super genius with the memory of a Goldfish.

[pterois]

the parallels of lucid dreaming and AI are just insane

[CturiX.IREALLY]

I have to admit, the artifacting is what has drawn me in the most, ever since Ganbreeder. Cant wait to see if anybody picks this up and works around this niche

[ethanfreeman]

ain't no way i found out about this AI thing before 2 minute papers did.
advantages of being a gamer. i finally win!! what a time to be alive (but for a slightly different reason)

[AdvantestInc]

Watching this AI learn reminds us of the journey from basic neural networks to interactive models like this. Even if it’s not perfect yet, the potential here is huge. Great video that really makes AI accessible and exciting to a wider audience!

[BrownCookieBoy]

The nicest way to diss graphics "It really looks like a dream"

[ShaddyWoohooMan]

I played this a few days ago. It was such a strange experience. It started out normal, then of course started seeing how the world around me changes when I look away. So I started traveling worlds based on what blocks I fill my screen with. Once I hit a desert the world started breaking down with cracks in the world forming. Then I came face to face with leaves and the whole world turned into a cartoon no longer looking like Minecraft but more like a water color painting. It was just like a dream where things are vaguely familiar but not quite and once you try to focus on it your dream moves onto something else.
There is huge potential for this being able to create actual games in the future but for now I'm honestly more interested in being able to play other games of my childhood in this weird dream like state lol

[NLOneOfNone]

It's like a dream that I once had. I came from a place, then look back to see it entirely different! Very surrealistic.

[JimmyKrochmalska-fp]

I'm pretty sure it only has 1 frame to figure out what is happening, the selection screen is the first frame, then the second frame is the generated frame, etc. So 3 seconds would actually be 60x better