NVIDIA’s New AI: Wow, Instant Neural Graphics! 🤖

📝 #NVIDIA's paper "Instant Neural Graphics Primitives with a Multiresolution Hash Encoding" (i.e., instant-ngp) is available here:

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Angelos Evripiotis, Benji Rabhan, Bryan Learn, Christian Ahlin, Eric Martel, Gordon Child, Ivo Galic, Jace O'Brien, Javier Bustamante, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Michael Albrecht, Michael Tedder, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.

Károly Zsolnai-Fehér's links:

#instantnerf

[draco]

This is incredible. It's not real-time raytracing, it's an AI literally just eyeballing it. And it's MORE real-time than the regular methods. Can't wait for this kind of rendering to make it into games and simulations, it would outperform anything ever seen before.

[sqworm]

Great video! It would be amazing if you had a second channel titled "Twenty Minute Papers, " where you go more in depth on topics that interest you.

[dissonanceparadiddle]

This is going to make photogrammetry so much easier

[AlvaroALorite]

A lot of people are mentioning computer graphics as an interesting application, but are missing the bigger picture: This is using neural networks, and it's replicating a 3D environment from limited input, which is VERY similar to what our brain does (dreaming, for example)... This is amazing for neuroscience.

[Rezmason]

This channel will live to see the day when the pace of progress in this field will exceed the speed of publishing and paper discovery.

The format may have to switch to a statistical approach that samples results from multiple simultaneously published papers to depict the state of the art. aka "paper transport"

Then Nvidia will publish work on a hardware accelerated paper transport resolver that produces "perf"s at a rate faster than this channel. The papers will move so fast we won't be able to hold onto them

[zynius]

In a few years when this can run at 60hz+, all you need is a few cameras in a space and you'll be able to use VR to insert yourself in that location :O

That will be completely bonkers!

[koendos]

Imgine rendering only 10 frames of a 100 frame animation. And then feeding it into this new AI. You'll finish your render 10x faster. Thats amazing!

[WikiSnapper]

Can you imagine being able to apply this to table top gaming maps and have the ai fill in the game world as you zoom in!

[danczer]

Is it possible to apply this on a video footage? It would be mind blowing to have this in a VR video player. Current VR video players play a video projected inside a sphere. Which not a real 3D, because once you start moving your head in 6DOF it breaks the immersion. But having a dynamic 3D mesh which would be used for the video projecton instead of a sphere, would be mind blowing!

[GierlangBhaktiPutra]

I am eager to see the practical application to be available. As an architectural historian, it would help documenting architectural heritage much easier with more simple equipment!

[rafqueraf]

Imagine what cheap GPUs will be able to do in the future

[AdityaTripathi]

I can't wait for research like these to end up in game engines, truly incredible!

[JRAN]

NVIDIA has been going crazy with these AI papers

[eamonia]

What a time to be alive, indeed! And your documentation of these accomplishments will be preserved forever. Thanks Doc 😊

[sigmata]

Absolutely extraordinary.

My first thought was that "Now we know what those old CSI shows were using to zoom into their videos to find important details" Haha

Yet also, does this mean from a couple of photos we can now create 3D models which could plausibly be printed? Effectively advanced Photogrammetry?

[AykutKlc]

Google Street View with this would be mindblowing.

[ollllj]

nvidia GPUs of 2021 are heavily optimized for matrix multiplication, with a mode for sparse matrices. It is mostly used for up-scaling, but can also be used as great noise-filter (audio and raytracing-denoiser) ray-tracing is also useful for more realistic audio.
The more general applications of this are pretty much anything with linear-algebra, where ever you multiply 2 or more matrices, most likely

[markwood]

Thank you for making Two Minute Papers. Your excitement and enthusiasm is infectious! And I always find myself getting more and more enthused as I watch your videos and see the pace of progress. It's nice to see a channel that just... Makes me feel that the future can be bright.

[epcnss]

This is unbelievable. Phenomenal work, can't wait to see the applications! Especially in photogrammetry.

[eragon_argetlam]

This is insane. I've watched many of your videos, but this is the only one so far that *really* seems like straight up magic.