NVIDIA GET3D: AI Model to Populate Virtual Worlds with 3D Objects and Characters

Trained using only 2D images, NVIDIA GET3D generates 3D shapes with high-fidelity textures and complex geometric details. These 3D objects are created in the same format used by popular graphics software applications, allowing users to immediately import their shapes into 3D renderers and game engines for further editing.

#ai, #3D, #deeplearning, #nvidia, #NVIDIAResearch, #GTC22
deep learning, AI, 3D, triangle mesh, NVIDIA, NVDIAResearch

[Sandro-Da-Cruz]

Based on that video, I'm not altogether sure it delivers on it's sales pitch. That's some really nasty geometry and kooky looking results.
But it's a start in at what is quite a tricky problem. There just isn't the wealth of semantic object data that there is for images.

[CanalDojogames]

What gpu i need and how can i make it on my own PC?

[ONDANOTA]

@Nvidia Developer, When would we be able to generate a 3d model by describing it, much like a 3d version of Dall-E2?

[GeometricPidgeon]

mfw i spent 8 years to become a 3D environment artist and now my job security is in jeopardy... It's not long before they'll be able to generate game topology/quad meshes..

[Constantinesis]

The way I read it i got that the model is not trained but it can be trained with any subject of datasets. My question is how is this out-of-the-box? What can I do with it if i manage to run it? I hope someone comes with some tutorials for those of us who are not developers or researchers! This is from NVIDIA blog article :

" GET3D can generate a virtually unlimited number of 3D shapes based on the data it’s trained on. Like an artist who turns a lump of clay into a detailed sculpture, the model transforms numbers into complex 3D shapes.

With a training dataset of 2D car images, for example, it creates a collection of sedans, trucks, race cars and vans. When trained on animal images, it comes up with creatures such as foxes, rhinos, horses and bears. Given chairs, the model generates assorted swivel chairs, dining chairs and cozy recliners"

[joshkar]

This is the start of taking real world partial data about a location like cellphone photos and having it crank out a high fidelity simulation of that place in time. We should be able to explore vast swathes of the real world in vr in a few years

[arash]

can this be implemented inside a video game so that the inside the game ai generates new things and make the game feel fresh everytime with new things added to the scenes...

[audiogus]

Cooool, so how long until we can get a 'Panda Cop riding a Rhinocycle'?

[kevinh]

they terk err jerbs!

source: 3D artist.

[jimj]

I just want a digital Earth twin as the map of a game like GTA.

[Netryon]

I wish they would convert every youtube upload for a day with Object programing features, it's a technological age and we got used to a way how it works.

[J_gumbainia]

Is NVIDIA GET3D Can make humanoid 3d model such as "Korea girl" produce 3d model by AI?.

[NycroLP]

Yea I hope atleast 3D art stays safe for like 2 years. AI is the worst thing to have happen to the internet.

[a-lightful-forest]

You know what I would find really cool? If at some point AI could create a whole animated movie for you. :D
Because I can't animate...
Although I wouldn't want AI to do it ALL for us... the script writing... the animation... at some point we might have a self-creating entertainment industry. And what then? Will that feel hollow? Will we feel that the human spirit is missing in those works? Will we notice? Interesting times. Hopefully fun times too. Me, awaiting further developments with a certain trepidation, but also a lot of curiosity : )

[LatentSpaceCadet]

IS THERE AN INSTALLATION TUTORIAL ANYWHERE PLEEEAAASEEE ?!?!?! (and thnx byeee!)

[nicholaspostlethwaite]

It is clever and will doubtless get much used. Especially by the younger generation who seem to like and want easy one click results. For me, the making is the point of life, be it in real world crafts or digital. But I obviously have no place in this changing world at my advanced age, left school before digital pocket calculators existed. I wish the young well but it looks like a poor way to be from my perspective. What will you do with your lives? 'Flower arranging' ai made stuff? Until ai does that for you too?

[rogerszeto]

The more we venture into the metaverse, the more it will auto-populate. It has infinite possibilities, infinite opportunities.

[incaroads]

Okay. I guess I'll just give up animation and modeling. What's the point if a machine can do it better and faster. If you welcome this then bend over and say aah to the new overlords. Nice knowing you all.

[Aldraz]

AI will be indistinguishable from magic pretty soon

[ericwilkinson]

This is BS i worked my ass off for years to get good at 3D, and now I'm going to probably lose my job in the near future. Please please please stop. I love what I do.