Is Nerf The End of Photogrammetry

►The first 500 people to use my link will get a 1 month free trial of Skillshare

Photogrammetry turns photos into stunning 3D models, benefiting gaming, visual effects, and architecture for years. Let's dig deeper in the subject in today's video.

Resources:

Blender Courses:
Cinematic lighting in Blender

Toanimate: Blender Animation Course

PostPro

Photogrammetry Course

Human: Create realistic Characters

Alive: Ultimate Character animation Course

The Art of Affective Rigging

Real-time Motion Graphics

Best Blender Course Creators:

CHECK OUT THESE AMAZING BLENDER ADDONS ►

MODELING►

ARCHITECTURE/RENDERING ►

VEGETATION ►

VFX, SIMULATIONS & DYNAMICS ►

MATERIALS/TEXTURING ►

CLOTH SIMULATION ►

UV UNWRAPPING ►

RIGGING & ANIMATION ►

SCULPTING ►

RETOPOLOGY ►

READY VEHICLES ►

SCRIPTING ►

DISCLAIMER ► Some links here are affiliate links that help us create more content. Thanks in advance for using our links

[Dilligff]

I can't see why the two can't work off of each other. NerF still requires images to be taken like photogrammetry, just far less, and generates a full 3D view in high fidelity. Why not, then, extrapolate the additional reference points from the generated view to aid in creating meshes without artifacts? I don't see one replacing the other so much as them working in tandem for maximum results.

[Shura]

bro's bouta start a war with that thumbnail

[naninano]

come to think of it, gaussian splats can be used directly for other things like rigid body physics simulation (easy to calculate object intersections or estimate center of mass - don't need meshes for that). Once animation is solved, i can totally see meshless gaming engines pop up in the next hundred of years

[iamgnud]

But isn't NERF(or similar AI that do the same) also a "photogrammetry" ?

[looneytuned]

It's amazing that you managed to make an 11-minute video that said so much and so little at the same time.

[rjv]

lots of blah blah about NeRFs, but no practical explanation of which engine to use, how to upload, formats, etc

[ge]

would be interesting to see how this may be able to take 2d video content and make it viewable in 3d in vr. Like imagine being able to watch a sitcom and feel like youre there in the room with them.

[DirkTeucher]

There is no way NERF can replace photogrammetry .... But Neuralangelo or Neoralangelo 2.0 most likely will :D ... I've been making nerfs for about a year now since it first came out and the quality is just not that useful in most typical 3d pipelines if you want high quality 3d models and texture accuracy. But Neuralangelo looks like it can pump out some nice geometry + textures. I am very excited about getting my hands on it.

[hchattaway]

Many of the issues with photogrammetry mentioned here can be pretty easily overcome. Reality Capture, which Epic games recently bought to allow game developers to create assets for UE, has some great features to model shiny objects easily. And the latest version is MUCH faster now. What takes Meshroom 8 hours to do, RC can do in under 2 hours.

[aresaurelian]

As long as the data exists in the training databases, or even real time updated data sets for scientific purposes, the generative transformers can recreate, using standard models, the attributes and effects of the missing parts, or by direct request of the user. For gaming industry, it means that if any part of our cosmos has been measured and scanned with various methods of source collections: images, lidar, telescopes, microscopes; these generative transformers can manifest your requested objects or subject immediately at run time. A combination of many sets used in the training data is good, but it requires strong ai models to drive it until science can optimize the systems further.

[jarmida]

03;28 That "desired object" is not an object of desire.

[matthewendler]

What video is being referenced at 4:40?

[gaba]

Now I need a deeper dive into the subject. Mostly what I got out of this is that Nerf is AI enhanced photogrammetry that uses a different file format. It has to be more complicated than that. There must be a reason the people that developed Nerf, didn't use an object mesh as output. Isn't the situation similar to a RAW image format like DNG vs some other proprietary format like CR2 (Cannon) or RAF (Fuji)?

[ArtwithAmarBrisco]

I would say this woulld be the evolution of photogrammetry because it saves time and will get better overtime allot faster. Where the other is at its peak and cannot get better as fast over time. Only things it will be able to do is create more detailed models but it requires more work and better tech.

Nerf would also be great for indie companies and creators so i would say if this is accepted by individuals and industry. This would be a better option especially since nvida and others are already working on this tech.

[SilverEye]

It has the potential sure. But just like any type of emerging tech like this you always just see the best results of the absolute best material. In most real life cases the results are not good enough to be used or a real headache to get there. It's intersting technology for sure, but I am really, really hesitant to call it anything but potential for the future. It may be future tech, but the future is not now.

[laigamer]

Bro never stop to make blender videos.. we love it ❤️😊

[DamageNando]

I felt like you said alot and also said very little at the same time

[KrazyKaiser]

Glad you are addressing the issue of ethical data gathering for AI training, it's something A LOT of people just gloss over when it come to talking about AI technologies.

[googleyoutubechannel]

Imagine if researchers put any time into AI models that can take garbage photogrammetry point-clouds, which are basically useless as 3D object, into useable, reasonable, geometry. NeRF doesn't look to be helpful in this respect, 'radiance fields' are even more esoteric, fragile, inflexible, types of data structures.

[bricaaron]

"Scary and exciting". Yes, that is what it is. It's not good or useful for anything other than the creation of fiction. It's scary that anyone might think this is useful for recording reality, or attempt to use it in such a way.