10 Things You Can Do With 3D Gaussian Splatting & Reality Capture

Step into the future of 3D content creation with a deep dive into Reality Capture and Gaussian Splatting. Learn how these cutting-edge technologies are blurring the lines between the real and the virtual, enabling creators to produce photorealistic 3D models, dynamic scenes, and reality-bending visual effects with unprecedented quality. Whether it's for memory capture, heritage conservation, e-commerce, or virtual production, see how these AI tools are opening new frontiers in digital storytelling and content creation. Combining 3D scanning and Generative AI is a potent combination. Experience the magic of this tech that connects the physical and digital worlds, allowing you to transform imagination into reality.

Video Chapters:
00:00 The Reality Capture Revolution
01:05 3D Memory Capture
01:54 Reality Bending Visual Effects
03:08 Dynamic 3D Capture (Movement!)
04:36 Advanced Relighting Effects
05:34 Kitbashing in 3D Game Engines
06:38 Sharing Content Everywhere (Web & Mobile)
07:34 Editing Gaussian Splats & E-Commerce
08:26 Virtual Production & Game Dev
09:10 Heritage Conservation
09:33 Big Picture: Connecting Physical & Digital Worlds
10:48 Conclusion & What’s Next For 3D Capture

Connect on socials:

#ai #3dgaussiansplatting #3dscan #gaussiansplatting #3d #3drender #photogrammetry

[bencone]

Amazing. Quick rundown of what's going on in the field in a very professional way that people who actually use these tools will understand and care about. very useful, thank you

[JonathanWinbush]

This is an great overview. I remember using volume capture studios only like 5 years ago that cost millions and now we have access to all that practically with our phones it's insane! 🤙🏾

[elvinshoolbraid]

This stuff is awesome. Me and a friend are just getting excited about potentially doing photorealistic 3D scans for real estate companies, and offering super realistic virtual tours on their website. Seems so feasible now!

[peterallely]

Reality Capture is a program for processing photogrammetry scans, your use of the term is maybe confusing?

[vp-land]

Visual Umami is my new favorite phrase

[joelface]

I'm waiting for a phone app that lets me synchronize multiple phones to capture volumetrically. They start recording at the same time and maybe have some kind of calibration to locate themselves within the scene. The multiple angles would allow for volumetric video capture. I don't see why this couldn't be done now, especially with the advancements in Gaussian splatting. Ideally we get to live streaming of 6DOF real-time animating volumetric capture of concerts and sporting events, but for now, it would be nice to have my family set up our phones to capture Christmas or a picnic or something, and then have that animated scene to watch and walk around in later in VR.

[andybrice]

Oh wow, these are all really interesting applications I'd never heard of before.

[CompositeNation]

Great!!! thanks for sharing! Excited to start with this tech!

[parsecd]

Didn't knew RC was already doing GS, can you make a video comparing GS results from different softwares?

[peterk]

Where does one go to look for talent in this space? Serious question.

[beaumac]

I feel like these captures on the Vision Pro will make it feel like you’re traveling without leaving your house. This is going to be huge.

[lucastaberna]

this got me super excited but I wish I was smart enough to do all this

[adizepl]

Hey! Amazing work! What is the name of the software you're using to relight gs?

[bohdandoval]

This would be a cinematographers dream! Get the data in a location scout and then digitally light it and get real renders before even shooting that would be insane. Almost too easy though 😅

[alphasiera]

Cant wait for gaussian splatting and google maps. Imagine walking in google maps just like in a game

[karubrandao]

I want the mesh of it!!! Please make a video teaching to make a mesh!

[austinwellsby]

Cool video. I'm having difficulty understanding the best process for our resort & theme park project we are building in UE.

We have an 11 acre property with dramatic terrain that borders the forest and sea. We want to be able to view our site from all angles and elevations, so that the 3D environment looks as it does in real life, no matter if a character in UE is walking around the property or flying above it.

Can this be done with 3D Gaussian Splatting, or would it be done with some other process? Or, should we get a 3D Gaussian Splat of just our property using drone & ground photos, and use another process for the surrounding lands?

Newbie. Realism is the goal, as I sometimes see distortion with the 3D Gaussian Splats.

Thank you so much,
Austin

[BusyPlaying]

Thanks, man. Great video. Would you like to explore another topic and explain the Chat GPT Turbo? haven't seen a single video of a real test drive of it's fucntions

[salamanderAFK]

Hey great video! Could you go into more detail of how you did the drone shot you did?

[jeffspicer]

For 4d dynamic gaussian capture, the cameras have to be in synch. Is it possible to synch the footage from a bunch of normal cameras in post-production?