Step-by-Step Unreal Engine 5 Tutorial: 3D Gaussian Splatting for Beginners

In this UE5 tutorial you will learn about 3D Gaussian Splatting in Unreal Engine 5. We are going to render Gaussian Splats in UE5. 3D Gaussian Splatting (gsplats) is a huge leap forward in 3D rendering. We will use UE5.3 this tutorial.

#animation
#ue5
#gamedev

@UnrealEngine

[dzezonja]

I'm more and more convinced we're living in a simulation created by someone, and we've just started a process of creating a new one.

[fotozhora]

Happy to see my creation right from the beginning ;)

[entumonitor]

Is it possible to convert a 3D scene to Gaussian splatting? that each point of the cloud is specifically determined and that this kind of blurring in the cloud is not seen when viewing from angles far from the camera's point of view in conventional constructions.

[simonebasi]

Thank you very much! So helpful!
Do you know how to make the "point transition" effect of luma ai app?

[Kzyon]

Thanks for the tutorial!
I've been using it for a virtual reality experience and the plugin is displaying fine in viewport and preview window, but previewing on the headset, the alignment of both eyes on that object is weird. Do you have any idea what could be causing it so I can investigate how to fix it?

[ajking]

Could one tell concert goers to download an app, then have them all film the show with their phones, but live-stream their footage through the app, to compile a song performance as a Gaussian splat construct?

Could be a cool way to record concerts for virtual viewers.

[agnivamahata]

How about 4D gaussian splatting in unreal

[rccsrgaming]

Loved this content! But one thing to be aware!

If you are having flickering issues, you will need to set your sort precision in your sprite renderer to high!!!

[DillonThomasDigital]

This is a great video! Thank you! I got this working just a few minutes ago using Xverse plugin in 5.3. It seems to be fine but when I bring it into the vr template and activate VR, it only shows correctly in the left eye, whereas the right eye doesn't correctly show the splats - they look like billboard cards. Is it possible to view these splats in VR?

[Kafka-movg]

hi, can you render 360° panoramic frames including a gaussian splat? How does this work?

[kidtoday]

Anyone else notice how the translation transformations do not seem to work correctly with this plugin? When you try to move the GS actor, it will double transform and move diagonally on multiple axis. As cool as this is, if we can't properly transform the actors... it becomes almost unusable for many workflows.

[rajendrameena]

what about other propoerties of material like specularity, metalness, transmission etc because it just capture current view at the time of recording.

[bethany-rptq]

Is there any plugin available for 4D Gaussian Splatting?

[MWLaboratories]

Would it be possible for a player running a compiled UE5 game to upload a video and it is used in-game to generate an environment? Or are the splatting tools for dev environment only?

[dimaananyev]

Many thanks to the author for the clear explanation and high-quality demonstration. It inspires me to conduct my own experiments. I have some questions and would be grateful if the author of the video could answer them:
Firstly, I would like to understand more about performance, specifically how many resources are consumed in processing the files.
Is it possible to cut out an area with a single toy car, or an area with a single Christmas tree, from these files and then clone this object multiple times within an Unreal level?
I would like to learn more about the capabilities of working with lighting; it would be great if the next video could include a demonstration.
Thanks again for the video!

[TheDiervek]

Hold on!
Yes it can run in a standard browser and that is truly amazing but your browser uses your GPU.
It might not tax the GPU like some apps but it has to be using it even if it's simply to display an image.

[Hobnockers]

Cool. Can you change the texture maps, materials as well from the splat? I guess not possible?

[tomasyaconis]

my 3dgs dont load the textures in ue 5.4... any idea?

[kickassmovies]

what could be its usage apart from creating various camera movements ?

[cristobalpesce]

great video, a question, can applications be packaged using this plugin? I would like to add this to my games