Luma AI NeRF Setup in Unreal Engine 5 and Camera Round Trip

preview_player
Показать описание
How to create Nerf in Luma AI and set it up in Unreal Engine. How to prepare camera animation either directly in Luma AI or import it from Unreal Engine.

00:00 Creating Nerf in Luma AI
02:32 Setting up Nerf in Unreal Engine
04:21 Adjusting & Cropping Nerf in Unreal Engine
06:26 Camera Export from UE for Further Luma AI Local Render
09:21 Final Words & Addressing Issues

At this day (2023-09-19), in order to maintain reflections and full quality of Nerfs, renders have to be made locally in Luma AI. If brought to UE, they do not maintain reflections and details like they are presented in Luma AI previews. Furthermore, once brought from Unreal Engine, the camera and scale do not match, which create an issue for possible matchmaking for compositing opportunities. For now, the only workaround is to try to eyeball it, or track the render for further compositing. I hope this will change in future.
Рекомендации по теме
Комментарии
Автор

Helo! Great video, thanks. I have few questions:
1) The original camerapath in my models is strange, so I recreated the camera path in luma, however when I open to same link, it "brings" the viewer in the original strange path. How can I update the camerapath to the new one?
2) What would be your best suggestion for showing multiple models on our website at the same time? Should I upload them seperately or can I merge multiple splats into 1 scene?

Thank you!

atlantistogether
Автор

i'm fairly new to this and i was wondering if you can clarify something for me. When I download a *.luma file, this is a NeRF, and when I download a *.ply this is a Gaussian Splatter, is this correct? And if it is correct, why have they not named it so on their website. Everything is just called "interactive" scenes or something like that.

red
Автор

Hi. Great video. I am wondering what camera did you use for these?

ZhiwanCheung
Автор

Hi! I have just downloaded Unreal 5.3. and tryed to connect with Luma ai plugin but it seems plugin is for 5.2. update? Any help? :)

marinomazor.adventures
Автор

Hi! Can I import these files into my own project, or it only has to be operated within this specific project?

TheChrisNong