3D Gaussian Splats in Motion. 4DGS/RGB+W.

preview_player
Показать описание
This post represents our next phase of progress with 4DGS research.

We're working with the original code base from Inria:

Captured with IR's custom-built "AeonX:S0L" scanning rig.

The next phase of R&D for us was to capture 3d Gaussian Splats under varying RGB+W lighting states and to process them "in motion".

This is an early sneak peek at 2 seconds of test footage of each "character" played by @henrypearce4D who's been digitized into the Splatterverse!! Inhabiting virtual characters.

We wanted to explore different lighting states (not just GI), with different clothing and character performances. This is a small example of a longer video piece we have planned that will be all 4DGS. We still have some improvements to be made on floater removal and temporal stability.

We're posting these snippet videos to showcase our progress with 3D/4DGS. We plan to write a full blog post on our 3D/4DGS journey soon.

Our next goal is to capture and process much longer performances, with more costumes and character pieces! Ideally to inspire.

We cannot wait to move this research over to our full-body rig. Then to playback in VR.

HDRI's Programmed into the S0L Lighting Rig

#GaussianSplatting #inria #4D #radiancefields #ir #aeonx #rgbw #idatronic #ximea #sibr #hdri #notavideo #60fps #actual #volumetric #spatialcapture 👀 ───

Рекомендации по теме
Комментарии
Автор

That looks great! Love the tone of each scene really comes through, that's fun.
Imagine a director: "That scene went great, but can we rotate the main character more towards the camera?" *clicks* "Now about that set lighting..."

MadComputerScientist
Автор

This is so amazing, would love to see some data and facts about performance and advantages over other 3d modeling techniques. File size, FPS, GPU Memory usage, and so on. Please let them wonderful videos coming, it’s eye candy!

egalegalegalegal
Автор

amazing , How do you create a dynamic gaussian splatting rather than static effect?

stickmanuniverssid
Автор

Bonkers tech. Amazing. Do you think this will ever be used in games?

dawsoncjames
Автор

that's awesome! What's the performance like? Fast enough to run in VR?

theteddychannel
Автор

What software is used to combine the multiple videos?

mattm