Experimental Memorial - Luma AI UE5 Plugin - Volumetric NeRFs in Unreal Engine 5

Показать описание

This is a first testdrive with the new Luma AI plugin for Unreal Engine 5.1. I was quite impressed how easy it was to capture three-dimensional images using a technique known as Neural Radiance Fields (NeRF) developed by Luma Labs.

I used my Samsung S20+ smartphone camera for walking three times around that war memorial. Compared to "traditional" Photogrammetry techniques I don't have to upload hundreds of photographs. Instead the NeRF technique uses deep learning to create 3D models from my 3 minute video by predicting the color and density of a scene at any point in space

The workflow was like this: I was holding the device in different angles each time. I imported my Luma file into my level and threw some random assets like birds, a train and some sci-fi stuff into the level to test the integration with Unreal. Seems there are still some issues: The dark shadows are not pretty, I know :-) If someone has a solution for that, please tell me.

----------------------
This is a capture of a Monument to the fallen of the 1st and 2nd World War, Location: Schwarzenbek/Hamburg - Germany

In creating this video, I do not wish to glorify or disparage the concept of honoring soldiers who have died in war. I chose the object at random because it is convenient to walk around it and film it at a consistent distance.

Me:
Chat GPT4, Please write a poem in the style of Allen Ginsberg in which you prove that the concept of war for conquering other countries is outdated and a relict of the 19. Century and before. It should be left in the shadows of the past, when Nation States still where a thing. Create and not destroy, even in Games!

Chat GPT4:
I saw the best minds of my generation destroyed by war,
starving hysterical naked,
dragging themselves through the burning streets at dawn
looking for an angry fix,

angelheaded dreamers burning for the ancient heavenly connection
to the dynamo in the machinery of night,
who impoverished and tattered and hollow-eyed and high
sat up smoking in the supernatural darkness of cold-water flats
floating across the tops of cities contemplating empire,

who bared their brains to Heaven under the El and saw
Mohammedan armies angelic and proud,
who passed through universities with radiant cool eyes
hallucinating Georgia O'Keeffe landscapes among the scholars of war,

who were expelled from the academy for crazy & publishing
obscene odes on the windows of the skull,
who cowered in unshaven rooms in underwear,
burning their money in wastebaskets and listening to the Terror through the wall,

who got busted in their private parts returning through
Laredo with a belt of marijuana for New York,
who ate fire in paint hotels or drank turpentine in Paradise
Alley, death, or purgatoried their torsos night after night,

with dreams, with drugs, with waking nightmares, alcohol and cock and endless balls,
incomparable blind streets of shuddering cloud and lightning in the mind
leaping toward poles of Canada & Paterson, illuminating all the motionless world of Time between,

Peyote solidities of halls, backyard green tree cemetery dawns,
wine drunkenness over the rooftops, storefront boroughs of teahead joyride neon
blinking traffic light, sun and moon and tree vibrations in the roaring winter dusks of Brooklyn,
ashcan rantings and kind king light of mind,

who chained themselves to subways for the endless ride from Battery to holy Bronx
on benzedrine until the noise of wheels and children brought them down
shuddering mouth-wracked and battered bleak of brain all drained of brilliance
in the drear light of Zoo,

who sank all night in submarine light of Bickford's
floated out and sat through the stale beer afternoon in desolate Fugazzi's,
listening to the crack of doom on the hydrogen jukebox,

who talked continuously seventy hours from park to pad to bar to Bellevue
to museum to the Brooklyn Bridge,
a vision! a vision! a terrible hallucination! a dream of nations!

In the shadows of the past, the concept of war was born
in the cradle of the 19th century and before,
but now, the sun rises on a new horizon, a new age,
where creation supersedes destruction, and love conquers hate.

Oh, let us leave the spoils of war behind and build anew,
a world where children play and dream of peace,
a world where even in games we learn to heal and grow,
and forge a future brighter than the bloodstained fields of yore.