NVIDIA ACE for Games Sparks Life Into Virtual Characters With Generative AI

NVIDIA ACE for Games is a new foundry for intelligent in-game characters powered by generative AI. Developers of middleware, tools, and games can use NVIDIA ACE for Games to build and deploy customized speech, conversation, and animation AI models in their software and games.

Watch our NVIDIA Kairos demo, showcasing how NVIDIA partnered with Convai to help optimize and integrate ACE for Games modules into an immersive and dynamic interaction with a non playable character named Jin. The demo is also enhanced with ray tracing and performance multiplying NVIDIA DLSS 3.

Subscribe to @NVIDIAGeForce for more PC gaming content featuring advanced graphics, AI, and high-performance technology.

Subscribe to @NVIDIADeveloper to see more cutting-edge PC gaming development software and tools.

#nvidia
#Omniverse
#RTXOn

[johnclark]

This is the widest aspect ratio I’ve ever seen for a video, it’s so wide it just blows past the point of being cinematic

[orangeguidancesoapstone]

Feels like an oblivion npc interaction lol

[domagojbelic]

Interesting showcase for sure. Jin definitely sounds a bit unnatural, but I can easily see how these technologies could change the gaming industry.

[MrMindlink]

The Ramen shop looks amazing, but the interaction, while cool in its conception, was not very impressive in its execution. IMHO

[OcihEvE]

It's hard to exhibit the AI generated element from this alone. This is a sample of every recorded conversation we skip, skip, skip in any given video game. I'm sure the AI generative side allows us to return to that bar and order food, have a unique conversation or take a different, radiant quest. Just hard to express that in a 2 minute UE5 showcase.

[KKahnwald]

Many individuals critiquing this might not fully grasp the significance of what's unfolding here. It's monumental! This represents the future of dialogue-driven AI, taking charge of every non-playable character within a gaming universe.

I often find myself being critical of the content shared on this platform, but this particular video compelled me to reply. At present, our gaming worlds are populated with hundreds, sometimes thousands, of NPCs spewing out predetermined dialogues, serving little to no purpose beyond their scripted roles. Let's consider GTA V – an incredible game but held back by the lack of substantial interaction with NPCs beyond a couple of repetitive lines. Not immersive at all.

Now, envision a scenario where every seemingly inconsequential NPC has a unique backstory, a set role, a distinct purpose. What if you could engage in meaningful conversations about the game world with any character you encounter? The scale of impact this could have is astounding.

Consider exploring the world of Cyberpunk 2077, where every interaction doesn't merely fall into the confines of a few prewritten dialogues. Instead, you could engage in diverse discussions about the intricacies of the world around you. This could revolutionize immersion in gaming like never before. I am excited!

It's relatively effortless to dismiss the initial versions of technology. Take the case of RTX, and see the remarkable journey it's undergone from its infancy. Remember the debut of DLSS? Today, it's universally used by anyone who can access it.
Allow the technology to mature and witness its potential unfold. It's always easy to hate online to get likes.

[trackah]

I think eventually we get full non-scripted NPC using generative-AI dialog. kinda like procedural generation. So each time you speak to a NPC, you will get a different conversation entirely.

[MaTtRoSiTy]

Games are going to get so crazy so fast, when they can make AI NPC's have better human like expressions it will be beyond amazing

[markspatny]

The underlying technology sounds great, and being able to give these characters backstories and history that inform their AI interactions is super cool. That said, this is a terrible demonstration of that tech. Aside from the quality of the rendering, it's indistinguishable from an NPC interaction in a 90s CD-ROM game. I implore you to please use storytellers to create scenarios for demos like this, to breath some life into the character, and show them doing a little smalltalk interaction before assigning a side quest. That's the whole point us using AI for characters in the first place. To make them feel and react like humans.

[cormoran]

This showcases conversational AI in the same way your Redfall and Gollum ads showcased graphics.

[TheDigitalGuerrilla]

I don't hear or see emotions... But if they answer with that speed I'd be quite happy

[fb]

Imagine quests being assigned on the fly by underlying AI instead of getting scripted ones.

[ricepony]

Correct me if I’m wrong, but I think the point of this is to show that developers could basically use AI to create entire scenes, characters and dialogue with minimal input.

[HarryUK]

It’s like talking to Microsoft Sam in 1998.

It would be more inversive if the NPC would also greet the player and ask him what's up.

[PorkYoSelf]

"Hey Jin, how's it hangin'?"
"The Hanging Gardens of Babylon were a massive, terraced garden built by King Nebuchadnezzar II for his wife, Amytis. The gardens were said to be a marvel of engineering and irrigation, and they were one of the Seven Wonders of the Ancient World. However, their existence has been disputed by some historians, and their exact location is unknown. Worst of all, the powerful crime lord Kumon Aoki is causing all sorts of Chaos in the city."

[ukaszp]

We need wider aspect ratio and bigger black bars!

[JakobDam]

That's definitely interesting, and it can be extremely good when it's rolled out in games. However, I'd like to have heard the answers to some questions that didn't sound scripted; the dialog here was pretty much what you could expect with a multiple-choice menu. How about saying "Hey Jin, how much did you pay for that hat?" or "I found a booger underneath this bar chair, damn that's gross"... I mean, he should be able to respond within parameters - and it'd be key to making the NPC's more lifelike.

[Gonnes]

Cara isso é muito louco, isso sim eu posso chamar de nova geração. Imagina as possibilidades dessa tecnologia em jogos de RPG, SAO está cada vez mais presente.

[Kuli]

Monotone, mouth doesn't line up, guy just stands there with no emotion or movement.... am I missing something? What was the point of this? I'd be mashing the "skip" button.