New AI: This Is A Gaming Revolution!

📝 The paper "Categorical Codebook Matching for Embodied Character Controllers" is available here:

📝 My paper on simulations that look almost like reality is available for free here:

Or this is the orig. Nature Physics link with clickable citations:

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Gaston Ingaramo, Gordon Child, John Le, Kyle Davis, Loyal Alchemist, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Sundvall, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.

[TheAkdzyn]

I'm genuinely impressed with it's leg motion simulation and how smooth it is. Exciting updates as always. Thank you as always.

[Steamrick]

This would probably really benefit from one more sensor to clip to your belt. Acceleration, hip angle, vibration from steps would make lower body guesses much more accurate without major inconvenience.

[epimolophant]

Those are the legs Zuckerberg desperately needed for Meta back then

[AmbientMood]

Wow, adding this to VRChat would do wonders. Just like networks physics collision with other players brings a whole other level of emersion, i think this would be one of those things that one cannot look back from.

[coolbath]

add this with some extra knee or feet sensors, we'll get the perfect embodiment tracker!

[Quicksplained_]

This will be great for online VR gaming imersion, where you can see the other players doing more realistic movements,

for example if your playing a shooter and the enemy is crouching, it should look like a more realistic crouch and therefore more immersive for you.

[styxrakash]

So they used neural networks to improve the accuracy of inverse kinematics for VR?

[marvin]

We finally have the leg technology for the metaverse, surely this will save it

[shang]

I remember getting a Nintendo WIi for the first time. It came with Wii Sports, and at first we'd play bowling and baseball the way they were intended, but eventually we discovered that you could throw the ball with a short flick of the hand rather than swinging your whole arm, and that's what we did.

Most of the time you don't want an interface that requires moving your whole body, you want small precise movements.

[dan_loup]

The kinect can do that, however it lacked developers that were willing to actually make games that make full use of the body tracking, instead opting for using the device as a glorified virtual button pusher.
"make X pose to press virtual button Y" and that was naturally laggy as you needed to finish the pose to the game to start processing the input.

[DavidInfinityOfficial]

I remember doing this like a decade ago with my Kinect 360…

[mitchellvandongen]

I Just found this channel again after being lost for a year. I don't know why I wasn't subbed before, but I am now. I love your videos. What a time to be alive.

[fen]

Right now any VRchat fan without the budget for (or faith in) body trackers should be very excited. Plus some of my favorite games like Into The Radius and Blade & Sorcery would seriously benefit from this.

[ChiggenWingz]

The video title and thumbnail are appallingly bad for what this video is trying to show off. The content is great and I'm sharing it around to other VR devs, but damn if the title and thumbnail way off the mark :\

[TheKwiatek]

Finally, a video about something new without using irrelevant clips from other vaguely relevant papers. Grrat job 👍

[matandessaur]

I want to move in an intergalactic something !

[LarryPanozzo]

1:33 “That is absolutely insanity.”

I concur.

[jackburton]

During the Friends theme song I always wait for the applause, to clap too.
For years now in every video I've been waiting for you to say *"What a time to be alive"* so I can say it too.
I don't know, maybe I have OCD but... I enjoy it too much!

[johnemanuelsson]

What needs to be done next is to input actual data from lower body, such as camera data from headset and actual trackers. Optional support for mirrors would be great as well.

[cddelgado]

04:36 I came for the information. I smiled for the moment.