Using an LLM to direct our robot Digit. #AI #GPT

In this demonstration, Digit starts out knowing there is trash on the floor and bins are used for recycling/trash. We use a voice command "clean up this mess" to have Digit help us. Digit hears the command and uses an LLM to interpret how best to achieve the stated goal with its existing physical capabilities.

At no point is Digit instructed on how to clean or what a mess is. This is an example of bridging the conversational nature of Chat GPT and other LLMS to generate real-world physical action.

-------------------------------------------------------------------------

At Agility, we make robots that are made for work. Our robot Digit works alongside us in spaces designed for people. Digit handles the boring and repetitive tasks that are meant for a machine, which allows companies and their people to focus on the work that requires the human element.

Subscribe (hit the bell for notifications)

Join our Team

Follow our Journey

#robotics #machinelearning #AI #GPT

[talltomtube]

It cleaned the mess without saying it was going to go have a smoke break first. It's already better than some of my past coworkers.

[metaphysicalArtist]

Fantastic!! Wow, this is such a great idea! I would love to see a video about how the robot recharges its battery and interacts with the dock. It must be so cool to watch it go in and out of the station.

[blackhawksp]

I just noticed the new legs, even tho I saw the previous promat videos, I find it very cool to see a design go throug streamlining and optimization.

[microMobilidade]

Wow so you can program them to participate in a fire drill! If the alarm sounds they have to go to an exit thats not close to the fire and to avoid humans. Or they could lag a bit to verify noone is left in the building calling for rescue. You guys are great!

[kmo]

Amazing, this is what has been missing in robotics so far, a brain. It feels like this plus the hability to speak to ask questions, an internal state and some memory would pretty much give you a working generalist robot that would actually be hable to do a lot of jobs.

[GT]

Well done Agility Robotics team! I saw you 2 years ago in the UK at Goodwood and the progress you made in HW and now with LLM integration... Bravo! You are literally eating Teslas lunch atm. Hope you guys find enough funding to go big. Whens the IPO?

[first-thoughtgiver-of-will]

Excellent utilization of next gen tech and very innovative! Keep up the awesome work!

[chenwilliam]

Amazing ❤
But it's not enough for a family 😊
We need a 'house keeper Robot' replacing the female
housekeeper we have hired and worked several years ❤

[autingo]

Excellent! Now it's getting REALLY interesting. :-D

[AWESOMEVIDESHEE]

Agility Robotics
gooood jooob, ai robots in for people and world ))

[lucasantonio]

wonderful! I can't wait until these little beauties can live in our homes and help us with the housework!

[davidtro]

How does it discriminate between materials? Known objects? Awesome demo! Please show more!

[witherwolf]

Interesting choice to go with digitigrade legs, makes for a very unique design

[JJs_playground]

This is absolutely amazing. Wow.

We are getting closer and closer to general purpose humanoid robots.

[DominicI]

This will be the future. If you don't mind me asking, which LLM is being used?

[Wanderer]

We need more updates like this showing how the robots are progressing. Not giving us a video update like once every 2 years

[datalifter]

You guys are doing great! it's so fun to watch your systems progress. Keep up the great work.

[Sirmenonottwo]

If you could just get Digit to walk around like it does not have to pee now that would be great! Or rename it Figgit for more accuracy.

[donaldsunny]

The Digit robot puts the newborn baby with the dirty nappy in the waste bin.😂

[lazarusblackwell]

People need to be freed from their work so they can live their life and not just be slaves or cogs in a machine.