Claude | Computer use for orchestrating tasks

With the upgraded Claude 3.5 Sonnet, we’re introducing a new capability in beta: computer use. Developers can now direct Claude to use computers the way people do—by looking at a screen, moving a cursor, clicking, and typing text.

While groundbreaking, computer use is still experimental—at times cumbersome and error-prone. We're releasing computer use early for feedback from developers.

In this demo, Claude orchestrates a multi-step task by searching the web, using native applications, and creating a plan with the resulting information.

Claude is generating all the computer actions shown here.

This demonstration was recorded in a controlled environment, with some supporting infrastructure simplified to highlight the core capabilities.

[Rareme]

This will revolutionize experience for the people with special needs, well done.

[thenoblerot]

The pixel coordinate identification is a big deal. Good job, Claude and Anthropic Team!
I'm really excited for Haiku 3.5 with vision!!

[whiteha]

The feature is inevitable, and I'm glad you're the first with it.

[sunitaroopnarine]

WOW! Such an explanatory video - I can't wait to use it to plan my next trip!!

[Wulk]

This will automate so many tidius repetitive tasks man I can't wait for this

[lthaxor]

Claude dipping its toes into using other software is really interesting

[chandrachoodR]

This is going to redefine how computation is done historically, you could even share tasks between LLM and Local computer optimizing the energy efficiency and reducing carbon foot print and a lot of the tasks can be automated if this becomes mainstream . Great work team

[elliotchapman]

I can definitely think of a use case here for the elderly.. instead of painfully trying to help desk them through the steps, you can have Claude do the walk through for you .. This could also be great for optimising their day from planning activities to scheduling the radio to come on for an hour in the morning to watching a film @ night & even order a meal on uber eats .. there is naturally a fear that this could lead to mass human replacement, but that largely depends on how sophisticated this gets & the value of human discernment through the process.

[pelangos]

Finally something unique from Anthropic. Hope to see this get better and faster!

[rohullahkarimi]

It is just mind boggling and I 'm so exciting that it is just the tiny beginning just 6 months from now this will become just look very simple with this speed of AI improvement like the light speed

[aiforculture]

Very exciting! (Also I love the Claw'd figurine! ❤)

[jonnyvpc]

This is innovation. At time of this writing, the accuracy of this models capping at what 14.9%. Revisit this comment later. Should be closer to 99%.

Good job Anthropic. Future is exciting

[JamesYeang]

Don't get me wrong, this is very cool, but it's something I'd expect Claude to do in the background. Maybe just ask me a few questions like "Do you want me to add to calendar".

[andrewleonardi]

I'm finally going to get 99 mining.

[JanacMeena]

- 🌇 Demonstrates planning a sunrise hike using Claude's computer.
- 🌉 Focuses on finding a location with a view of the Golden Gate Bridge.
- 📅 Integrates logistics with a calendar application for organization.

[EnGmA]

pls enable for PC users - would be amazing. i could talk to my pc and be as productive as before

[micbab-vgmu]

thanks - i will test it - maybe as a resarch assistance :)

[MoneySavingVideos]

It did this wrong. Drive time depends on the time of day. It should have determined the time to arrive (sunrise) BEFORE the drive time. Someone may get caught in the morning commute.

[siyandanhlebela]

I’m torn between excitement and fear; this is groundbreaking from the Anthropic and Claude team.

[Maybe]

All the other Anthropic Computer Use demos show the launching and use of a Linux Desktop. This is one of 2 Anthropic videos that show the use of a MacOS Desktop. It is not clear from this video if Pujaa is running Computer Use to control her computer directly or if she was running a sandboxed MacOS.

Pujaa, How did you get Computer Use to control a MacOS Desktop, whether it be Sandboxed or not? What command did you use to activate it?