How To Use Claude Computer Use Agent For Beginners (anthropic, claude 3.5 sonnet)

Let's learn how to let these AI models control our computer using the new interaction feature in Claude 3.5 Sonnet and Haiku models. If you want to skip to AI controlling my computer, go to 6:07 🤠

Setting Up Computer Use for Claude - Mac / Windows / Linux [Google Doc]:

Still need help setting up? Chat with this video here 👇

⚙️ Start automating anything with Zapier Today!

Introducing computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

Build with Claude - Computer use (beta)

-------------------------------------------------
➤ Follow @webcafeai

-------------------------------------------------

Key Takeaways:

✩ Model Upgrades: Claude 3.5 Sonnet offers improved coding performance and tool use, while Claude 3.5 Haiku delivers enhanced speed and affordability without compromising intelligence.
✩ Computer Use Feature: An experimental capability allowing Claude to interact with computer interfaces by moving cursors, clicking buttons, and typing, currently in public beta for developer feedback.
✩ Implementation Guidance: Instructions on integrating computer use through the API, including tool definitions, agent loops, and safety precautions to mitigate risks.

▼ Extra Links of Interest:

automate everything. 👇

👨‍💻 Ask Me Anything / Exclusive Content (119+ Lessons) ☕

My Setup To Record Content (amazon storefront) 📷

Become an Early Adopter 🍻

Starting today, developers can build with the computer use beta on the Anthropic API, Amazon Bedrock, and Google Cloud's Vertex AI.

I build things for fun 🤠

[Corbin_Brown]

If you want to skip to AI controlling my computer, go to 6:07

[peterscotson]

Thanks for the demonstration mate, I needed to see what it could do ! Can’t wait to see where it’s gonna go 🔥🔥

[bumpupsapp]

Hey Everyone 🤠
Find the parts that interest you:

0:00 - Download a cute cat photo
0:28 - AI can control our computer
2:11 - Set up your Anthropic API key
4:54 - Create Docker image for VM
5:56 - Verify Docker setup with Docker PS
9:01 - AI attempts to download cat image
10:37 - Picture of a cat shown
12:10 - Issues with API form submission
15:10 - Successfully submitted a form with AI

Chat with videos via Bumpups 🌲

[fernandogonzalezhenr]

This blows my mind. I’m going to try it after work and ask to make a financial model, using free public financial statements in pdf from public companies and fill out a spreadsheet

Nice

[ePreneurs]

Awesome man! Great work. I personally love zapier, and I even just started creating a few videos about Zapier, and I really see ton of value out of your content. Please, keep it up <3 :) all the best.

[pelangos]

THE CAT HAS BEEN SECURED THE CAT HAS BEEN SECURED THE CAT HAS BEEN SECURED AGI IS HERE

[zimovak]

So cool!!! Thank you for the demo. Your comments have made me laugh :-D

[onetwothreefour]

Your directions are easy enough to follow, but the docker portion does not work. clause-computer-use-demo container just keep exiting immediately upon start because "exec ./entrypoint.sh: no such file or directory". Docker won't even let me delete the build to try and restart. Bummed.

[peterlustig]

Very good video! So many comments from people that don't get it 😁

I installed and started claude computer use on my raspy 5, but it doesn't allow me to connect from another machine than localhost. I tried "--network host \" in the start.sh script I wrote, I modified the http_server.py in the docker image but it does not allow me to do this. It opens the web page with the two panes, but both of them only show an error, saying "localhost has denied the connection". There is no firewall or anything else involved, it's my home network.

[mihailion]

For some reason firefox it's missing in the Docker environment? Did they remove it?

[FloNocode]

Hi Corbin how are you, thanks for you content and use case ! I would like to know if it's possible to insert Timer with title in your video please ?

[nhoyo]

Bro is always one step ahead. Thanks!

Can we automate my Twitter/X

[jjmatashi]

I love your content, but Please, Please speak a bit more slowly and CLEARLY. You'll be easier to follow and understand, and I suspect that you'll get a LOT more subscribers because you're one of the only people who fully describes this stuff soup to nuts. This is meant respectfully, so THANKS for your service!

[djx_official]

It's free or not? I done all the steps but i got status code 400 error, message shows like your credit balance is too low

[DaneWinehouse]

/smfh
It is .. shall we say, infinitely more annoying turning off and enabling certain features thru a windows install.
/looks over at sudo
WHY CANT POWERTERMINAL BE EASY?!
lol

[DanielFelipeKlotz]

Unusable to do anything meaningful due to rate limits, unfortunately.

[jackyyang]

this is not manipulating my personal desktop environment so it's not helpful

[sidharthshekar]

I could have downloaded the same image in 2 seconds for which you took 15 minutes to input the task into the ai, thats lame