LangGraph Computer Use Agents

A LangGraph agent that uses the OpenAI Computer Use API and Scrapybara to build a computer use agent

pip install langgraph-cua

[kenchang]

I'll have to investigate further, although I'm hopeful. Every time I hear "this is going to take a while" and it's a closed source model I see money being sucked from my credit card.

[Paper-Z]

But i suspect this will be quite expensive


Also, instead of vm, what if i wanted it to actually interact with an app on my pc?

[letshi]

I decided to test this out myself and instead of using openai, I tried using a local vision-language model:
Qwen/Qwen2.5-VL-3B-Instruct --dtype=half

I am not seeing a way to switch out the model in create_cua(). Is this possible? If not, can this change be added?

[abdulrehmanbaber]

I am confused, are we using computer use of openai? Or u created your own? As you mentioned that computer use api of openai is state full? So i am little confused

2nd i dont want any vm i want to run this on my ec2 win server

[skytuebingen]

Awesome work!! The life struggling with playwright is gone.

[kfliden]

I'm curious why the browser implementers haven't implemented this as a native feature yet. With some optin they could analyze users' common webpage sessions and create more optimal agent navigation, with integrated login functionality.

[kfliden]

Super cool! How does this compare to Browser Use?

[palashjyotiborah]

General rule of thumb. short crisp videos are always better than long boring once. If you can say a 10 min thing in 2 mins, say it in 2 mins and tell me 4 more such concepts.

[JeomonGeorge]

I have built an ai agent that can control computer called the computer agent currently it can control the windows machine
I built with langgraph under the hood.
There is no computer use api or ominiparser i just built from scratch

[davesongpc]

Isn’t this just similar to browser-use?

[vasanth]

please do a developer version like you did for email assistant.

[marcusdidius]

I got me a scrapybara api key. Still I get
NotFoundError: Error code: 404 - {'error': {'message': 'The model does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}
During task with name 'call_model' and id '...'
A description how to set up your scapybara account to make this work would be appreciated.