{"repo":"TobiasNorlund/ui-act","free":true,"listed":false,"github":"https://github.com/TobiasNorlund/ui-act","clone":"git clone https://github.com/TobiasNorlund/ui-act.git","description":"A seamless Computer Use agent for Linux","language":"Rust","stars":88,"topics":["automation","linux","ui-agent"],"license":null,"category":"workflow-automation","readme_excerpt":"--- UI Act is a Computer Use/GUI agent software that works alongside you on your Linux desktop. Just press CTRL + Space , type your prompt and the agent will kick off — using its own mouse and keyboard . Have a look: Demo This way, you can still continue working as the agent doesn't hog your mouse. Yet, it allows for a seamless agent handoff as it's working directly in your desktop environment! It works by using Multi-Pointer X (MPX), a feature for having multiple mouse pointers in the X windowing system. UI Act is completely free and open source (Apache License 2.0), and you stay in control of your data by providing your own API key. Currently UI Act supports Anthropic as Computer Use backend. Note: Looking for UI Act the model (an early computer use model)? It has been moved here ⚡️ Quick start UI Act currently only runs on Ubuntu Desktop 24.04 and later, and is distributed as a debian package. Run this in a terminal to set it up: Now log out and log back in again for the changes to take effect. Then run: You are now set up to use UI Act! Try press CTRL + Space and kick off a prompt! Note: You will need to run your session using X11, not Wayland. Check what your're running with echo $XDG SESSION TYPE . To switch, log out and on the login screen, click on your username to activate the password field. Click the gear icon in the bottom right corner and select \"Ubuntu on Xorg\" before logging in. 🛠️ How it works The package installs a CLI tool ui-act that runs the agent, and a ","default_branch":null,"files":null,"tree":[],"storefront":"/r/TobiasNorlund","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/TobiasNorlund/ui-act/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}