{"repo":"yaroshevych/desktopctl","free":true,"listed":false,"github":"https://github.com/yaroshevych/desktopctl","clone":"git clone https://github.com/yaroshevych/desktopctl.git","description":"GPU-accelerated CLI tool for AI agents, to control computer via screen, mouse, and keyboard.","language":"Rust","stars":62,"topics":["ai-agents","osx","automation","cli","computer-vision","desktop-automation","playwright"],"license":"MIT","category":"ai-agents","readme_excerpt":"DesktopCtl Local CLI for AI agents to observe and control your computer via screen, mouse, and keyboard. Bring your own AI - any model, even without vision. Runs fully local. No screenshots sent to the cloud. Learn more at https://desktopctl.com https://github.com/user-attachments/assets/4321b23e-6706-4792-a911-89e13766ebc0 Why DesktopCtl - Local-first runtime. No cloud dependency - Bring your own AI: works with any desktop AI agent - GPU-accelerated text recognition and computer vision - Selector-first automation ( --text , --token ) with coordinate fallback - Agent-friendly explicit waits and post-action verification - Stable JSON contracts for agent integrations Architecture DesktopCtl is split into two binaries: - DesktopCtl.app ( desktopctld ): daemon that owns perception, state, execution, and verification - desktopctl : stateless CLI surface for actions and queries over local IPC Repository layout: - src/desktop/core - shared protocol and types - src/desktop/daemon - daemon runtime - src/desktop/cli - CLI client Current Scope - macOS-first - OCR-first perception pipeline - Tokenized screen output for agent grounding - Deterministic CLI primitives for click/type/wait flows Prerequisites - macOS (current support target) - Rust toolchain ( cargo ) - just command runner - Accessibility permission for DesktopCtl.app - Screen Recording permission for DesktopCtl.app Quick Start Status / Roadmap - Status: active development, with macOS-first CLI and daemon workflows already us","default_branch":null,"files":null,"tree":[],"storefront":"/r/yaroshevych","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/yaroshevych/desktopctl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}