{"repo":"xlang-ai/OSWorld","free":true,"listed":false,"github":"https://github.com/xlang-ai/OSWorld","clone":"git clone https://github.com/xlang-ai/OSWorld.git","description":"[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments","language":"Python","stars":3090,"topics":["agent","artificial-intelligence","benchmark","multimodal","reinforcement-learning","rpa","code-generation","language-model","cli","gui"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Website • Paper • Doc • Data • Data Viewer • Discord • Cache 📢 Updates - 2025-07-28: Introducing OSWorld-Verified ! We have made major updates, fixed several issues reported by the community, with more support for AWS (can reduce evaluation time to within 1 hour through parallelization!), and making the benchmark signals more effective. Check out more in the report. We have run new model results in the latest version and updated them on the official website. Please compare your OSWorld results with the new benchmark results when running the latest version. - 2025-05-01: If you need pre-downloaded files for init state setup, we downloaded for you here. - 2024-10-22: We supported Docker🐳 for hosting virtual machines on virtualized platforms. Check below for detailed instructions! - 2024-06-15: We refactor the code of environment part to decompose VMware Integration, and start to support other platforms such as VirtualBox, AWS, Azure, etc. Hold tight! - 2024-04-11: We released our paper, environment and benchmark, and project page. Check it out! 💾 Installation VMware/VirtualBox (Desktop, Laptop, Bare Metal Machine) Suppose you are operating on a system that has not been virtualized (e.g. your desktop, laptop, bare metal machine), meaning you are not utilizing a virtualized environment like AWS, Azure, or k8s. If this is the case, proceed with the instructions below. However, if you are on a virtualized platform, please refer to the Docker section. 1. First, clone this reposit","default_branch":null,"files":null,"tree":[],"storefront":"/r/xlang-ai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/xlang-ai/OSWorld/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}