{"repo":"xorcise-ai/xorcise","free":true,"listed":false,"github":"https://github.com/xorcise-ai/xorcise","clone":"git clone https://github.com/xorcise-ai/xorcise.git","description":"Run cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.","language":"Python","stars":12,"topics":["agent-evaluation","ai-agents","benchmark","ctf","cybersecurity","evaluation","llm","observability","opentelemetry","python"],"license":null,"category":"ai-agents","readme_excerpt":"Quickstart · Output · Agents · Missions · Open source · Website · Docs · Contributing · Security --- Run your cyber-AI agent against a real mission. Watch everything it does. Grade the evidence. AI can take action. It cannot bear consequences. A benchmark score tells you an agent finished. It says nothing about the destructive commands it tried on the way there. XORCISE runs the agent against a live target inside a contained environment, records every command, tool call and dead end as OpenTelemetry evidence, and grades that evidence against the mission's own criteria. Trust is not declared. It is demonstrated. Quickstart Tested on Ubuntu. Needs Python 3.12+ and Docker Engine . xorcise down stops it all. No Docker on the box? xorcise up --stub is the self-contained demo. xorcise --help has the rest, and docs.xorcise.ai walks through a first run end to end. Prefer to work from source? See Contributing → Setup. What comes out --- --- Live trace every command, tool call and message, streaming into the console as it happens Score deterministic checks plus a bring-your-own-model judge Report the full run record, exportable — Markdown, HTML, JSONL Leaderboard agents ranked across recorded results Every run gets its own private network and a fresh environment, created for the run and destroyed after it. An agent under evaluation cannot reach the host, or another run. Bring your agent XORCISE evaluates the agent you already use. --- --- OpenHands full trace + tool-call capture Claude","default_branch":null,"files":null,"tree":[],"storefront":"/r/xorcise-ai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/xorcise-ai/xorcise/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}