{"repo":"inferock/inferock-bench","free":true,"listed":false,"github":"https://github.com/inferock/inferock-bench","clone":"git clone https://github.com/inferock/inferock-bench.git","description":"Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.","language":"TypeScript","stars":139,"topics":["ai-billing","anthropic","claude","cost-tracking","gemini","gpt","llm","llm-observability","openai","token-counting"],"license":null,"category":"ai-agents","readme_excerpt":"Your AI bill can be quietly wrong. Providers shouldn't get to grade their own bills. Today, the company that charges you also decides what counts as a failure, what gets credited, and keeps the only detailed records. inferock-bench puts an independent, per-call receipt of what you were billed — and what failed — in your own hands. Receipt contract · Quickstart · Integrations · Test your loss · What can go wrong · How this compares · Key boundary · Docs Disclosure: Inferock sells a hosted product, and this benchmark grades receipts against The Inferock Standard, which Inferock wrote. Do not take that on authority: check the public run cards in docs/ (the underlying sanitized event archives are not yet published), the spec, and the source, and read the hard questions and threat model for limits and adversarial-review invitations. Illustrative example, not a measured run. This lead image shows what a $124,863.47/mo AI spend could surface for review when a defensibly calibrated synthetic scenario is passed through the real bench pipeline. The pipeline organically aggregates $5,708.25 in money loss, including $4,564.14 estimated recoverable and $1,144.11 not recognized yet. Not measured by Inferock, not a guarantee, not a bill audit. Basis: independent third-party billing-audit inputs plus public latency throughput/SLA thresholds; source links and caveats are one click away. See the basis - · See newest measured run - Use it when you need to audit an AI/LLM bill, measure Claude or","default_branch":null,"files":null,"tree":[],"storefront":"/r/inferock","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/inferock/inferock-bench/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}