{"repo":"The-Distillery-dev/thedistillery","free":true,"listed":false,"github":"https://github.com/The-Distillery-dev/thedistillery","clone":"git clone https://github.com/The-Distillery-dev/thedistillery.git","description":"The Distillery. A Token Optimization Proxy","language":"TypeScript","stars":110,"topics":["anthropic","claude","claude-code","cli","context-optimization","cost-reduction","developer-tools","llm","proxy","token-optimization"],"license":null,"category":"networking-infra","readme_excerpt":"The Distillery Cut your input tokens before they reach the model. The Distillery is a local token-optimization proxy for AI coding tools. It sits between your coding agent and the model API, removes redundant input context, and reports the overall input reduction across your sessions. It is built for developers who want lower model bills without prompt rewriting, workflow changes, or sending code to The Distillery's hosted service for optimization. Install Requires Node.js =20.9.0 <25 . Quick Start thedistillery start binds to 127.0.0.1:3080 by default and automatically configures Claude Code routing. For other clients, point the tool at the local Anthropic or OpenAI-compatible endpoint shown below. What It Does The Distillery optimizes request input before it reaches the upstream model API: 1. Deduplication - removes identical tool outputs already seen in the session. 2. Tool output distillation - trims oversized shell, search, diff, and file outputs while preserving useful head/tail context. 3. Retention - keeps the most useful session context when history grows too large. 4. Prompt-cache placement - on paid plans, places cache breakpoints automatically where supported. The displayed reduction is an input-token metric. Output tokens are streamed back unchanged. Supported Clients The Distillery works with Claude Code automatically and with any client that supports a custom Anthropic base URL or OpenAI-compatible base URL. Client Configuration OpenAI adapter required --- --- ","default_branch":null,"files":null,"tree":[],"storefront":"/r/The-Distillery-dev","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/The-Distillery-dev/thedistillery/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}