{"repo":"open-compress/claw-compactor","free":true,"listed":false,"github":"https://github.com/open-compress/claw-compactor","clone":"git clone https://github.com/open-compress/claw-compactor.git","description":"14-stage Fusion Pipeline for LLM token compression — reversible compression, AST-aware code analysis, intelligent content routing. Zero LLM inference cost. MIT licensed.","language":"Python","stars":2034,"topics":["ai-agent-tools","context-compression","context-pruning","context-window-optimization","llm-compression","llm-tools","openclaw","prompt-compression","token-compression","claw-compactor"],"license":"MIT","category":"machine-learning","readme_excerpt":"Claw Compactor 14-Stage Fusion Pipeline for LLM Token Compression 15–82% compression depending on content · Zero LLM inference cost · Reversible · 1600+ tests Documentation · Architecture · Benchmarks · Quick Start · API --- What is Claw Compactor? Claw Compactor is an open-source LLM token compression engine built around a 14-stage Fusion Pipeline . Each stage is a specialized compressor — from AST-aware code analysis to JSON statistical sampling to simhash-based deduplication — chained through an immutable data flow architecture where each stage's output feeds the next. Demo --- How It Compares Feature Claw Compactor LLMLingua-2 SelectiveContext gzip + base64 :-------- :-: :-: :-: :-: Compression rate 15–82% 30–70% 10–40% 60–80% ROUGE-L @ 0.3 0.653 0.346 0.4 N/A ROUGE-L @ 0.5 0.723 0.570 0.6 N/A LLM inference cost $0 $0.02/call $0 $0 Latency bool: return ctx.content type == \"log\" def apply(self, ctx: FusionContext) - FusionResult: compressed = my compression logic(ctx.content) return FusionResult( content=compressed, original tokens=estimate tokens(ctx.content), compressed tokens=estimate tokens(compressed), ) Add to pipeline pipeline = engine.pipeline.add(MyStage()) bash python3 scripts/mem compress.py [options] 12,000+ lines Python · 1,600+ tests · 14 fusion stages · 0 external ML dependencies bash Clone git clone https://github.com/open-compress/claw-compactor.git cd claw-compactor Optional: exact token counting pip instal","default_branch":null,"files":null,"tree":[],"storefront":"/r/open-compress","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/open-compress/claw-compactor/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}