{"repo":"abyo-software/s4","free":true,"listed":false,"github":"https://github.com/abyo-software/s4","clone":"git clone https://github.com/abyo-software/s4.git","description":"GPU-accelerated transparent compression S3-compatible storage gateway. Drop-in replacement for AWS S3 endpoints; cuts your S3 bill 50-80% with no app changes (Rust, nvCOMP, zstd).","language":"Rust","stars":155,"topics":["apache-2","aws-s3","compression","cost-optimization","cuda","data-lake","gpu","minio","nvcomp","observability"],"license":"Apache-2.0","category":"analytics","readme_excerpt":"S4 — Squished S3 Cut your S3 storage bill 50–80% — drop-in, zero app-code changes S4 (Squished S3) is an S3-compatible gateway that sits in front of your existing S3 bucket and transparently compresses every object on the way in, then decompresses it on the way out. Point boto3, aws-cli, Spark, Trino, DuckDB — anything that speaks the S3 API — at S4, and your apps keep working unchanged while your backend stores 50–80% fewer bytes . The main thing that changes is the endpoint URL. - No app changes — same S3 wire protocol, SigV4 auth, and SDK calls; just change --endpoint-url . (GET returns the original bytes; HEAD reports the original size and ETag too — the compression is invisible to clients by default.) - Per-object smart codec — CPU zstd for text/logs, GPU nvCOMP (Bitcomp/zstd/GDeflate) for integer/columnar data, passthrough for already-compressed inputs. You almost never need a GPU. - No lock-in — stop the gateway and the compressed objects + S4IX sidecars stay S3-native, decodable by the Apache-2.0 s4-codec CLI / library ( pip / WASM / Rust). (format) - Range GET for framed objects — sidecar-indexed byte ranges serve Parquet/ORC readers; some SSE / multipart-SSE modes use a buffered fallback. ☁️ Run it on AWS Marketplace — AWS-billed, no app changes: ▶ Container on EKS / ECS / Fargate — hourly per pod; runs on any small CPU node; the default path for most workloads.  ·  Metered Savings edition — pay per GB actually saved instead of per pod-hour ( ⅓ of the avoi","default_branch":null,"files":null,"tree":[],"storefront":"/r/abyo-software","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/abyo-software/s4/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}