{"repo":"mintance/nginx-clickhouse","free":true,"listed":false,"github":"https://github.com/mintance/nginx-clickhouse","clone":"git clone https://github.com/mintance/nginx-clickhouse.git","description":"Simple nginx logs parser & transporter to ClickHouse database.","language":"Go","stars":159,"topics":["clickhouse","logs","nginx","analytics","grafana","monitoring","prometheus"],"license":"Apache-2.0","category":"analytics","readme_excerpt":"nginx-clickhouse Simple NGINX access log parser and transporter to ClickHouse database. Uses the native TCP protocol for fast, compressed batch inserts. Features - Tails NGINX access logs in real-time - Configurable log format parsing via gonx - JSON access log support ( log format escape=json ) alongside traditional text format - Log enrichment : auto-hostname, environment, service tags, status class, referrer domain, URL extension - User-agent parsing and bot detection via go-ua-parser — browser, OS, device type, bot name/class - Batch inserts into ClickHouse using the official Go client (native TCP, LZ4 compression) - Retry with exponential backoff and full jitter on ClickHouse failures - Automatic connection recovery — reconnects transparently after outages - Optional disk buffer with segment files for crash recovery (at-least-once delivery) - Server-side batching via ClickHouse async inserts ( async insert=1, wait for async insert=1 ) - Circuit breaker to fast-fail when ClickHouse is persistently down - Bulk loading ( -once ) — read an entire log file and exit - Stdin support ( -stdin ) — pipe or stream logs from other tools - Graceful shutdown — flushes buffer on SIGTERM/SIGINT or EOF - /healthz endpoint for Kubernetes liveness/readiness probes - Prometheus metrics: buffer size, flush latency, parse errors, circuit breaker state - Expression-based filtering and sampling — drop health checks, keep only 5xx, sample 10% of 2xx, etc. via expr-lang - Structured JSON logging ","default_branch":null,"files":null,"tree":[],"storefront":"/r/mintance","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mintance/nginx-clickhouse/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}