{"repo":"glassflow/clickhouse-etl","free":true,"listed":false,"github":"https://github.com/glassflow/clickhouse-etl","clone":"git clone https://github.com/glassflow/clickhouse-etl.git","description":"GlassFlow: Open source data ingestion and transformations for ClickHouse pipelines","language":"TypeScript","stars":497,"topics":["clickhouse","kafka","realtime-etl","streamprocessing","glassflow","otlp"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Docs · Report Bug · Roadmap · Get Help · Watch Demo · Free Swag Ingest your data into ClickHouse from day one Backfill historical data, keep CDC in sync, handle schema changes, normalize messy data, and keep ClickHouse queries correct. GlassFlow is an open-source stream processing engine designed for data ingestion and transformation from multiple sources into ClickHouse. GlassFlow comes with the following core functionalities: - Stateless transformations : Powered by the expr expression engine, enabling flexible data transformations using helper functions and standard operators (e.g., removing null values or replacing missing timestamps). - Stateful transformations : A built-in state store allows deduplication logic and temporal joins over configurable time windows. - Filtering : Drop events you don’t want to ingest into ClickHouse before they reach your tables. - Ingest only : Direct data transfer from many sources to ClickHouse without transformations. - Metrics & OTEL : Built-in pipeline metrics with OpenTelemetry support. - Dead-Letter-Queue : Keep pipelines running when faulty events occur. Inspect failed events and reprocess them later. ⚡️ Quick Start To get started with GlassFlow, you can: 1. Install on Kubernetes : Follow our Kubernetes Installation Guide for any production deployment 2. Learn More : Explore our Usage Guide to start creating data pipelines 🧭 Installation Options GlassFlow is open source and can be self-hosted on Kubernetes. GlassFlow works with any ","default_branch":null,"files":null,"tree":[],"storefront":"/r/glassflow","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/glassflow/clickhouse-etl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}