{"repo":"icegatetech/icegate","free":true,"listed":false,"github":"https://github.com/icegatetech/icegate","clone":"git clone https://github.com/icegatetech/icegate.git","description":"IceGate is an observability data lake engine","language":"Rust","stars":33,"topics":["iceberg","logs","metrics","monitoring","observability","traces","alerts","apache-arrow","data-lake","datafusion"],"license":"Apache-2.0","category":"analytics","readme_excerpt":"IceGate icegate.tech · Documentation · Slack An Observability Data Lake engine designed to be fast, easy-to-use, cost-effective, scalable, and fault-tolerant. IceGate supports open protocols and APIs compatible with standard ingesting and querying tools. All data is persisted in Object Storage, including WAL for ingested data, catalog metadata, and the data layer. Features - Highly Scalable : Scale compute resources independently based on workload demands of specific components - ACID Transactions : Full transaction support without requiring a dedicated OLTP database - Exactly-Once Delivery : Reliable data ingestion with no data loss or duplication - Real-Time Queries : Access live data through WAL while maintaining historical query capabilities - Open Standards : Built on Apache Iceberg, Arrow, and Parquet with OpenTelemetry protocol support - Cost-Effective : Object storage-based architecture minimizes infrastructure costs - Fault-Tolerant : Designed for resilience and high availability Architecture IceGate employs a compute-storage separation architecture, allowing independent scaling of processing and storage resources. This design enables cost-effective scaling where compute resources (Ingest, Query, Maintain, Alert) can be scaled independently based on workload demands, while all data resides in object storage. The system consists of five core components for handling observability data (metrics, traces, logs, and events): Catalog - Technology : Apache Iceberg - Purpose ","default_branch":null,"files":null,"tree":[],"storefront":"/r/icegatetech","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/icegatetech/icegate/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}