{"repo":"koralium/flowtide","free":true,"listed":false,"github":"https://github.com/koralium/flowtide","clone":"git clone https://github.com/koralium/flowtide.git","description":"High-performance streaming SQL query engine designed for real-time data processing. Use cases include event-driven architectures, ETL pipelines, and modern data-intensive applications.","language":"C#","stars":107,"topics":["engine","integration","materialize","stream","denormalize","stream-processing","streaming","data-engineering","etl","etl-pipeline"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Flowtide.NET Streaming integration engine Explore the docs » Flowtide is a high-performance streaming SQL query engine designed for real-time data processing. Flowtide enables operations on live data streams such as joins, aggregations, windowing, and recursive queries. Use cases include event-driven architectures, ETL pipelines, and modern data-intensive applications. Key Features - Versatile Connector Support : Ready-built connectors are available for databases such as SQL Server, MongoDB, CosmosDB, Elasticsearch, etc., with the possibility to build your own connectors in .NET. - SQL Language Support : Write your data streams and integrations using SQL, making complex data handling accessible and manageable. - High-Performance Operations : Supports various operations such as projection, filtering, joining, aggregation, and recursion, enabling complex data transformations. - Integrated Checkpointing System : Features a custom storage solution with a built-in checkpointing system to ensure data integrity and support full rollback capabilities on failure. - Larger than RAM Support : Writes data to temporary storage on disk to manage data streams larger than the system's memory. - Materialize Data : Easily materialize data from one or multiple sources into a destination, enabling architectures such as CQRS. - Vector Clock Watermark System : Notifies when rows from the source system have been processed by the stream, informing users when the data has been transferred. - OpenLine","default_branch":null,"files":null,"tree":[],"storefront":"/r/koralium","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/koralium/flowtide/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}