{"repo":"arkflow-rs/arkflow","free":true,"listed":false,"github":"https://github.com/arkflow-rs/arkflow","clone":"git clone https://github.com/arkflow-rs/arkflow.git","description":"High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.","language":"Rust","stars":1300,"topics":["flow","rust","rust-lang","stream","sql","datafusion","duckdb","kafka","mysql","postgresql"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"ArkFlow English 中文 Latest docs Dev docs High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis. It not only supports multiple input/output sources and processors, but also enables easy loading and execution of machine learning models, enabling streaming data and inference, anomaly detection, and complex event processing. Cloud Native Landscape     ArkFlow enlisted in the CNCF Cloud Native Landscape. Features - High Performance : Built on Rust and Tokio async runtime, offering excellent performance and low latency - Durable Delivery : At-least-once by default via per-stream WAL durability, with optional exactly-once for transactional sinks - Multiple Data Sources : Support for Kafka, MQTT, HTTP, files, SQL databases, and many other input/output sources - Powerful Processing : Built-in SQL queries, Python UDFs, JSON processing, Protobuf encoding/decoding, batch processing, and VRL - Streaming Codecs : JSON and Protobuf codecs, plus Debezium CDC envelopes and Confluent Schema Registry wire-format - Control Plane : An optional Hub and web console to observe, configure, and operate multiple ArkFlow compute nodes as a fleet - Extensible : Modular design, easy to extend with new input, buffer, output, and processor components Installation Building from Source Quick Start 1. Create a configuration file config.yaml : 2. Run ArkFlow: Configuration Guide ArkFlow uses YAML ","default_branch":null,"files":null,"tree":[],"storefront":"/r/arkflow-rs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/arkflow-rs/arkflow/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}