{"repo":"volga-project/volga","free":true,"listed":false,"github":"https://github.com/volga-project/volga","clone":"git clone https://github.com/volga-project/volga.git","description":"Real-time data processing/feature engineering tailored for modern AI/ML systems.","language":"Rust","stars":158,"topics":["ai","data","feature-engineering","feature-extraction","ml","real-time","stream-processing","streaming","rust","sql"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Volga - Real-time data processing for modern AI/ML systems Volga is a data processing engine aiming to be an alternative to general streaming engines like Flink and Spark as well as AI/ML oriented systems like Chronon and OpenMLDB. It is built in Rust using Apache DataFusion and Apache Arrow. 🤯 What and why Modern AI/ML systems (recsys, fraud detection, personalization, search, RAG) rely on features computed from real-time/historical event streams: - Long continiously sliding window aggregations ( 1h , 7d , 30d , 1y ) - Point-in-time correct data for batch and inference - Consistent online + offline pipeline definitions and computation semantics - Real-time asynchronous data serving Today this typically requires combining multiple systems: - Streaming engine (Flink/Spark) - Storage (Redis/S3) - Serving layer - Feature platforms (Chronon, OpenMLDB, etc.) Volga replaces this with a single engine : - Streaming = write path - Request = read path - Batch = training Check the blog , join Slack . 📊 System Comparison System Execution Model Storage/State Pipeline Definitions Window Agg Optimization Serving ----------------- --------------------------------------------------- -------------------------------- ---------------------------------------------- --------------------------------- ---------------------------------------------- Volga native (streaming / batch / request); Rust native remote (S3 + SlateDB) + local cache SQL + ML funcs ( top , cate , etc.) ✅ tiling (native in-stat","default_branch":null,"files":null,"tree":[],"storefront":"/r/volga-project","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/volga-project/volga/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}