{"repo":"ParaGroup/WindFlow","free":true,"listed":false,"github":"https://github.com/ParaGroup/WindFlow","clone":"git clone https://github.com/ParaGroup/WindFlow.git","description":"A C++ Data Stream Processing Parallel Library for Multicores and GPUs","language":"C++","stars":88,"topics":["stream","streaming","stream-processing","streams","streaming-data","streaming-api","stream-api","parallel-patterns","parallel-computing","parallel-programming"],"license":"LGPL-3.0","category":"data-pipelines","readme_excerpt":"Introduction WindFlow is a C++17 header-only library designed for parallel data stream processing on heterogeneous shared-memory architectures that combine multi-core CPUs and NVIDIA GPUs. The library offers traditional stream processing operators such as map , flatmap , filter , and reduce , as well as window-based operators. Its API enables developers to build streaming applications using the MultiPipe and PipeGraph programming constructs. The former facilitates the creation of parallel pipelines with shuffle connections, while the latter allows multiple MultiPipe instances to be interconnected through merge and split operations, enabling the construction of complex directed acyclic graphs of interconnected operators. Analogous to popular stream processing engines such as Apache Storm and Apache Flink, WindFlow supports general-purpose streaming applications by allowing operators to execute user-defined code. The WindFlow runtime system is designed to efficiently operate on embedded architectures featuring low-power multi-core CPUs and integrated NVIDIA GPUs (such as the Jetson family of NVIDIA boards). Nevertheless, it also performs effectively on conventional multi-core servers equipped with discrete NVIDIA GPUs. At the moment, WindFlow supports single-node execution. We are currently working on a distributed implementation. The web site of the library is available at: https://paragroup.github.io/WindFlow/. Dependencies The library requires the following dependencies: a C","default_branch":null,"files":null,"tree":[],"storefront":"/r/ParaGroup","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ParaGroup/WindFlow/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}