{"repo":"mathsaey/skitter","free":true,"listed":false,"github":"https://github.com/mathsaey/skitter","clone":"git clone https://github.com/mathsaey/skitter.git","description":"A distributed stream processing framework with support for pluggable distribution strategies","language":"Elixir","stars":26,"topics":["elixir","distributed","big-data","stream-processing"],"license":"MPL-2.0","category":"data-pipelines","readme_excerpt":"[Homepage ] [Documentation ] A domain specific language for building scalable, distributed stream processing applications with custom distribution strategies. Built in the context of my PhD at the Software Languages Lab. Skitter Skitter is a distributed stream processing system: it makes it possible to define data processing pipelines by combining data processing steps called operations into a workflow . A key difference between Skitter and other related technologies is the notion of distribution strategies . An operation in a Skitter workflow is paired with a strategy which defines how the operation is distributed over a cluster at runtime. This enables developers to select the appropriate distribution strategy for each operation. Developers can use any of the strategies provided by Skitter or decide to build their own strategies. Strategies can be implemented from scratch or by extending existing strategies. More information about Skitter can be found at: https://soft.vub.ac.be/ mathsaey/skitter. Publications and previous versions We published about Skitter at the following venues: - Skitter: A DSL for Distributed Reactive Workflows (REBLS, November 2018) Note that the version of Skitter discussed in this paper differs significantly from the current version. Information on using this earlier version of Skitter can be found here. - Skitter: A Distributed Stream Processing Framework with Pluggable Distribution Strategies (The Art, Science, and Engineering of Programming, Febr","default_branch":null,"files":null,"tree":[],"storefront":"/r/mathsaey","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mathsaey/skitter/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}