{"repo":"capillariesio/capillaries","free":true,"listed":false,"github":"https://github.com/capillariesio/capillaries","clone":"git clone https://github.com/capillariesio/capillaries.git","description":"Distributed batch data processing framework","language":"Go","stars":73,"topics":["cassandra","rabbitmq","go","batch-processing","dag","distributed-computing","distributed-systems","golang","workflow-engine","workflows"],"license":"MIT","category":"workflow-automation","readme_excerpt":"Capillaries Capillaries is a data processing framework that: - addresses scalability issues and manages intermediate data storage, enabling users to focus on data transforms and quality control; - bridges the gap between distributed, scalable data processing/integration solutions and the necessity to produce enriched, customer-ready, production-quality, human-curated data within SLA time limits. This is a GitHub readme. More details and a blog at https://capillaries.io. Why Capillaries? BEFORE AFTER ----------- ------ ------ Cloud-friendly Depends Can be deployed to the cloud within minutes; Docker-ready Data aggregation SQL joins Capillaries lookups in Cassandra + Go expressions (scalability, parallel execution) Data filtering SQL queries, custom code Go expressions (scalability, maintainability) Data transform SQL expressions, custom code Go expressions, Python formulas (parallel execution, maintainability) Intermediate data storage Files, relational databases on-the-fly-created Cassandra keyspaces and tables (scalability, maintainability) Workflow execution Shell scripts, custom code, workflow frameworks Message queue as scheduler, workflow status stored in Cassandra (parallel execution, fault tolerance, incremental computing) Workflow monitoring and interaction Custom solutions Capillaries UI, Toolbelt utility, API, Web API (transparency, operator validation support) Workflow management Shell scripts, custom code Capillaries configuration: script file with DAG, Python for","default_branch":null,"files":null,"tree":[],"storefront":"/r/capillariesio","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/capillariesio/capillaries/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}