{"repo":"pinterest/orion","free":true,"listed":false,"github":"https://github.com/pinterest/orion","clone":"git clone https://github.com/pinterest/orion.git","description":"Management and automation platform for Stateful Distributed Systems","language":"Java","stars":113,"topics":["kafka","hadoop","cluster-management","hbase"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Orion Orion is a generalized pluggable management and automation platform for stateful distributed systems. Orion provides a unified interface of one or more clusters to both human and machine operators. Orion is capable of efficiently handling thousands of nodes spread across of 10s of clusters. Our intent is to use automation to handle commonly encountered operations issues and build a library of learnings from experiences of various large scale environments like ours. Problem Orion aims to address the following problems: - Lack of single console to manage large clusters of Stateful Distributed Systems : Present open source tooling lacks ability to manage 10s of clusters and 1000s of nodes simultaneously, requiring engineers to switch between multiple consoles and perform manual correlations. - Conflicts between human and automation operations : When automation scripts are implemented they mostly lack the visibility into out of band human operations and vice-a-versa as a single control surface is missing for machine and human operations this has proven to cause catastrophic failures e.g. engineer manually restarts process but automation system thinks that the node is down and replaces it causing stability issues in the cluster. - Missing generalized community learnings on operations : There currently is a lack of a generic unified interface and \"store\" for sharing community learnings for operations of various systems this leads to various companies having to rewrite remedia","default_branch":null,"files":null,"tree":[],"storefront":"/r/pinterest","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/pinterest/orion/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}