{"repo":"Tencent/caelus","free":true,"listed":false,"github":"https://github.com/Tencent/caelus","clone":"git clone https://github.com/Tencent/caelus.git","description":"Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs","language":"Go","stars":365,"topics":["docker","containerd","runtime","hadoop","yarn","kubernetes"],"license":null,"category":"deployment-docker-iac","readme_excerpt":"Caelus Caelus is a set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs, these resources come from the underutilization of online jobs, especially during low traffic periods. To make batch jobs compatible with online jobs, caelus dynamically manages multiple resource isolation mechanisms and also checks abnormalities of various metrics. Batch jobs will be throttled or even killed if interference detected. Features Collect various metrics, including node resources, cgroup resources and online jobs latency Batch jobs could be running on YARN or Kubernetes Predict total resource usages of the node, including online jobs and kernel modules, such as slab Dynamically manage multiple resource isolation mechanisms, such as CPU, memory, and disk space Dynamically check abnormalities of various metrics, such as CPU usage or online jobs latency Throttle or even kill batch jobs when resource pressure or latency spike detected Prometheus metrics supported Alarm supported Usage Find more usage at Tutorial.md. The project also have two attached tools: nm operator nm operator is used to execute YARN commands in the way of remote API. Getting started Build Run The caelus should better run on the node with the kubelet process, and write the kubelet's \"root-dir\" value to \"kubelet root dir\" in config file. The config file and rule file are just the example files, you could add more feature based on different demands. More You could find more about how to st","default_branch":null,"files":null,"tree":[],"storefront":"/r/Tencent","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Tencent/caelus/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}