{"repo":"kubernetes-sigs/usage-metrics-collector","free":true,"listed":false,"github":"https://github.com/kubernetes-sigs/usage-metrics-collector","clone":"git clone https://github.com/kubernetes-sigs/usage-metrics-collector.git","description":"High fidelity and scalable capacity and usage metrics for Kubernetes clusters","language":"Go","stars":137,"topics":["kubernetes","metrics","capacity","prometheus-exporter","utilization"],"license":"Apache-2.0","category":"analytics","readme_excerpt":"Usage Metrics Collector The usage-metrics-collector is a Prometheus metrics collector optimized for collecting kube usage and capacity metrics. Motivation Why not just use promql and recording rules? - Scale - Aggregate at collection time to reduce prometheus work - Export aggregated metrics without the raw metrics to reduce prometheus storage - Insight - Join labels at collection time (e.g. set the priority class on pod metrics) - Set hard to resolve labels (e.g. set the workload kind on pod metrics) - View node-level cgroup utilization (e.g. kubepods vs system.slice metrics) - Fidelity - Scrape utilization at 1s intervals as raw metrics - Perform aggregations on the 1s interval metrics (e.g. get the p95 1s utilization sample for all replicas of a workload) Example collector.yaml Architecture considerations - Metrics must be highly configurable - The metrics labels derived from objects - The aggregations (sum, average, median, max, p95, histograms, etc) must be configurable - Metrics should be able to be pushed to additional sources such as cloud storage buckets, BigQuery, etc - Metric computation must scale to large clusters with lots of churn. - Run aggregations in parallel - Re-use previous results as much as possible - Scrapes should always immediately get a result, even when complex aggregations in large clusters take minutes to compute. - Utilization metrics should not be published until the data is present from a sufficient number of nodes. This is to prevent showing ","default_branch":null,"files":null,"tree":[],"storefront":"/r/kubernetes-sigs","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/kubernetes-sigs/usage-metrics-collector/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}