{"repo":"uber/kraken","free":true,"listed":false,"github":"https://github.com/uber/kraken","clone":"git clone https://github.com/uber/kraken.git","description":"P2P Docker registry capable of distributing TBs of data in seconds","language":"Go","stars":6734,"topics":["docker","docker-registry","container","docker-image","p2p","bittorrent","containerd"],"license":"Apache-2.0","category":"deployment-docker-iac","readme_excerpt":"Kraken is a P2P-powered Docker registry that focuses on scalability and availability. It is designed for Docker image management, replication, and distribution in a hybrid cloud environment. With pluggable backend support, Kraken can easily integrate into existing Docker registry setups as the distribution layer. Kraken has been in production at Uber since early 2018. In our busiest cluster, Kraken distributes more than 1 million blobs per day, including 100k 1G+ blobs. At its peak production load, Kraken distributes 20K 100MB-1G blobs in under 30 sec. Below is the visualization of a small Kraken cluster at work: Table of Contents - Features - Design - Architecture - Benchmark - Usage - Comparison With Other Projects - Limitations - Contributing - Contact Features Following are some highlights of Kraken: - Highly scalable . Kraken is capable of distributing Docker images at 50% of the max download speed limit on every host. Cluster size and image size do not have a significant impact on download speed. - Supports at least 15k hosts per cluster. - Supports arbitrarily large blobs/layers. We normally limit max size to 20G for the best performance. - Highly available . No component is a single point of failure. - Secure . Support uploader authentication and data integrity protection through TLS. - Pluggable storage options . Instead of managing data, Kraken plugs into reliable blob storage options, like S3, GCS, ECR, HDFS or another registry. The storage interface is simple and ","default_branch":null,"files":null,"tree":[],"storefront":"/r/uber","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/uber/kraken/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}