{"repo":"vtuber-plan/olah","free":true,"listed":false,"github":"https://github.com/vtuber-plan/olah","clone":"git clone https://github.com/vtuber-plan/olah.git","description":"Self-hosted huggingface mirror service. 自建huggingface镜像服务。","language":"Python","stars":251,"topics":["datasets","huggingface","llm","self-hosting","mirror","mirror-server"],"license":"MIT","category":"self-hosted-apps","readme_excerpt":"Olah Self-hosted Lightweight Huggingface Mirror Service Olah is a self-hosted lightweight huggingface mirror service. Olah means hello in Hilichurlian. Olah implemented the mirroring feature for huggingface resources, rather than just a simple reverse proxy . Olah does not immediately mirror the entire huggingface website but mirrors the resources at the file block level when users download them (or we can say cache them). Other languages: 中文 Advantages of Olah Olah has the capability to cache files in chunks while users download them. Upon subsequent downloads, the files can be directly retrieved from the cache, greatly enhancing download speeds and saving bandwidth. Additionally, Olah offers a range of cache control policies. Administrators can configure which repositories are accessible and which ones can be cached through a configuration file. Features Huggingface Data Cache Models mirror Datasets mirror Spaces mirror Install Method 1: With pip or: Method 2: From source 1. Clone this repository 2. Install the Package Quick Start Run the command in the console: Then set the Environment Variable HF ENDPOINT to the mirror site (Here is http://localhost:8090). Linux: Windows Powershell: Starting from now on, all download operations in the HuggingFace library will be proxied through this mirror site. Or you can download models and datasets by using huggingface cli. Download GPT2: Download WikiText: You can check the path ./repos , in which olah stores all cached datasets and m","default_branch":null,"files":null,"tree":[],"storefront":"/r/vtuber-plan","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/vtuber-plan/olah/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}