{"repo":"kaito-project/aikit","free":true,"listed":false,"github":"https://github.com/kaito-project/aikit","clone":"git clone https://github.com/kaito-project/aikit.git","description":"🏗️ Fine-tune, build, and deploy open-source LLMs easily!","language":"Go","stars":535,"topics":["buildkit","large-language-models","llm","docker","inference","kubernetes","nvidia","ai","llama","chatgpt"],"license":"MIT","category":"deployment-docker-iac","readme_excerpt":"AIKit ✨ AIKit is a comprehensive platform to quickly get started to host, deploy, build and fine-tune large language models (LLMs). AIKit offers three main capabilities: - Inference : AIKit uses LocalAI, which supports a wide range of inference capabilities and formats. LocalAI provides a drop-in replacement REST API that is OpenAI API compatible, so you can use any OpenAI API compatible client, such as Kubectl AI, Chatbot-UI and many more, to send requests to open LLMs! - Fine-Tuning : AIKit offers an extensible fine-tuning interface. It supports Unsloth for fast, memory efficient, and easy fine-tuning experience. - OCI Packaging : Package models as OCI artifacts for distribution through any OCI-compliant registry. Supports CNCF ModelPack specification and generic artifact packaging. 👉 For full documentation, please see AIKit website! Features - 🐳 No GPU, Internet access or additional tools needed except for Docker or Podman! - 🤏 Minimal image size, resulting in less vulnerabilities and smaller attack surface with a custom chiseled image - 🎵 Fine-tune support - 📦 OCI packaging support for distributing models as OCI artifacts - 🚀 Easy to use declarative configuration for inference and fine-tuning - ✨ OpenAI API compatible to use with any OpenAI API compatible client - 📸 Multi-modal model support - 🖼️ Image generation support - 🦙 Support for GGUF ( llama ) and GGML ( llama-ggml ) models - 🚢 Kubernetes deployment ready - 📚 Supports multiple models with a single image","default_branch":null,"files":null,"tree":[],"storefront":"/r/kaito-project","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/kaito-project/aikit/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}