{"repo":"SeldonIO/seldon-core","free":true,"listed":false,"github":"https://github.com/SeldonIO/seldon-core","clone":"git clone https://github.com/SeldonIO/seldon-core.git","description":"An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models","language":"Go","stars":4772,"topics":["kubernetes","machine-learning","deployment","serving","mlops","aiops","machine-learning-operations","production-machine-learning"],"license":null,"category":"deployment-docker-iac","readme_excerpt":"Deploy Modular, Data-centric AI applications at scale 💡 About Seldon Core 2 is an MLOps and LLMOps framework for deploying, managing and scaling AI systems in Kubernetes - from singular models, to modular and data-centric applications. With Core 2 you can deploy in a standardized way across a wide range of model types, on-prem or in any cloud, and production-ready out of the box. To reach out to Seldon regarding commercial use, visit our website. 📚 Documentation The Seldon Core 2 Docs can be found here. For most specific sections, see here: 🔧 Installation &nbsp • &nbsp ⛽ Servers &nbsp • &nbsp 🤖 Models &nbsp • &nbsp 🔗 Pipelines &nbsp • &nbsp 🧑‍🔬 Experiments &nbsp • &nbsp 📊 Performance Tuning 🧩 Features Pipelines : Deploy composable AI applications, leveraging Kafka for realtime data streaming between components Autoscaling for models and application components based on native or custom logic Multi-Model Serving : Save infrastructure costs by consolidating multiple models on shared inference servers Overcommit : Deploy more models than available memory allows, saving infrastructure costs for unused models Experiments : Route data between candidate models or pipelines, with support for A/B tests and shadow deployments Custom Components : Implement custom logic, drift & outlier detection, LLMs and more through plug-and-play integrate with the rest of Seldon's ecosytem of ML/AI products! 🔬 Research These features are influenced by our position paper on the next generatio","default_branch":null,"files":null,"tree":[],"storefront":"/r/SeldonIO","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/SeldonIO/seldon-core/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}