{"repo":"superlinked/sie","free":true,"listed":false,"github":"https://github.com/superlinked/sie","clone":"git clone https://github.com/superlinked/sie.git","description":"Open-source inference server and production cluster for all the models your agent needs.","language":"Python","stars":2793,"topics":["embeddings","vector-search","data-pipeline","deep-learning","information-retrieval","llm","ml","mlops","natural-language-processing","nlp"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"SIE: Superlinked Inference Engine Self-hosted inference for agents. Every open model your agents call, served from one cluster in your cloud. Docs Quickstart API Reference Models ⭐ Help us reach more developers and grow the SIE community. Star this repo! About SIE is an open-source inference engine that runs the models behind every agent task through one API: search and retrieval, document-to-markdown conversion, structured output, content safety, and the agent loop itself. It replaces the patchwork of a separate model server per task with one system that serves 100+ models, loading each on demand. - OpenAI-compatible API for drop-in migration: /v1/embeddings , /v1/chat/completions , /v1/completions , /v1/responses - Pre-configured model catalog: Stella, SPLADE, Qwen3, GLiNER, SigLIP, and more; embedding and retrieval models benchmarked on MTEB - Serves multiple models simultaneously with on-demand loading and LRU eviction - Ships the full production stack: load-balancing gateway, KEDA autoscaling, Grafana dashboards, Terraform for GKE, EKS, and AKS - Integrates with LangChain, LlamaIndex, Haystack, DSPy, CrewAI, Chroma, Qdrant, Weaviate, and LanceDB Development The repository root is a virtual Python workspace. From the repository root, install and verify every workspace member with the committed lock (the audio-prep member requires its documented native build prerequisites): Package membership is explicit in the root pyproject.toml ; a package joins the workspace only in th","default_branch":null,"files":null,"tree":[],"storefront":"/r/superlinked","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/superlinked/sie/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}