{"repo":"Quazmoz/InferBridge","free":true,"listed":false,"github":"https://github.com/Quazmoz/InferBridge","clone":"git clone https://github.com/Quazmoz/InferBridge.git","description":"Windows-first OpenAI-compatible local LLM server powered by OpenVINO GenAI for Intel CPU/GPU/NPU, with chat UI, model conversion, and setup scripts.","language":"Python","stars":25,"topics":["ai-inference","intel-npu","llm-server","local-llm","n8n","openai-api","openvino","openwebui","python","windows"],"license":"MIT","category":"workflow-automation","readme_excerpt":"InferBridge Local AI for Intel hardware. Powered by OpenVINO GenAI. InferBridge turns Intel Windows PCs into local AI workstations. It provides a Windows-first, OpenAI-compatible server with streaming chat, local vision chat, text embeddings, model lifecycle and recovery workflows, secure Hugging Face access, context-budget visibility, CPU/GPU/NPU device targeting, System Doctor diagnostics, hardware benchmarking, a built-in browser UI, and a deterministic mock engine. OpenVINO GenAI remains the inference runtime. InferBridge does not replace OpenVINO, claim ownership of it, or imply affiliation with Intel. The project does not require Docker, cloud inference, Electron, or a Node frontend toolchain. Video walkthrough Watch the InferBridge walkthrough Project and release status Current stable release: 0.9.5 . See 0.9.5 for the full record. It brings transactional model preparation, strict converted-artifact validation, working packaged conversion, reliable install-over-existing and uninstall flows, uninterrupted device switching, model preparation recovery, stage-aware preparation watchdogs, secure Hugging Face access, and context-budget visibility to the stable channel. - Windows installer - Portable ZIP - SHA-256 checksums There is no pre-release newer than the current stable release. Versions 0.9.0 through 0.9.3 were published only as betas and are superseded by 0.9.5. Beta builds ship ahead of the next stable release and are marked pre-release on GitHub. Releases from v0.7","default_branch":null,"files":null,"tree":[],"storefront":"/r/Quazmoz","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Quazmoz/InferBridge/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}