{"repo":"withcatai/node-llama-cpp","free":true,"listed":false,"github":"https://github.com/withcatai/node-llama-cpp","clone":"git clone https://github.com/withcatai/node-llama-cpp.git","description":"Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level","language":"TypeScript","stars":2155,"topics":["ai","bindings","catai","llama","llama-cpp","llm","nodejs","prebuilt-binaries","grammar","gguf"],"license":"MIT","category":"ai-agents","readme_excerpt":"node-llama-cpp Run AI models locally on your machine Pre-built bindings are provided with a fallback to building from source with cmake ✨ Gemma 4 is here! ✨ Features Run LLMs locally on your machine Metal, CUDA and Vulkan support Pre-built binaries are provided, with a fallback to building from source without node-gyp or Python Adapts to your hardware automatically, no need to configure anything A Complete suite of everything you need to use LLMs in your projects Use the CLI to chat with a model without writing any code Up-to-date with the latest llama.cpp . Download and compile the latest release with a single CLI command Enforce a model to generate output in a parseable format, like JSON, or even force it to follow a specific JSON schema Provide a model with functions it can call on demand to retrieve information or perform actions Embedding and reranking support Safe against special token injection attacks Great developer experience with full TypeScript support, and complete documentation Much more Documentation Getting started guide API reference CLI help Blog Changelog Roadmap Try It Without Installing Chat with a model in your terminal using a single command: Installation This package comes with pre-built binaries for macOS, Linux and Windows. If binaries are not available for your platform, it'll fallback to download a release of llama.cpp and build it from source with cmake . To disable this behavior, set the environment variable NODE LLAMA CPP SKIP DOWNLOAD to true .","default_branch":null,"files":null,"tree":[],"storefront":"/r/withcatai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/withcatai/node-llama-cpp/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}