{"repo":"withcatai/catai","free":true,"listed":false,"github":"https://github.com/withcatai/catai","clone":"git clone https://github.com/withcatai/catai.git","description":"Run AI ✨ assistant locally! with simple API for Node.js 🚀","language":"TypeScript","stars":499,"topics":["chatgpt","ai","dalai","openai","chatbot","chatui","llama-cpp","ai-assistant","vicuna","vicuna-installation-guide"],"license":"MIT","category":"ai-agents","readme_excerpt":"Catai 🚀 Exciting Updates Coming Soon! New UI , Function Calling , and more amazing features are on the way! Stay tuned for updates. Run GGUF models on your computer with a chat ui. Your own AI assistant runs locally on your computer. Inspired by Node-Llama-Cpp, Llama.cpp Installation & Use Make sure you have Node.js ( download current ) installed. Features - Auto detect programming language 🧑‍💻 - Click on user icon to show original message 💬 - Real time text streaming ⏱️ - Fast model downloads 🚀 CLI Install command Cross-platform You can use it on Windows, Linux and Mac. This package uses node-llama-cpp which supports the following platforms: - darwin-x64 - darwin-arm64 - linux-x64 - linux-arm64 - linux-armv7l - linux-ppc64le - win32-x64-msvc Good to know - All download data will be downloaded at /catai folder by default. - The download is multi-threaded, so it may use a lot of bandwidth, but it will download faster! Web API There is also a simple API that you can use to ask the model questions. For more information, please read the API guide Development API You can also use the development API to interact with the model. (For the full list of model, run catai models ) Node-llama-cpp@beta low level integration You can use the model with node-llama-cpp@beta Catai enables you to easily manage the models and chat with them. Configuration You can edit the configuration via the web ui. More information here Contributing Contributions are welcome! Please read our contributing ","default_branch":null,"files":null,"tree":[],"storefront":"/r/withcatai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/withcatai/catai/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}