{"repo":"samestrin/llm-interface","free":true,"listed":false,"github":"https://github.com/samestrin/llm-interface","clone":"git clone https://github.com/samestrin/llm-interface.git","description":"A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, including OpenAI, Anthropic, Google Gemini, Cohere, Hugging Face Inference, NVIDIA AI, Mistral AI, AI21 Studio, LLaMA.CPP, and Ollama, and hundreds of models.","language":"JavaScript","stars":124,"topics":["ai","anthropic","chatgpt","claude","gemini","groq","llamacpp","llm","openai","reka"],"license":"MIT","category":"ai-agents","readme_excerpt":"llm-interface Introduction LLM Interface is an npm module that streamlines your interactions with various Large Language Model (LLM) providers in your Node.js applications. It offers a unified interface, simplifying the process of switching between providers and their models. The LLM Interface package offers comprehensive support for a wide range of language model providers, encompassing 36 different providers and hundreds of models. This extensive coverage ensures that you have the flexibility to choose the best models suited to your specific needs. Extensive Support for 36 Providers and Hundreds of Models LLM Interface supports: AI21 Studio, AiLAYER, AIMLAPI, Anyscale, Anthropic, Cloudflare AI, Cohere, Corcel, DeepInfra, DeepSeek, Fireworks AI, Forefront AI, FriendliAI, Google Gemini, GooseAI, Groq, Hugging Face Inference, HyperBee AI, Lamini, LLaMA.CPP, Mistral AI, Monster API, Neets.ai, Novita AI, NVIDIA AI, OctoAI, Ollama, OpenAI, Perplexity AI, Reka AI, Replicate, Shuttle AI, TheB.ai, Together AI, Voyage AI, Watsonx AI, Writer, and Zhipu AI . Detailed Provider List Features - Unified Interface : LLMInterface.sendMessage is a single, consistent interface to interact with 36 different LLM APIs (34 hosted LLM providers and 2 local LLM providers). - Chat Completion, Streaming and Embeddings : Supports chat completion, streaming, and embeddings (with failover). - Dynamic Module Loading : Automatically loads and manages LLM interfaces only when they are invoked, minimizing re","default_branch":null,"files":null,"tree":[],"storefront":"/r/samestrin","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/samestrin/llm-interface/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}