{"repo":"zilliztech/GPTCache","free":true,"listed":false,"github":"https://github.com/zilliztech/GPTCache","clone":"git clone https://github.com/zilliztech/GPTCache.git","description":"Semantic cache for LLMs. Fully integrated with LangChain and llama_index.","language":"Python","stars":8160,"topics":["chatbot","chatgpt","chatgpt-api","llm","milvus","similarity-search","vector-search","aigc","openai","memcache"],"license":"MIT","category":"ai-agents","readme_excerpt":"GPTCache : A Library for Creating Semantic Cache for LLM Queries Slash Your LLM API Costs by 10x 💰, Boost Speed by 100x ⚡ 🎉 GPTCache has been fully integrated with 🦜️🔗LangChain ! Here are detailed usage instructions. 🐳 The GPTCache server docker image has been released, which means that any language will be able to use GPTCache! 📔 This project is undergoing swift development, and as such, the API may be subject to change at any time. For the most up-to-date information, please refer to the latest documentation and release note. NOTE: As the number of large models is growing explosively and their API shape is constantly evolving, we no longer add support for new API or models. We encourage the usage of using the get and set API in gptcache, here is the demo code: https://github.com/zilliztech/GPTCache/blob/main/examples/adapter/api.py Quick Install pip install gptcache 🚀 What is GPTCache? ChatGPT and various large language models (LLMs) boast incredible versatility, enabling the development of a wide range of applications. However, as your application grows in popularity and encounters higher traffic levels, the expenses related to LLM API calls can become substantial. Additionally, LLM services might exhibit slow response times, especially when dealing with a significant number of requests. To tackle this challenge, we have created GPTCache, a project dedicated to building a semantic cache for storing LLM responses. 😊 Quick Start Note : - You can quickly try GPTCache ","default_branch":null,"files":null,"tree":[],"storefront":"/r/zilliztech","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/zilliztech/GPTCache/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}