{"repo":"hegelai/prompttools","free":true,"listed":false,"github":"https://github.com/hegelai/prompttools","clone":"git clone https://github.com/hegelai/prompttools.git","description":"Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).","language":"Python","stars":3050,"topics":["deep-learning","large-language-models","machine-learning","prompt-engineering","python","embeddings","llms","vector-search","developer-tools"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"PromptTools :wrench: Test and experiment with prompts, LLMs, and vector databases. :hammer: Welcome to prompttools created by Hegel AI! This repo offers a set of open-source, self-hostable tools for experimenting with, testing, and evaluating LLMs, vector databases, and prompts. The core idea is to enable developers to evaluate using familiar interfaces like code , notebooks , and a local playground . In just a few lines of code, you can test your prompts and parameters across different models (whether you are using OpenAI, Anthropic, or LLaMA models). You can even evaluate the retrieval accuracy of vector databases. To stay in touch with us about issues and future updates, join the Discord. Quickstart To install prompttools , you can use pip : You can run a simple example of a prompttools locally with the following You can also run the notebook in Google Colab Playground If you want to interact with prompttools using our playground interface, you can launch it with the following commands. You can run a simple example of a prompttools locally with the following Then, clone the git repo and launch the streamlit app: You can also access a hosted version of the playground on the Streamlit Community Cloud. Note: The hosted version does not support LlamaCpp Documentation Our documentation website contains the full API reference and more description of individual components. Check it out! Supported Integrations Here is a list of APIs that we support with our experiments: LLMs - Ope","default_branch":null,"files":null,"tree":[],"storefront":"/r/hegelai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/hegelai/prompttools/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}