{"repo":"dezoito/ollama-grid-search","free":true,"listed":false,"github":"https://github.com/dezoito/ollama-grid-search","clone":"git clone https://github.com/dezoito/ollama-grid-search.git","description":"A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.","language":"TypeScript","stars":951,"topics":["ai","gridsearch","llm","ollama","rust","ab-testing","testing-tools","grid-search"],"license":"MIT","category":"ai-agents","readme_excerpt":"Ollama Grid Search: Instantly Evaluate Multiple LLMs and Prompts. This project automates the process of selecting the best models, prompts, or inference parameters for a given use-case, allowing you to iterate over their combinations and to visually inspect the results. It assumes Ollama is installed and serving endpoints, either in localhost or in a remote server. Here's what an experiment for a simple prompt, tested on 3 different models, looks like: Dowloads: · macOS · Windows · Linux · All Releases (For a more in-depth look at an evaluation process assisted by this tool, please check https://dezoito.github.io/2023/12/27/rust-ollama-grid-search.html). Table of Contents - Installation - Features - Grid Search Concept - A/B Testing - Prompt Archive - Experiment Logs - Future Features - Contributing - Development - Citations - Acknowledgements Installation Check the releases page for the project, or on the sidebar. macOS Installation (Apple Silicon) For Apple Silicon (M1/M2/M3/M4) Macs, the application uses ad-hoc code signing (a free alternative to paid Apple Developer certificates). When first launching the app: 1. Download the .dmg file for your architecture (aarch64 for Apple Silicon) 2. Open the DMG and drag the app to Applications 3. Right-click (or Control+click) the application and select \"Open\" 4. Click \"Open\" in the security dialog that appears 5. The app will now launch normally (subsequent launches can use double-click) This is necessary because the app is not not","default_branch":null,"files":null,"tree":[],"storefront":"/r/dezoito","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/dezoito/ollama-grid-search/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}