{"repo":"ulyssestenn/omt","free":true,"listed":false,"github":"https://github.com/ulyssestenn/omt","clone":"git clone https://github.com/ulyssestenn/omt.git","description":"Ollama Model Test - Figure out the best model for the task","language":"Python","stars":51,"topics":["ai-tools","cli","llm","local-ai","local-llm","model-evaluation","ollama","prompt-testing","python"],"license":"MIT","category":"cli-tools","readme_excerpt":"Ollama Model Tester A small, dependency-free CLI for running the same prompt against your local Ollama models and saving every response to disk — so you can compare models (or compare repeated runs of one model) side by side. It uses only the Python standard library: no pip install required. Requirements - Python 3.7 or newer - Ollama running locally (the default http://localhost:11434 ) - At least one model pulled, e.g. ollama pull llama3.1:8b Quick start Make sure Ollama is running, then: You'll be asked, in order: 1. Which model to use (pick a number from your installed models) 2. The prompt — type as many lines as you like, then put /done on its own line to finish 3. How many times to run the prompt 4. Temperature ( 0.0 – 2.0 ), or press Enter to use Ollama's default 5. Whether to stream the responses live to the terminal It then runs the prompt the requested number of times and writes the results under ollama-runs/ . Command-line flags (optional) Every prompt above can be supplied up front, which makes the tool scriptable. Anything you omit is still asked interactively. Flag Description --- --- --model NAME Local model to use (must already be installed) --runs N Number of generations to run --temperature T Temperature, 0.0 – 2.0 --prompt-file PATH Read the prompt from a UTF-8 text file --stream / --no-stream Stream responses live, or don't Example — run a saved prompt three times, fully non-interactive: Output Results are grouped into one folder per prompt: The folder na","default_branch":null,"files":null,"tree":[],"storefront":"/r/ulyssestenn","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ulyssestenn/omt/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}