{"repo":"ProgrammerPeasant/llmtop","free":true,"listed":false,"github":"https://github.com/ProgrammerPeasant/llmtop","clone":"git clone https://github.com/ProgrammerPeasant/llmtop.git","description":"Realtime TUI monitor for local LLM servers (ollama, llama.cpp). The only GPU monitor that knows what model is running and how much each token costs you in energy and dollar-equivalent.","language":"Rust","stars":13,"topics":["gpu","htop","llm","monitoring","nvidia","ollama","rust","tui"],"license":"MIT","category":"ai-agents","readme_excerpt":"llmtop Terminal GPU monitor that links wattage to the LLM burning it. Tells you VRAM share, joules per token, hosted-API equivalent cost, and session energy/CO2. Ollama today. llama.cpp next. $/1K = per-1K output tokens at the hosted-API price. Default: Claude Sonnet. Override with --compare gpt-4o gemini-2.5 . vs nvtop / nvitop / asitop Feature nvtop nvitop asitop llmtop ------------------------- :-----: :----: :--------: :-------------------: GPU util / VRAM / power yes yes yes yes Knows loaded LLM models no no no yes Per-model VRAM share no no no yes Joules per token no no no yes API-equivalent $ cost no no no yes Session kWh + CO2 no no no yes Cross-platform partial partial macOS only Linux + Win + macOS\\ \\ Apple Silicon: v0.2. Install Usage Hotkeys: q:quit p:pause c:clear . Live tokens/sec Ollama does not expose live throughput on /api/ps . llmtop runs a reverse proxy by default on :11435 , forwards every request to upstream Ollama unchanged, and reads eval count / eval duration from the responses. Point your client at the proxy: Direct traffic to :11434 is invisible — TOK/S and J/TOK stay idle unless requests pass through the proxy. What's measured Metric Source ------------------------------ --------------------------------------------------- GPU util / VRAM / power / temp NVML (Linux, Windows). IOReport (macOS) in v0.2. Multi-GPU Aggregated (sum power/VRAM, avg util) in v0.1. Loaded models, per-model VRAM Ollama /api/ps Tokens/sec live Reverse proxy parses eval count ","default_branch":null,"files":null,"tree":[],"storefront":"/r/ProgrammerPeasant","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ProgrammerPeasant/llmtop/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}