{"repo":"niklasfrick/spark-dashboard","free":true,"listed":false,"github":"https://github.com/niklasfrick/spark-dashboard","clone":"git clone https://github.com/niklasfrick/spark-dashboard.git","description":"Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.","language":"TypeScript","stars":101,"topics":["dashboard","dgx","metrics","nvidia","observability","spark","vllm","ai","ai-monitoring","gpu"],"license":"MIT","category":"analytics","readme_excerpt":"Spark Dashboard Real-time hardware and LLM inference monitoring for Linux systems with NVIDIA GPUs. Developed and tested on the NVIDIA DGX Spark, but works on any Linux host with NVIDIA drivers — discrete-GPU workstations, DGX boxes, cloud VMs. A Rust backend collects GPU, CPU, memory, disk, and network metrics alongside vLLM engine statistics and streams them over WebSocket to a React frontend. Quick Start Install on your Linux host Run as your normal user on any Linux host with NVIDIA drivers (requires Rust 1.95+): The dashboard is now served on port 3000. See Install on your Linux host for the full guide, config overrides, and uninstall. Run with Docker Prefer containers? Run the published multi-arch image (needs the NVIDIA Container Toolkit): --group-add puts the container in the host's docker group so it can read the mounted socket and discover vLLM containers . Skip it (or get the GID wrong) and engine discovery silently falls back to host processes only — containerized engines won't appear. The named volume keeps saved dashboards across container replacement; without it they die with the container. Or with Compose (host networking + GPU + socket mount preconfigured): See deploy/docker/docker.md for networking modes, GPU passthrough, env vars, and troubleshooting. Develop locally Open http://localhost:5173 in your browser. See dev/README.md for details on what each script does. Features Hardware Monitoring (1s polling via NVML, sysinfo, procfs) - GPU utilization, temper","default_branch":null,"files":null,"tree":[],"storefront":"/r/niklasfrick","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/niklasfrick/spark-dashboard/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}