MIT LLM Serve Dashboard I am making open source
英文标题:MIT LLM Serve Dashboard I am making open source
A single-file, dependency-free live dashboard for your local LLM serving box — GPU utilization, per-model throughput, KV/context fill, and system stats for llama.cpp and vLLM, in one green terminal-styled page. No framework, no build step, no external requests. The frontend is one index.html (
打开原文相关 3 · 机会 4
中文
A single-file, dependency-free live dashboard for your local LLM serving box — GPU utilization, per-model throughput, KV/context fill, and system stats for llama.cpp and vLLM, in one green terminal-styled page. No framework, no build step, no external requests. The frontend is one index.html (
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
A single-file, dependency-free live dashboard for your local LLM serving box — GPU utilization, per-model throughput, KV/context fill, and system stats for llama.cpp and vLLM, in one green terminal-styled page. No framework, no build step, no external requests. The frontend is one index.html (