2 x 5070ti Qwen 27B full config / stats
英文标题：2 x 5070ti Qwen 27B full config / stats
Following up on yesterday's post about running everyone's faves on 2 x 16gb cards while maximizing performance and KV. Previous post data used abandoned Cu130 VLLM image. Stats here are done on cu129-nightly. Which has the KV cache connector fixes and performance improvements. Highlights - 2 c
打开原文相关 2 · 机会 0
中文
Following up on yesterday's post about running everyone's faves on 2 x 16gb cards while maximizing performance and KV. Previous post data used abandoned Cu130 VLLM image. Stats here are done on cu129-nightly. Which has the KV cache connector fixes and performance improvements. Highlights - 2 c
中文全文翻译正在补齐，可先查看下方英文原文。
English / 原文
Following up on yesterday's post about running everyone's faves on 2 x 16gb cards while maximizing performance and KV. Previous post data used abandoned Cu130 VLLM image. Stats here are done on cu129-nightly. Which has the KV cache connector fixes and performance improvements. Highlights - 2 c