community Reddit LocalLLaMA 2026-07-13T12:36 正文 thin 0 words

Production Qwen 3.6-27B VLLM config?

英文标题:Production Qwen 3.6-27B VLLM config?

UPDATE: If you are running Qwen3.6 27b or 35b with prefix caching and spec decode, you will run into corruption problems! Take a look at https://github.com/vllm-project/vllm/pull/48375; the patch there has resolved my problems on quality decrease. Thanks to /u/buttplugs4life4me for discovering the p
打开原文相关 2 · 机会 2

中文

UPDATE: If you are running Qwen3.6 27b or 35b with prefix caching and spec decode, you will run into corruption problems! Take a look at https://github.com/vllm-project/vllm/pull/48375; the patch there has resolved my problems on quality decrease. Thanks to /u/buttplugs4life4me for discovering the p

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

UPDATE: If you are running Qwen3.6 27b or 35b with prefix caching and spec decode, you will run into corruption problems! Take a look at https://github.com/vllm-project/vllm/pull/48375; the patch there has resolved my problems on quality decrease. Thanks to /u/buttplugs4life4me for discovering the p