Production Qwen 3.6-27B VLLM config?
英文标题:Production Qwen 3.6-27B VLLM config?
UPDATE: If you are running Qwen3.6 27b or 35b with prefix caching and spec decode, you will run into corruption problems! Take a look at https://github.com/vllm-project/vllm/pull/48375; the patch there has resolved my problems on quality decrease. Thanks to /u/buttplugs4life4me for discovering the p
打开原文相关 2 · 机会 2
中文
UPDATE: If you are running Qwen3.6 27b or 35b with prefix caching and spec decode, you will run into corruption problems! Take a look at https://github.com/vllm-project/vllm/pull/48375; the patch there has resolved my problems on quality decrease. Thanks to /u/buttplugs4life4me for discovering the p
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
UPDATE: If you are running Qwen3.6 27b or 35b with prefix caching and spec decode, you will run into corruption problems! Take a look at https://github.com/vllm-project/vllm/pull/48375; the patch there has resolved my problems on quality decrease. Thanks to /u/buttplugs4life4me for discovering the p