Qwen 3.6 27B - VLLM Performance Benchmark Results (BF16, FP8, NVFP4)
英文标题：Qwen 3.6 27B - VLLM Performance Benchmark Results (BF16, FP8, NVFP4)
Sharing some testing of Qwen 3.6 27B using VLLM across the popular quants on my development system. I used llama benchy to generate the results, then fed it into an LLM to format it the tables for readibility. While NVFP4 is blazing fast, have had looping issues in copilot that I don't get with BF16
打开原文相关 8 · 机会 1
中文
Sharing some testing of Qwen 3.6 27B using VLLM across the popular quants on my development system. I used llama benchy to generate the results, then fed it into an LLM to format it the tables for readibility. While NVFP4 is blazing fast, have had looping issues in copilot that I don't get with BF16
中文全文翻译正在补齐，可先查看下方英文原文。
English / 原文
Sharing some testing of Qwen 3.6 27B using VLLM across the popular quants on my development system. I used llama benchy to generate the results, then fed it into an LLM to format it the tables for readibility. While NVFP4 is blazing fast, have had looping issues in copilot that I don't get with BF16