community Reddit LocalLLaMA 2026-08-07T21:25 正文 thin 0 words

Qwen 3.6 27B flags/settings in llama.cpp

英文标题:Qwen 3.6 27B flags/settings in llama.cpp

I run the following on a 5090 and have been okay with its performance, it does most things somewhere 80-100 t/s, though that can slow down at full 262k context - more like 40 t/s at times. I use it primarily in appdev tasks. This just barely fits in the 5090, no vision, with very very little room to
打开原文相关 2 · 机会 0

中文

I run the following on a 5090 and have been okay with its performance, it does most things somewhere 80-100 t/s, though that can slow down at full 262k context - more like 40 t/s at times. I use it primarily in appdev tasks. This just barely fits in the 5090, no vision, with very very little room to

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

I run the following on a 5090 and have been okay with its performance, it does most things somewhere 80-100 t/s, though that can slow down at full 262k context - more like 40 t/s at times. I use it primarily in appdev tasks. This just barely fits in the 5090, no vision, with very very little room to