community Reddit LocalLLaMA 2026-07-17T17:14 正文 thin 0 words

DeepSeek v4 Flash on 5090 in llama.cpp with 1 Million context

英文标题:DeepSeek v4 Flash on 5090 in llama.cpp with 1 Million context

After the recent llama.cpp changes, DeepSeek V4 Flash has become much more usable. I ran some benchmarks and wanted to share the results along with the config I used. I'm using DeepSeek-V4-Flash-UD-Q8_K_XL from Unsloth: https://huggingface.co/unsloth/DeepSeek-V4-Flash-GGUF Config: llama-server \ -m
打开原文相关 2 · 机会 0

中文

After the recent llama.cpp changes, DeepSeek V4 Flash has become much more usable. I ran some benchmarks and wanted to share the results along with the config I used. I'm using DeepSeek-V4-Flash-UD-Q8_K_XL from Unsloth: https://huggingface.co/unsloth/DeepSeek-V4-Flash-GGUF Config: llama-server \ -m

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

After the recent llama.cpp changes, DeepSeek V4 Flash has become much more usable. I ran some benchmarks and wanted to share the results along with the config I used. I'm using DeepSeek-V4-Flash-UD-Q8_K_XL from Unsloth: https://huggingface.co/unsloth/DeepSeek-V4-Flash-GGUF Config: llama-server \ -m