DeepSeek v4 Flash on 4090 + DDR5, my experience
英文标题:DeepSeek v4 Flash on 4090 + DDR5, my experience
Disclosure: No AI was used to write this My specs are: RTX 4090 128 GB DDR5 5600 MT/s Intel Core Ultra 7 270k Running nvidia-595 on ubuntu 26.04 with latest llama.cpp build (pulled and rebuilt this morning). Tried a lot of things, ended up running unsloth's UD-Q2_K_XL quant with command: taskset -
打开原文相关 2 · 机会 0
中文
Disclosure: No AI was used to write this My specs are: RTX 4090 128 GB DDR5 5600 MT/s Intel Core Ultra 7 270k Running nvidia-595 on ubuntu 26.04 with latest llama.cpp build (pulled and rebuilt this morning). Tried a lot of things, ended up running unsloth's UD-Q2_K_XL quant with command: taskset -
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
Disclosure: No AI was used to write this My specs are: RTX 4090 128 GB DDR5 5600 MT/s Intel Core Ultra 7 270k Running nvidia-595 on ubuntu 26.04 with latest llama.cpp build (pulled and rebuilt this morning). Tried a lot of things, ended up running unsloth's UD-Q2_K_XL quant with command: taskset -