DeepSeek V4 Flash 0731 - Happy Numbers (700pp/18tg) and Thoughts
英文标题：DeepSeek V4 Flash 0731 - Happy Numbers (700pp/18tg) and Thoughts
Originally, I was only getting around 140pp/s and about 21tg/s, but the config with -b 8192 -ub 8192 --cpu-moe is vastly superior, let's say 700pp/s and 18tg/s in the most relevant range. Test System: CPU: Threadripper 5965WX (24c/48t) RAM: 512GB (8x64 DDR4 ECC REG 2400) GPU: RTX 5090 (PCIe 4 x16,
打开原文相关 2 · 机会 0
中文
Originally, I was only getting around 140pp/s and about 21tg/s, but the config with -b 8192 -ub 8192 --cpu-moe is vastly superior, let's say 700pp/s and 18tg/s in the most relevant range. Test System: CPU: Threadripper 5965WX (24c/48t) RAM: 512GB (8x64 DDR4 ECC REG 2400) GPU: RTX 5090 (PCIe 4 x16,
中文全文翻译正在补齐，可先查看下方英文原文。
English / 原文
Originally, I was only getting around 140pp/s and about 21tg/s, but the config with -b 8192 -ub 8192 --cpu-moe is vastly superior, let's say 700pp/s and 18tg/s in the most relevant range. Test System: CPU: Threadripper 5965WX (24c/48t) RAM: 512GB (8x64 DDR4 ECC REG 2400) GPU: RTX 5090 (PCIe 4 x16,