community Reddit LocalLLaMA 2026-10-15T21:45 正文 thin 0 words

Ternary Bonsai 2 Family: 2B, 4B, & 9B based on Qwen 3.5

英文标题:Ternary Bonsai 2 Family: 2B, 4B, & 9B based on Qwen 3.5

Going to try these out to see if they have the same looping behaviors that other Bonsai models have had. Still requires their fork of llama.cpp (branch prism) so dont expect it to work with vanilla llama.cpp. Edit: You can use with regular llama.cpp! Will see if there is some way to support th
打开原文相关 2 · 机会 0

中文

Going to try these out to see if they have the same looping behaviors that other Bonsai models have had. Still requires their fork of llama.cpp (branch prism) so dont expect it to work with vanilla llama.cpp. Edit: You can use with regular llama.cpp! Will see if there is some way to support th

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

Going to try these out to see if they have the same looping behaviors that other Bonsai models have had. Still requires their fork of llama.cpp (branch prism) so dont expect it to work with vanilla llama.cpp. Edit: You can use with regular llama.cpp! Will see if there is some way to support th