Qwen-Next seems worse to me then 3.8 27b for coding, but I feel like I must be missing something?
英文标题:Qwen-Next seems worse to me then 3.8 27b for coding, but I feel like I must be missing something?
Hi! I run both models on MTPLX on my m5 max, and since I have 128GB of ram I run the q8 27b. I think MTPLX only lets me run "optimized for speed" which it says is a dynamic q4 with 8 bit attention. Both of them honestly are very speedy! For coding (in pi agent in nodejs) I've just noticed that 27B
打开原文相关 5 · 机会 1
中文
Hi! I run both models on MTPLX on my m5 max, and since I have 128GB of ram I run the q8 27b. I think MTPLX only lets me run "optimized for speed" which it says is a dynamic q4 with 8 bit attention. Both of them honestly are very speedy! For coding (in pi agent in nodejs) I've just noticed that 27B
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
Hi! I run both models on MTPLX on my m5 max, and since I have 128GB of ram I run the q8 27b. I think MTPLX only lets me run "optimized for speed" which it says is a dynamic q4 with 8 bit attention. Both of them honestly are very speedy! For coding (in pi agent in nodejs) I've just noticed that 27B