Ornith-1.5-35B-A3B-NInfer - 250 tok/s, 5-8k prefill, 5090
英文标题:Ornith-1.5-35B-A3B-NInfer - 250 tok/s, 5-8k prefill, 5090
I tried this model yesterday, and it felt to me like the best one I've tried for a local model for interactive use; the responses and reasoning are very fast, and it actually performs agentic tasks well. The speed is phenomenal. I am running this on Ninfer for Windows - https://github.com/natp
打开原文相关 5 · 机会 2
中文
I tried this model yesterday, and it felt to me like the best one I've tried for a local model for interactive use; the responses and reasoning are very fast, and it actually performs agentic tasks well. The speed is phenomenal. I am running this on Ninfer for Windows - https://github.com/natp
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
I tried this model yesterday, and it felt to me like the best one I've tried for a local model for interactive use; the responses and reasoning are very fast, and it actually performs agentic tasks well. The speed is phenomenal. I am running this on Ninfer for Windows - https://github.com/natp