When will we have another breakthrough for faster local dense models?
英文标题：When will we have another breakthrough for faster local dense models?
Most of the speedup are touching along the likes like cutting the active params reletive to total params(MOE) but it does take a hit in stability & reliability compared to a dense-27b can be much more stable at low total params. We hade the innovation of MTP which is great and lots of other things l
打开原文相关 2 · 机会 0
中文
Most of the speedup are touching along the likes like cutting the active params reletive to total params(MOE) but it does take a hit in stability & reliability compared to a dense-27b can be much more stable at low total params. We hade the innovation of MTP which is great and lots of other things l
中文全文翻译正在补齐，可先查看下方英文原文。
English / 原文
Most of the speedup are touching along the likes like cutting the active params reletive to total params(MOE) but it does take a hit in stability & reliability compared to a dense-27b can be much more stable at low total params. We hade the innovation of MTP which is great and lots of other things l