Raschka reports MiMo-V2.6 ranks first in open-weight benchmarks
1Sep 22 9:46 AM · 3d ago · 2 posts · 1 source · development 1 of 1
Sebastian Raschka announced that MiMo-V2.6 has achieved the top position in open-weight language model benchmarks by weighted average score. He noted the model uses a simple architecture based on Grouped Query Attention with Sliding Window Attention operating at a 128-token window.
x.com
“MiMo-V2.6 is "simply" the best (for now). Despite its simple architecture design it's currently No.1 in the open-weight benchmarks (weighted average).”
MiMo-V2.6 is "simply" the best (for now). Despite its simple architecture design it's currently No.1 in the open-weight benchmarks (weighted average). With "simple," I mean a classic Grouped Query Attention (GQA) with Sliding Window Attention (SWA) at a tiny 128-token window