Expand description
Moirai-2.0-R-small inference engine.
Architecture: causal transformer decoder with ResidualBlock in/out projections, partial interleaved RoPE (first 32 of 64 head dims), BinaryAttentionBias, PackedStdScaler normalization, and multi-token (4 patches/token) decoding loop.