Expand description
Toto-2 inference engine.
Unit-scaling (μP) inference notes:
uu.Linear→F.linear(x, w, b) / sqrt(fan_in)uu.LinearReadout→F.linear(x, w, b) / fan_inU.silu→F.silu(x) * 1.766782948(unit-scaled)- τ-rule:
residual_splitis identity;residual_add(h,skip,τ)=h*(τ/d) + skip*(1/d)whered=√(1+τ²) PerDimScale(q, w)=q * softplus(w) / log(2)— the 0.52103 unit-scaling factors cancel
Structs§
- Infer
Config - Toto
Model - Toto
Model Builder - Fluent constructor for
TotoModel: point it at a GGUF file, optionally layer on a parsedconfig.jsonand/or explicitInferConfigoverrides, then callbuild.