Functionsยง
- apply_
interleaved_ rope - Apply interleaved (paired) rotary embeddings in place on host data.
- apply_
llama_ rope - Llama-style rotary embedding apply on
[b, heads, seq, head_dim]with prebuilt[max_seq, head_dim]cos/sin tables (positionsstart..). - build_
rope_ tables - Build cos/sin tables from explicit
inv_freq([half]). - rope_
tables - Build Llama-style RoPE cos/sin tables for positions
[0, max_seq).