Skip to main content

Module attn

Module attn 

Source

Functionsยง

burn_attention
Scaled dot-product attention with additive mask. q/k/v: [batch, heads, seq_q/kv, head_dim].