Skip to main content

Crate zsfm_lag_llama

Crate zsfm_lag_llama 

Source

Re-exports§

pub use config::LagLlamaConfig;
pub use infer::LagLlamaModel;

Modules§

config
convert
infer
Lag-Llama inference engine with KV caching.
tensor_map