Expand description
Canonical dtype casting for GGUF conversion: {F32, F16, BF16} sources to any
writable GGMLType, including Q8_0 block quantization. Bit-for-bit the same
math as the per-model converters (which predate this crate and keep their own
verified copies).
Enums§
- SrcDtype
- Source dtype of raw checkpoint tensor bytes.
Functions§
- cast_
data - Cast raw little-endian tensor bytes from
srctodst. - decode_
to_ f32 - Decode raw bytes of
srcdtype into f32 values (exact for all three sources). - f16_
to_ f32 - f32_
to_ bytes - f32_
to_ f16_ bits - quantize_
q8_ 0