Skip to content

Latest commit

History

History
27 lines (16 loc) 路 1.16 KB

lokr.md

File metadata and controls

27 lines (16 loc) 路 1.16 KB

LoKr

Low-Rank Kronecker Product (LoKr), is a LoRA-variant method that approximates the large weight matrix with two low-rank matrices and combines them with the Kronecker product. LoKr also provides an optional third low-rank matrix to provide better control during fine-tuning.

LoKrConfig

[[autodoc]] tuners.lokr.config.LoKrConfig

LoKrModel

[[autodoc]] tuners.lokr.model.LoKrModel