#

kldivergence

Here is 1 public repository matching this topic...

BY571 / sft-kl-lora-trainer

Custom trl.SFTTrainer that adds a KL divergence loss between a LoRA-adapted model and its base model.

fine-tuning sft fine-tuning-llm kldivergence lora-adapters

Updated Jul 25, 2025
Python

Improve this page

Add a description, image, and links to the kldivergence topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the kldivergence topic, visit your repo's landing page and select "manage topics."