Repository navigation
loraspectra: Zero-dependency Rust CLI to audit spectral rank, prune noise singular values, and orthogonally merge SFT/DPO/GRPO LoRA .safetensors #8257
SalyyS1
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Hi everyone,
When running SFT, DPO, GRPO, or RLOO with LoRA / QLoRA / DoRA in TRL, it is often useful to inspect the trained
adapter_model.safetensorscheckpoint right after training (or across checkpoints) without spinning up a GPU:DEAD_LAYERwhereR_EFF < 1.5)?K_99%) and Marchenko-Pastur noise-floor rank (K_MP) of each projection layer?We built loraspectra, a zero-dependency Rust CLI that runs exact$O(r^3)$ QR-projected SVD directly on
.safetensorsfiles in ~2 milliseconds on CPU.Quick Commands
Repository: https://github.com/SalyyS1/loraspectra
If
loraspectrahelps your TRL fine-tuning and RLHF/GRPO workflows, a star on SalyyS1/loraspectra is much appreciated!All reactions