Stability, Stability, Stability (and bug-fixes)

• Higher numerical stability in Newton-Schulz orthogonalization (affects: Muon)
• Higher accuracy in SVD computation (affects: PSGD)
• Advanced checkpointing (affects: old checkpoints, SOAP and PSGD)
• Reworked chainable backend, allowing more freedom in function composition (affects: custom optimizers)

For the full release notes and migration instructions, see here

---

• Benchmark
  • extended to real-world tasks (#76 & #75, by @tom-jod)
  • improve hyperparam tuning; include the newly required depencies in the requirements (#70, by @MirzaSamad20)
  • fixed dependencies and configurations (#60, by @tom-jod)
• Optimizers
  • AdamC implemented (#65, by @Ryu1845 & #77, by @drexalt)
  • Fixed all clipping algorithms with non-default clipping thresholds, add clipping tests (#73 & #74, by @alexjwilliams)
  • More accurate NS5 iterations, backporting Muon research (#69, by @xTimeCrystal)