Muon varying width experiment

watermark_weight_width.ipynb

Transformer experiment

watermark_transformer.ipynb

Reference

Code based on https://github.com/zhangfaen/effect-of-the-initial-configuration-of-weights.