OpenAI parameter-golf challenge: train the smallest LM that fits in 16MB. My SP8192 frontier submission (openai/parameter-golf#1887): 11L x 512d w/ targeted middle recurrence, MuonEq-R optimizer, int6 GPTQ+SDClip, Brotli-11 compression, legal score-first TTT. 8xH100 DDP.
openai quantization ddp model-compression distributed-training llm gptq h100 language-model-training muon-optimizer
-
Updated
Apr 28, 2026 - Python