https://discord.com/channels/@me/947889822754832484/999769323419750500
- pre-training: given a diff, predict the commit (message)
- fine-tuning: code state (at some fixed commit) as input, next-k commits (messages) contrastive
my lack of sleep has given me clarity i can see the matrix