Skip to content

Version 1.0.0

Choose a tag to compare

View all tags
@heeres heeres released this 31 Jul 18:51
· 232 commits to main since this release
v1.0.0
dba34b6

This release consists of many improvements and introduces several new features:

  • Competitions. The validator now supports multiple competitions, with settings fetched from the coldint/sn29 repo (competitions.json).
  • Include tokenizer with model (in upload and download). Competitions can either have a fixed tokenizer, or load the one included with the model on huggingface.
  • Many constants are now properties of the competition.
  • Loss sum is computed instead of average, although both are displayed in several places. The sum is more meaningful when comparing different tokenizers; this is a first step in exploring that comparison.
  • Internal state reworked. To add competition support and make things somewhat simpler
  • Option to save json output which can be used for a leaderboard (our leaderboard will be included in the codebase soon)
Assets 2
Loading