Skip to content

v0.2.6

Choose a tag to compare

@gopaljigaur gopaljigaur released this 17 Oct 07:39
· 26 commits to main since this release
b647af2
  • laya_mlx now defaults to aac6fef/laya-mlx, the English checkpoint, instead of the multilingual one. Measured on 150 rows each of ag_news and sst2, the multilingual checkpoint answers 0.527 of yes/no questions correctly against the English one's 0.833, and its expected calibration error on them is 0.373 against 0.053. A gate reads that confidence, so the best calibrated checkpoint is the right default. Pass model="aac6fef/laya-multilingual-mlx" for input that is not English. The numbers are in docs/backends.md.
  • Naming laya or laya_mlx in DECIDE_BACKENDS no longer requires DECIDE_LOCAL_MODEL. It behaves like auto-detection and uses the backend's own default checkpoint; set the variable to override it.
  • README, docs/server.md and docs/typesafe-sdk.md carry re-measured output from the new default: one Choice question now takes 15.6 ms on an M4 instead of 8.6 ms, since the English checkpoint is 421M against 322M.