Skip to content

Groot 1 · v0.1.1 — Folha correction

Latest

Choose a tag to compare

@leofmarciano leofmarciano released this 23 Oct 12:45

Groot 1 v1.1 fixes the zero-shot failure reported after launch.

Groot 1 (S+M) Groot 1 S Jev Julia 1
Folha news pt · zero-shot, 400 87.8% 84.5% 85.8% 49.5%
Typed decisions · 2,000 75.3% 75.2% 73.7% 72.7%
  • Groot 1 averages a 149M S and a new 333M M model (mmBERT-base): marcyano/Groot-1.
  • Groot 1 S weights replaced with the corrected model: marcyano/Groot-1-S. v1.0 scored 33.8% on Folha.
  • GrootEngine loads any directory with an ensemble.json as a probability-averaged ensemble.
  • New training data: label-diversified topic sets, URL-labelled Portuguese web news (Folha/UOL blocked), Qwen2.5-14B soft labels. No Folha text and no Jev outputs in training.
  • The lead over Jev on Folha is 8 of 400 articles, within the ±3-point margin. Selection, test runs and remaining gaps are in the README.