Skip to content

ara-diac-2.0

Choose a tag to compare

@ronaldtse ronaldtse released this 30 Aug 14:24
· 153 commits to main since this release

ara-diac-2.0

IMF v1 (int8, decoder kv, opset 14). Trained from rababa train_arabic_r7.py run-007-news (news-domain adaptation of the r6 morphological-aux teacher: r5-units anchor + 13,986 teacher-labeled news units at 0.85% mix + 400 gold WikiNews-2014 lines, init from run-006-morph); checkpoint rababa-checkpoints:/rababa_arabic_byt5/run-007-news/best.

field value
task diacritization (Arab → Arab)
artifact ara-diac-2.0-int8.zip (0.48 GiB)
der_total_greedy 2.2864 — greedy decode (the v1 runtime path); SadeedDiac-25, windowed zero-skip at 1400 bytes, full 1,200 paragraphs; ByT5-base r7
der_morph_greedy 1.3343 — same harness; Morphological DER (word-final case endings only)
wer_wikinews_multiref 17.3794 — WikiNews-2024 multi-reference, QCRI EvalDiac protocol (full mode), 356 texts / 10,616 words
der_wikinews_multiref 11.8273 — same harness
parity cer_delta 0.0947pp on 600 samples
sha256 7f1d55d43f97564ad62fc14a7e0cabe52c01d8298b747677a75900de748bb6c6
license BSD-3-Clause

Runtimes reassemble split parts transparently and verify every sha256:

from secryst import Model
model = Model.load("ara-diac-2.0")