v0.10.0

Major changes

• Updated the Japanese model using the new model training pipeline powered by LogitBoost.
• Updated supported versions for Python and Node.js

What's Changed

• fix(js): don't split surrogate pairs by @kwy404 in #1403
• perf(java): precompute totalScore and HashMap feature maps in Parser by @tushuhei in #1404
• refactor(py): replace LifoQueue with list for HTMLChunkResolver.element_stack by @tushuhei in #1405
• fix(py): track chunk boundaries by offset instead of in-band SEP character by @tushuhei in #1406
• chore(deps): bump the patch group across 2 directories with 2 updates by @dependabot[bot] in #1408
• chore(deps): bump the codeql group with 4 updates by @dependabot[bot] in #1407
• fix: preserve HTML state for unmatched closing tags by @Shubham-Padkonde in #1409
• fix(java): don't split surrogate pairs by @kwy404 in #1411
• chore(deps): bump urllib3 from 2.7.0 to 2.8.0 in the uv group across 1 directory by @dependabot[bot] in #1412
• feat(scripts): add early stopping (--patience) to train and pipeline by @tushuhei in #1413
• feat(scripts): add magnitude pruning (--top-k) by @tushuhei in #1414
• feat(scripts): add LogitBoost training algorithm (--algorithm) by @tushuhei in #1415
• chore(deps-dev): bump the patch group across 1 directory with 6 updates by @dependabot[bot] in #1416
• feat(scripts): add dataset linter, resolve fine-tuning contradictions, and enforce integrity by @tushuhei in #1417
• feat(scripts): normalize LogitBoost algorithm with learning rate and sample weights by @tushuhei in #1418
• chore(deps-dev): bump source-map-js from 1.2.1 to 1.2.2 in /javascript by @dependabot[bot] in #1419
• feat(scripts): auto-balance fine-tuning weights and eliminate text duplication in pipeline by @tushuhei in #1420
• feat(model): update Japanese model weights with auto-balanced LogitBoost pipeline by @tushuhei in #1421
• docs(scripts): update training pipeline documentation for LogitBoost and auto-balancing by @tushuhei in #1422
• feat(model): resolve word segmentation issue for なぞなぞ (#1410) by @tushuhei in #1423
• chore(deps-dev): bump playwright from 1.63.0 to 1.64.0 in /javascript by @dependabot[bot] in #1425
• chore(deps-dev): bump the patch group across 1 directory with 2 updates by @dependabot[bot] in #1424
• chore(deps): bump actions/setup-node from 7.0.0 to 7.1.0 by @dependabot[bot] in #1429
• chore(deps): bump step-security/harden-runner from 2.21.1 to 2.22.1 by @dependabot[bot] in #1428
• chore(deps): bump the codeql group with 4 updates by @dependabot[bot] in #1426
• chore(deps): bump actions/upload-artifact from 7.0.1 to 7.0.2 in the patch group by @dependabot[bot] in #1427
• fix: explicitly import budoux.utils to resolve standalone AttributeError and pyrefly warnings by @tushuhei in #1432
• ci: pin npm and Python dependencies via npm ci and uv sync --locked by @tushuhei in #1431
• chore(deps): bump types-setuptools from 82.0.0.20260518 to 84.0.0.20261006 by @dependabot[bot] in #1438
• chore(deps): bump pydantic from 2.13.4 to 2.14.0 by @dependabot[bot] in #1437
• chore(deps): bump regex from 2026.5.9 to 2026.9.29 by @dependabot[bot] in #1436
• chore(deps): bump pyrefly from 1.2.0 to 1.3.2 by @dependabot[bot] in #1435
• chore(deps): bump ruff from 0.16.2 to 0.16.10 in the patch group by @dependabot[bot] in #1434
• chore(deps-dev): bump vite from 8.3.3 to 8.3.4 in /javascript in the patch group across 1 directory by @dependabot[bot] in #1433
• fix: require -o/--output flag in find_conflicts.py by @tushuhei in #1439
• fix(demo): register Thai parser in Web Worker and use loadDefaultParsers by @tushuhei in #1440
• bump version to v0.10.0 by @tushuhei in #1430
• Add Python 3.15 support and drop Python 3.10 by @tushuhei in #1443
• ci(js): add node 26, remove 20 by @kojiishi in #1444

New Contributors

• @Shubham-Padkonde made their first contribution in #1409

Full Changelog: v0.9.3...v0.10.0