v1.10.0

中文版

基准测试数据集

• Agent 与自动化评测：新增 AutomationBench、DeepSearchQA、JobBench、BrowserGym MiniWoB 等评测能力
• 文档理解评测：新增 OmniDocBench v1.6 评测，并修复 OCR 相关兼容性

功能增强

• 性能测试：支持通过 prefix_file / prefix_role 注入长上下文前缀；补充百分位统计最小值和平均延迟指标
• Web 界面：性能列表新增 I/O token 列，支持删除历史记录

文档优化

• 修正中文文档中的拼写和语法问题

问题修复

• 修复 IFBench 下载错误的 NLTK English tagger 问题
• 修复数学解析器中未保存 str.replace() 返回值的问题
• 修复 CMMLU few-shot 加载、ARC 答案格式、Windows UTF-8 文件读写等兼容性问题
• 修复异步事件循环和任务生命周期、Anthropic tool-call ID、每 subset 浮点数 limit 等问题
• 修复性能测试的调度截止、无固定速率 HTML 报告、非流式 TTFT/TPOT/ITL 指标和缓存 token 同步问题

---

English Version

Benchmark Datasets

• Agent and automation evaluation: Added AutomationBench, DeepSearchQA, JobBench, BrowserGym MiniWoB, and related capabilities
• Document understanding evaluation: Added OmniDocBench v1.6 and fixed OCR compatibility

Feature Enhancements

• Performance testing: Added long-context prefix injection with prefix_file / prefix_role, plus minimum percentile and average latency metrics
• Web UI: Added I/O token columns to performance lists and history-record deletion

Documentation

• Corrected spelling and grammar in Chinese documentation

Bug Fixes

• Fixed IFBench downloading the incorrect NLTK English tagger
• Fixed math parsing where the result of str.replace() was discarded
• Fixed CMMLU few-shot loading, ARC answer formatting, and Windows UTF-8 file I/O compatibility
• Fixed async event-loop and task lifecycle handling, Anthropic tool-call IDs, and per-subset float limits
• Fixed perf scheduling deadlines, HTML reports for no-fixed-rate runs, non-stream TTFT/TPOT/ITL metrics, and cached-token synchronization

What's Changed

• fix(ifbench): download correct NLTK English tagger by @git-jxj in #1539
• fix: assign result of str.replace() in math parser by @LeoYueDev in #1536
• Fix OCR benchmark compatibility and add OmniDocBench v1.6 evaluation by @Yunnglin in #1535
• Fix CMMLU few-shot loading by @Yunnglin in #1534
• fix(docs): correct typos and grammar errors in Chinese documentation by @LeoYueDev in #1532
• feat(perf): long-context prefix injection via prefix_file/prefix_role by @Yunnglin in #1531
• feat: add direct BrowserGym MiniWoB evaluation by @Yunnglin in #1530
• fix: per-subset float limit and Anthropic tool call id sanitization by @Yunnglin in #1528
• feat(web): I/O token column for perf list and history record deletion by @Yunnglin in #1526
• fix: add encoding='utf-8' to remaining core file read/write for Windows compatibility by @Yunnglin in #1522
• fix: performance test progress and cancellation handling, plus tokenizer path support by @duxingx1a in #1520
• feat(perf): add min row to percentile table and label avg latency metrics by @Yunnglin in #1517
• fix: normalise ARC answerKey digits to letters in arc_adapter by @duxingx1a in #1516
• fix: add encoding='utf-8' to yaml_to_dict for Windows compatibility by @duxingx1a in #1515
• fix(web): accept completed invoke status by @afox666 in #1510
• Add JobBench benchmark by @Yunnglin in #1509
• fix(perf): sync server-reported cached_tokens for single-turn runs by @Yunnglin in #1508
• Fix async event loop and task lifecycle by @Yunnglin in #1507
• Add AutomationBench benchmark by @Yunnglin in #1505
• fix(perf): generate HTML report for open-loop runs with no fixed rate by @qiumuyang in #1503
• Add DeepSearchQA benchmark by @Yunnglin in #1502
• fix(perf): stop open-loop dispatch at duration deadline by @YingchaoX in #1501
• fix(perf): exclude non-stream requests from TTFT/TPOT/ITL metrics by @qiumuyang in #1499