v1.17.3

English

v1.17.3

Changes

Features 🎉

• feat(core): add ant-ling model adapter by @EAGzzyCSL in #3315
• feat(report): add directory report artifact foundation (PR1) by @xiong35 in #3312

Refactors ♻️

• refactor(core): rename supportedTaskTypes to allowedTaskTypes by @EAGzzyCSL in #3314

Documentation 📖

• docs(site): clarify test entry points by @yuyutaotao in #3310

Full Changelog: v1.17.2...v1.17.3

中文

v1.17.3

完整变更

新特性 🎉

• feat(core): add ant-ling model adapter by @EAGzzyCSL in #3315
• feat(report): add directory report artifact foundation (PR1) by @xiong35 in #3312

重构 ♻️

• refactor(core): rename supportedTaskTypes to allowedTaskTypes by @EAGzzyCSL in #3314

文档 📖

• docs(site): clarify test entry points by @yuyutaotao in #3310

Full Changelog: v1.17.2...v1.17.3

v1.17.2

English

v1.17.2

Changes

Features 🎉

• feat(core): support custom endpoints for System One models by @EAGzzyCSL in #3301

Fixes 🐞

• fix(core): allow Jev as default model for supported tasks by @EAGzzyCSL in #3308
• fix(core): support Gemini 4 Argon by @EAGzzyCSL in #3309

Full Changelog: v1.17.1...v1.17.2

中文

v1.17.2

完整变更

新特性 🎉

• feat(core): support custom endpoints for System One models by @EAGzzyCSL in #3301

问题修复 🐞

• fix(core): allow Jev as default model for supported tasks by @EAGzzyCSL in #3308
• fix(core): support Gemini 4 Argon by @EAGzzyCSL in #3309

Full Changelog: v1.17.1...v1.17.2

v1.17.1

English

v1.17.1

Changes

Features 🎉

• feat(test): support namespaces for Midscene Nodes by @xiong35 in #3300

Fixes 🐞

• fix(workflow): preserve MDX in release highlights by @EAGzzyCSL in #3298
• fix(site): restore v1.17 changelog videos by @EAGzzyCSL in #3299

Documentation 📖

• docs(site): sdk docs restructure by @yuyutaotao in #3297

Full Changelog: v1.17.0...v1.17.1

中文

v1.17.1

完整变更

新特性 🎉

• feat(test): support namespaces for Midscene Nodes by @xiong35 in #3300

问题修复 🐞

• fix(workflow): preserve MDX in release highlights by @EAGzzyCSL in #3298
• fix(site): restore v1.17 changelog videos by @EAGzzyCSL in #3299

文档 📖

• docs(site): sdk docs restructure by @yuyutaotao in #3297

Full Changelog: v1.17.0...v1.17.1

v1.17.0

English

v1.17.0

Highlights

Use your ChatGPT subscription

Authorize Midscene through Sign in with ChatGPT (SIWC) to call GPT models using your ChatGPT subscription allowance. The video below demonstrates the browser extension's sign-in and authorization flow. See Use your ChatGPT subscription for setup instructions.

Experimental Jev 1.14 support

Jev can handle planning, localization, and judgments, working with a general-purpose default model for tasks such as text input. See the Jev configuration guide for setup instructions and limitations.

The following measurements come from a single run of each demo. A step means one model call; latency excludes page actions and waits. Costs are in USD, calculated at $0.042 per million Jev input tokens, with output tokens free of charge.

Fruit tile matching: Jev only

Jev handles clicks and localization to clear all fruit pairs until the remaining count reaches zero. View the execution report.

• Model latency per call: 0.887 seconds on average, 0.774 seconds at P50.
• Input usage: 6,761.4 tokens per call on average, 101,421 tokens in total.
• Model cost: $0.000284 per call on average, $0.00426 in total.

Registration form: Jev + DeepSeek

Jev handles clicks, localization, gender dropdown selection, and completion checks. DeepSeek generates input values for the email, password, and username fields to complete the registration form together. View the execution report.

The following measurements cover Jev only and exclude DeepSeek:

• Model latency per call: 0.583 seconds on average, 0.559 seconds at P50.
• Input usage: 5,265.8 tokens per call on average, 68,455 tokens in total.
• Model cost: $0.000221 per call on average, $0.002875 in total.

Changes

Fixes 🐞

• fix(chrome-extension): keep recorder screenshots on their source tab by @dakjdakd in #3194
• fix(workflow): stabilize Studio notarization and unblock release notices by @quanru in #3294

Refactors ♻️

• refactor(core): restructure Jev integration and planning delegation by @EAGzzyCSL in #3295

New Contributors

• @dakjdakd made their first contribution in #3194

Full Changelog: v1.16.5...v1.17.0

中文

v1.17.0

亮点

使用 ChatGPT 订阅额度

通过 Sign in with ChatGPT（SIWC）授权 Midscene，使用 ChatGPT 订阅额度调用 GPT 模型。下面的视频演示浏览器插件中的登录授权流程。接入方式详见使用 ChatGPT 订阅。

Jev 1.14 实验性支持

Jev 可用于任务规划、定位和判断，并与通用默认模型协同完成输入等任务。接入方式及限制详见 Jev 配置指南。

以下数据来自演示中的单次运行，“单步”指一次模型调用，耗时不包含页面操作和等待。费用单位为美元，按 Jev 输入 $0.042 / 百万 Token、输出免费计算。

水果连连看：纯 Jev

Jev 独立完成点击与定位，消除所有水果配对，直到剩余配对数为 0。查看运行报告。

• 单步模型耗时：平均 0.887 秒，P50 0.774 秒。
• 输入消耗：平均每步 6,761.4 Token，总计 101,421 Token。
• 模型费用：平均每步 $0.000284，总计 $0.00426。

注册表单：Jev + DeepSeek

Jev 负责点击、定位、性别下拉框选择和完成判断；DeepSeek 生成邮箱、密码和用户名等输入内容，共同完成注册表单。查看运行报告。

以下数据仅统计 Jev，不包含 DeepSeek：

• 单步模型耗时：平均 0.583 秒，P50 0.559 秒。
• 输入消耗：平均每步 5,265.8 Token，总计 68,455 Token。
• 模型费用：平均每步 $0.000221，总计 $0.002875。

完整变更

问题修复 🐞

• fix(chrome-extension): keep recorder screenshots on their source tab by @dakjdakd in #3194
• fix(workflow): stabilize Studio notarization and unblock release notices by @quanru in #3294

重构 ♻️

• refactor(core): restructure Jev integration and planning delegation by @EAGzzyCSL in #3295

新贡献者

• @dakjdakd made their first contribution in #3194

Full Changelog: v1.16.5...v1.17.0

v1.16.5

English

v1.16.5

Changes

Full Changelog: v1.16.4...v1.16.5

中文

v1.16.5

完整变更

Full Changelog: v1.16.4...v1.16.5

v1.16.2

English

v1.16.2

Changes

Features 🎉

• feat(test): redesign CLI reporting and model usage summaries by @xiong35 in #3285

Fixes 🐞

• fix(workflow): diagnose Chrome Web Store OAuth failures by @quanru in #3284
• fix(core): keep trailing parenthesis in auto-glm finish message by @kwy404 in #3190
• fix(core): validate locate coordinate types strictly by @linhongyu510 in #3068
• fix(core): validate swipe action parameters by @linhongyu510 in #3069
• fix(workflow): build report dependencies and stabilize AI checks by @quanru in #3290

Documentation 📖

• docs(site): reorganize model setup and debugging guides by @yuyutaotao in #3288
• docs(site): standardize navigation capitalization by @ottomao in #3291

New Contributors

• @kwy404 made their first contribution in #3190

Full Changelog: v1.16.1...v1.16.2

中文

v1.16.2

完整变更

新特性 🎉

• feat(test): redesign CLI reporting and model usage summaries by @xiong35 in #3285

问题修复 🐞

• fix(workflow): diagnose Chrome Web Store OAuth failures by @quanru in #3284
• fix(core): keep trailing parenthesis in auto-glm finish message by @kwy404 in #3190
• fix(core): validate locate coordinate types strictly by @linhongyu510 in #3068
• fix(core): validate swipe action parameters by @linhongyu510 in #3069
• fix(workflow): build report dependencies and stabilize AI checks by @quanru in #3290

文档 📖

• docs(site): reorganize model setup and debugging guides by @yuyutaotao in #3288
• docs(site): standardize navigation capitalization by @ottomao in #3291

新贡献者

• @kwy404 made their first contribution in #3190

Full Changelog: v1.16.1...v1.16.2

v1.16.1

English

v1.16.1

Changes

Features 🎉

• feat(test): add file concurrency with maxConcurrentFiles by @xiong35 in #3259

Fixes 🐞

• fix(playground): isolate reports between executions by @xiong35 in #3252

Documentation 📖

• docs(site): add GitHub Actions guide for Midscene Test by @await-ovo in #3263
• docs(site): simplify GitHub Actions docs and link to Marketplace by @await-ovo in #3276
• docs(site): clarify Jev setup with combined model configuration by @ottomao in #3277
• docs(site): update introduction of GUI Agent by @yuyutaotao in #3278
• docs(site): clarify Midscene Test terminology and release status by @yuyutaotao in #3279
• docs(site): migrate introduction to the homepage by @yuyutaotao in #3282

Testing 🧪

• test(report): migrate report app e2e tests to midscene-test and publish CI reports by @await-ovo in #3275

New Contributors

• @await-ovo made their first contribution in #3263

Full Changelog: v1.16.0...v1.16.1

中文

v1.16.1

完整变更

新特性 🎉

• feat(test): add file concurrency with maxConcurrentFiles by @xiong35 in #3259

问题修复 🐞

• fix(playground): isolate reports between executions by @xiong35 in #3252

文档 📖

• docs(site): add GitHub Actions guide for Midscene Test by @await-ovo in #3263
• docs(site): simplify GitHub Actions docs and link to Marketplace by @await-ovo in #3276
• docs(site): clarify Jev setup with combined model configuration by @ottomao in #3277
• docs(site): update introduction of GUI Agent by @yuyutaotao in #3278
• docs(site): clarify Midscene Test terminology and release status by @yuyutaotao in #3279
• docs(site): migrate introduction to the homepage by @yuyutaotao in #3282

测试 🧪

• test(report): migrate report app e2e tests to midscene-test and publish CI reports by @await-ovo in #3275

新贡献者

• @await-ovo made their first contribution in #3263

Full Changelog: v1.16.0...v1.16.1

v1.16.0

English

v1.16.0

Highlights

Jev 1.4 support: faster, lower-cost visual E2E testing

Midscene now supports Jev 1.4, continuing our focus on visual understanding to drive UI automation. With this integration, developers can experience faster, lower-cost E2E testing. See the Jev configuration guide for setup instructions and the current experimental limitations.

In the tile-matching game test shown in the demo below, 28 model calls were made, with model inference averaging 393.57 ms (approximately 0.39 seconds) per call. Each call averaged 5,025 input tokens and 67 output tokens, at a model cost of approximately $0.000211 per call. This is calculated at $0.042 per million input tokens, with output tokens free of charge.

20261016-220919.mp4

Changes

Full Changelog: v1.15.6...v1.16.0

中文

v1.16.0

亮点

接入 Jev 1.4：更快、更低成本的视觉 E2E 测试

Midscene 现已接入 Jev 1.4，继续沿着视觉理解的道路推进 UI 自动化。通过此次接入，开发者可以体验更快、更低成本的 E2E 测试。接入步骤和当前的实验性限制详见 Jev 配置指南。

在下方 Demo 的连连看游戏测试中，共进行了 28 次模型调用，平均每次模型推理耗时 393.57 ms（约 0.39 秒）。平均每次输入 5,025 Token、输出 67 Token，模型调用费用约 $0.000211/次。费用按输入 $0.042 / 百万 Token 计算，输出免费。

完整变更

Full Changelog: v1.15.6...v1.16.0

v1.15.6

English

v1.15.6

Changes

Features 🎉

• feat(llm): add dedicated locate model configuration by @EAGzzyCSL in #3268
• feat(llm): add experimental Jev model support by @EAGzzyCSL in #3271

CI & Chore ⚙️

• chore(core): redesign introduction page by @yuyutaotao in #3267

Full Changelog: v1.15.5...v1.15.6

中文

v1.15.6

完整变更

新特性 🎉

• feat(llm): add dedicated locate model configuration by @EAGzzyCSL in #3268
• feat(llm): add experimental Jev model support by @EAGzzyCSL in #3271

CI 与维护 ⚙️

• chore(core): redesign introduction page by @yuyutaotao in #3267

Full Changelog: v1.15.5...v1.15.6

v1.15.5

English

v1.15.5

Changes

Features 🎉

• feat(web): add Puppeteer test runner nodes by @quanru in #3160
• feat(report): redesign test report workspace and clarify execution details by @xiong35 in #3245

Fixes 🐞

• fix(core): preserve aiAct reference images for independent locating by @EAGzzyCSL in #3257
• fix(ios): wait for input readiness and restore focus after clearing by @quanru in #3239
• fix(shared): preserve empty string CLI argument values by @quanru in #3260
• fix(core): align default scrolling across Android, iOS, and HarmonyOS by @resonlei in #3225
• fix(web-integration): preserve CLI viewport after disconnect by @quanru in #3261
• fix(test): validate wait options and preserve cross-module screenshots by @quanru in #3246
• fix(web-integration): launch cookie tests without sandbox on Linux CI by @xiong35 in #3269

CI & Chore ⚙️

• chore(core): add a highlight section to release note by @yuyutaotao in #3256

New Contributors

• @resonlei made their first contribution in #3225

Full Changelog: v1.15.4...v1.15.5

中文

v1.15.5

完整变更

新特性 🎉

• feat(web): add Puppeteer test runner nodes by @quanru in #3160
• feat(report): redesign test report workspace and clarify execution details by @xiong35 in #3245

问题修复 🐞

• fix(core): preserve aiAct reference images for independent locating by @EAGzzyCSL in #3257
• fix(ios): wait for input readiness and restore focus after clearing by @quanru in #3239
• fix(shared): preserve empty string CLI argument values by @quanru in #3260
• fix(core): align default scrolling across Android, iOS, and HarmonyOS by @resonlei in #3225
• fix(web-integration): preserve CLI viewport after disconnect by @quanru in #3261
• fix(test): validate wait options and preserve cross-module screenshots by @quanru in #3246
• fix(web-integration): launch cookie tests without sandbox on Linux CI by @xiong35 in #3269

CI 与维护 ⚙️

• chore(core): add a highlight section to release note by @yuyutaotao in #3256

新贡献者

• @resonlei made their first contribution in #3225

Full Changelog: v1.15.4...v1.15.5