v1.17.0

English

v1.17.0

Highlights

Use your ChatGPT subscription

Authorize Midscene through Sign in with ChatGPT (SIWC) to call GPT models using your ChatGPT subscription allowance. The video below demonstrates the browser extension's sign-in and authorization flow. See Use your ChatGPT subscription for setup instructions.

Experimental Jev 1.14 support

Jev can handle planning, localization, and judgments, working with a general-purpose default model for tasks such as text input. See the Jev configuration guide for setup instructions and limitations.

The following measurements come from a single run of each demo. A step means one model call; latency excludes page actions and waits. Costs are in USD, calculated at $0.042 per million Jev input tokens, with output tokens free of charge.

Fruit tile matching: Jev only

Jev handles clicks and localization to clear all fruit pairs until the remaining count reaches zero. View the execution report.

• Model latency per call: 0.887 seconds on average, 0.774 seconds at P50.
• Input usage: 6,761.4 tokens per call on average, 101,421 tokens in total.
• Model cost: $0.000284 per call on average, $0.00426 in total.

Registration form: Jev + DeepSeek

Jev handles clicks, localization, gender dropdown selection, and completion checks. DeepSeek generates input values for the email, password, and username fields to complete the registration form together. View the execution report.

The following measurements cover Jev only and exclude DeepSeek:

• Model latency per call: 0.583 seconds on average, 0.559 seconds at P50.
• Input usage: 5,265.8 tokens per call on average, 68,455 tokens in total.
• Model cost: $0.000221 per call on average, $0.002875 in total.

Changes

Fixes 🐞

• fix(chrome-extension): keep recorder screenshots on their source tab by @dakjdakd in #3194
• fix(workflow): stabilize Studio notarization and unblock release notices by @quanru in #3294

Refactors ♻️

• refactor(core): restructure Jev integration and planning delegation by @EAGzzyCSL in #3295

New Contributors

• @dakjdakd made their first contribution in #3194

Full Changelog: v1.16.5...v1.17.0

中文

v1.17.0

亮点

使用 ChatGPT 订阅额度

通过 Sign in with ChatGPT（SIWC）授权 Midscene，使用 ChatGPT 订阅额度调用 GPT 模型。下面的视频演示浏览器插件中的登录授权流程。接入方式详见使用 ChatGPT 订阅。

Jev 1.14 实验性支持

Jev 可用于任务规划、定位和判断，并与通用默认模型协同完成输入等任务。接入方式及限制详见 Jev 配置指南。

以下数据来自演示中的单次运行，“单步”指一次模型调用，耗时不包含页面操作和等待。费用单位为美元，按 Jev 输入 $0.042 / 百万 Token、输出免费计算。

水果连连看：纯 Jev

Jev 独立完成点击与定位，消除所有水果配对，直到剩余配对数为 0。查看运行报告。

• 单步模型耗时：平均 0.887 秒，P50 0.774 秒。
• 输入消耗：平均每步 6,761.4 Token，总计 101,421 Token。
• 模型费用：平均每步 $0.000284，总计 $0.00426。

注册表单：Jev + DeepSeek

Jev 负责点击、定位、性别下拉框选择和完成判断；DeepSeek 生成邮箱、密码和用户名等输入内容，共同完成注册表单。查看运行报告。

以下数据仅统计 Jev，不包含 DeepSeek：

• 单步模型耗时：平均 0.583 秒，P50 0.559 秒。
• 输入消耗：平均每步 5,265.8 Token，总计 68,455 Token。
• 模型费用：平均每步 $0.000221，总计 $0.002875。

完整变更

问题修复 🐞

• fix(chrome-extension): keep recorder screenshots on their source tab by @dakjdakd in #3194
• fix(workflow): stabilize Studio notarization and unblock release notices by @quanru in #3294

重构 ♻️

• refactor(core): restructure Jev integration and planning delegation by @EAGzzyCSL in #3295

新贡献者

• @dakjdakd made their first contribution in #3194

Full Changelog: v1.16.5...v1.17.0