IATest 2.1.1

IATest 2.1.1 加固本地控制台、模型凭据和配置更新，完善确定性判定、AI 分析状态与发布质量检查。

• 控制台统一校验 Host/端口与写请求 token，默认通过一次性启动链接建立会话；报告、任务和二进制证据受同一边界保护。
• 模型目标与凭据引用在本机独立登记；跨项目配置更新采用冲突检查与合并，秘密文件和调试日志使用受限权限。
• 增加明确的检查计数、结构化 AI 分析状态、知识缓存失效保护、全文索引校验/修复和结果证据清理预览。
• 关联请求、任务、引擎与模型追踪，启用新项目任务预算，复用浏览器有界等待并拆分关键边界模块。
• 修复 Chromium 端口文件尚未写完时的启动竞态；真实浏览器回归不再依赖 favicon 请求顺序，并稳定视觉测试图形。
• 固定 CI/构建依赖及 Actions 提交，增加 lint、关键模块类型/分支覆盖门禁、存储基准和无模型示例。

升级后使用 iatest web 打印的授权链接。新增模型连接先执行 iatest llm-trust <base_url> <credential_env>；旧资产布局保持兼容，非法配置现在会明确报错。

验证包括完整跨平台回归、关键模块覆盖率 86%（启用分支统计）、wheel/sdist 元数据和干净基础 wheel 的 CLI/隔离 worker/Web 冒烟。真实设备和平台兼容范围仍以相应验收为准，跳过不代表设备通过。

完整变更与升级说明 · 控制台与凭据指南

IATest 2.1.0

IATest 2.1.0

PyPI distribution: iatest-framework==2.1.0 · CLI: iatest · Python: 3.11+

按项目和测试类型保存资产

接口、Web、桌面、Android、iOS、性能、安全、数据与协议等资产统一位于 projects/<project>/assets/<type>/。计划、目标探索用例、业务用例版本、安全规则、协议 Schema、设备配置和测量资料保存为可读 JSON/Markdown。运行结果和证据位于 reports/<type>/。

SQLite 保留可重建查询视图及内部状态。修改或删除资产文件会同步到查询结果；非法文件或重复身份会阻止读取，不会回退到旧缓存执行。通用入口和原生移动入口保留各自的计划标识空间。完整目录见项目资产与目录。

升级与迁移

退出使用同一工作空间的旧版 IATest，再升级：

python -m pip install --upgrade "iatest-framework==2.1.0"

正常打开项目时迁移旧 API 目录和报告；首次访问通用或原生移动资产时，从旧数据库导出文件。旧目录、数据库和历史证据保留，新操作更新新结构。内容冲突时拒绝覆盖，并指出需比较的目标路径。

迁移标记独立于查询缓存，重建索引不会复活已删除资产。多文件提交保留恢复快照，进程中断后根据提交状态恢复；不要将整个 .iatest/ 当作可丢弃缓存，也不要让旧版与新版同时写入同一项目。只读 MCP 支持新旧路径，不触发写入迁移。

本版本保留 2.0.1 的项目契约隔离修复；从更早版本升级、需要重新生成 API 用例时，另见2.0.1 修复说明。

兼容性与验证

修复 Windows 并发创建目录时普通路径和 \\?\ 路径形式不一致导致的越界误报，保留跨项目符号链接保护。文档、CLI、Web、节点与执行器共用文件资产存储，旧证据地址继续可读。

回归覆盖旧库迁移、文件编辑和删除、用例版本、索引重建、并发写入、进程中断恢复、项目隔离及节点执行。发行流程验证 Python 3.11–3.14、Linux/macOS/Windows，以及仅安装基础 wheel 的 CLI、工作进程和 Web 控制台。

IATest 2.0.1

IATest 2.0.1 removes the legacy application-specific adapter from default document discovery and case compilation. Business routes, email domains, lifetime assumptions and chain titles must come from the current project.

Changes

• Removed the built-in adapter and all default calls to it; cleaned console examples and model prompts.
• Preserved explicit business chains and unscoped Markdown evidence; operation names no longer activate hidden route recipes.
• Dependency proposals require fields from documented successful responses.
• Chain titles use the current operation summaries; email domain and length checks use the supplied source.
• Added 11 project-isolation checks and installed-runtime scanning to release validation.

Upgrade

python -m pip install --upgrade "iatest-framework==2.0.1"

Reimport documents and regenerate affected API cases to rebuild their trusted contracts. Existing user assets are retained. Python imports and plan schemas remain compatible with 2.0.0.

Release notes · 简体中文

The publishing workflow verifies Linux/Python 3.11–3.14, macOS/Windows/Python 3.14, real X11/AT-SPI input, distribution metadata and four clean base-wheel installations before uploading to PyPI. Platform-dependent skips remain explicit.

IATest 2.0.0

IATest 2.0.0 brings API, browser, desktop, native mobile, performance, security, data and protocol tests into one framework.

Highlights

• Goal-first UI testing: describe the target, business goal and trusted outcome, then explore and independently replay.
• A unified asset library for UI cases, API contracts/cases, performance plans and measurements, security plans/rules, data/protocol checks and release workflows.
• Native browser, desktop and Android/iOS backends, scoped measurements, authorized LAN nodes and typed business workflows.
• Redesigned local console with responsive navigation, page transitions and reduced-motion support.
• Reorganized source and examples; new English and Chinese README, usage guides and migration notes.

Install

python -m pip install "iatest-framework==2.0.0"
iatest init --project demo
iatest web --project demo

Optional extras: iatest-framework[database]==2.0.0 and iatest-framework[hid]==2.0.0.

Migration

The Python import namespace changed from ai_apitest to iatest. Update custom imports, provider references and python -m ai_apitest invocations. The PyPI distribution remains iatest-framework, and the CLI remains iatest.

Full release and migration notes · English README · 简体中文

Validation and scope

Release validation covers Linux, macOS and Windows regressions, real Linux X11/AT-SPI input, distribution metadata, and clean base-wheel installation for the CLI, process worker and Web resources. Publishing additionally checks Python 3.11–3.14 on Linux and Python 3.14 on macOS/Windows. Platform-dependent skips remain explicit; they are not hardware acceptance.

Native features require the documented SDKs, permissions, signatures or hardware. Capability boundaries explicitly retain Safari advanced interception, some Apple raw collector failures, experimental digitizer behavior and physical-hardware limitations.

IATest 1.1.0

IATest 1.1.0 增加运行时测试数据和 Agent 编排能力，并降低模型重复读取证据带来的 Token 消耗。

• 受约束的运行时数据、多样本、可复现 seed、失败输入重放、分区采样及请求预算。
• Agent 离线/真实模型评测、持久化会话恢复、完整工具契约、共享任务预算、模型路由及项目测试配方。
• 只读 MCP stdio 服务，以及遵守既有沙箱和清理机制的 HTTP MCP Fixture。
• Token 明细统计、可逆证据去重、已授权事实预取、保守增量复审和自适应批次/输出预算；保留全部独立审计模型与原准入门禁。
• 修复断言 Schema、审计缓存失效、读取范围恢复及重复断言门禁问题。相较 1.0.4 不新增生产依赖，Python 要求仍为 3.11+。

python -m pip install --upgrade iatest-framework==1.1.0
iatest token-stats --project my-project --output token-usage.json

发布前本地回归 468 项通过、离线评测 60/60。三模型对同一合成样本的单次 A/B 验收：Token 76,613 → 55,756（减少 27.22%），调用 9 → 3 次；耗时未改善。错误候选被三个模型均判为 critical；该结果不代表所有业务项目的节省比例。

1.1.0 完整发布说明 · 配置与能力说明 · 跨平台 CI · PyPI

IATest 1.0.4

IATest 1.0.4

PyPI distribution: iatest-framework==1.0.4; CLI: iatest.

Changes / 更新内容

• Add complete JSON Schema assertions, recursive OpenAPI definitions and constraint-checked sample generation. Fix missing-header assertions and business-rule change detection.
• Add JSON/CSV/matrix datasets, reproducible seeds, environment/identity selection, stable CI sharding, failed-case reruns and JSON/JUnit exports with meaningful exit codes.
• Add Bearer/OAuth2 authentication, proxy/CA/mTLS settings, independent case cookies, polling, safe retries, cancellation and execution deadlines.
• Add fixture checks, installed-plugin assertions/hooks/adapters, resource mutexes, execution provenance, coverage evidence and incremental generation caches.
• Add default file/network access policies, isolated process workers and an optional Docker backend with bounded inputs/results, checkpoints and forced termination.
• Extend shared redaction and regression coverage; add Linux/macOS/Windows push/PR testing and Windows operation locks.

对应使用方式见 框架能力说明、执行隔离说明 和 用例格式规范。

Upgrade / 升级

python -m pip install --upgrade iatest-framework==1.0.4

Markdown 用例格式和原有命令保持兼容，新增生产依赖为 jsonschema>=4.23,<5。

默认 sandbox.mode=policy：当前配置环境和显式 CLI base URL 已授权，额外鉴权、Fixture、文档来源须配置 sandbox.allowed_origins；用例文件和数据集遵守 read_paths/denied_read_paths。插件需同时配置 plugins 与 sandbox.allow_plugins=true。旧项目应按实际用途授权所需范围。

普通进程提供故障和超时隔离，不能限制任意 Python 插件的宿主机权限；运行不可信插件应使用容器。容器模式要求已准备 Docker、镜像和 internal 测试网络，默认网络为 none；运行失败时不会自动降低隔离级别。

强制中断不保证远端 cleanup 完成。{{iatest_namespace}} 需由测试服务实际用于数据隔离，并配合独立测试账号、幂等清理或 TTL。

Build / 构建

python -m pytest -q
python -m build
python -m twine check dist/iatest_framework-1.0.4-py3-none-any.whl dist/iatest_framework-1.0.4.tar.gz

GitHub Release 触发既有发布工作流，在 Python 3.11–3.14 测试后构建 wheel/sdist，经 PyPI 环境审核和 Trusted Publishing 发布。Docker 真实运行需另行在具备 Docker 的环境验证。

Release validation / 发布验证

• Local regression: 380 passed.
• Cross-platform CI: Linux Python 3.11/3.14, macOS Python 3.14 and Windows Python 3.14.
• Wheel/sdist built successfully and passed twine check; packaged isolated worker verified.

IATest v1.0.3

Corrects the public license description to Apache-2.0. Install with: python -m pip install iatest-framework. The installed command remains iatest.

IATest v1.0.2

First PyPI publication of iatest-framework. Superseded by v1.0.3 to correct the README license label; the package metadata and bundled LICENSE in this release were already Apache-2.0.

IATest v1.0.1

Not published to PyPI. This release was superseded by v1.0.2 after CI found a Python 3.11 compatibility issue.

IATest 1.0.0

IATest 1.0.0 is the first stable release.

Highlights:

• Agent-based API discovery, case generation, result analysis, and multi-model quality auditing.
• Trusted contracts with deterministic case compilation and quality gates.
• Fixture integration and a configurable HTTP mock service with Web console controls.
• English, Simplified Chinese, Japanese, French, and Russian Web UI and artifact language controls.
• Batch case/report management, improved execution evidence, and hardened local storage.

Release assets include a universal Python wheel, source distribution, and SHA-256 checksums.

本版本为 IATest 首个稳定版，包含 Agent 工作流、可信契约、确定性用例编译、多模型质量审计、夹具与 Mock、多语言控制台及批量管理能力。