Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Qwen-CUA mascot holding a mouse pointer and keyboard

Qwen-CUA: Native Computer Use for (almost) Everything

A Qwen-based computer-use model and agent that sees screenshots,
reasons over visible state, and acts through native keyboard and mouse events.

arXiv Paper Demo License

Qwen-CUA results across eight computer-use benchmarks

Eight benchmark families, from desktop control and long-horizon work to web interaction and adversarial robustness. Click the figure for the technical report.

86.2
OSWorld-Verified
20 images / turn
active visual history
~100k vCPUs
rollout infrastructure

One model. One native interface. Almost any software.

Qwen-CUA operates from pixels rather than hidden application state. It receives the same visual evidence available to a person and produces actions in a shared keyboard-and-mouse space—without DOM trees, accessibility metadata, shell access, or task-specific APIs.

Qwen-CUA model Agent runtime
Understands screenshots and instructions, tracks progress, reasons about the visible interface, and proposes grounded native actions. Captures observations, manages multimodal history, validates and executes actions, requests approval, and preserves replay evidence.

Remember what matters

Long computer-use trajectories accumulate image-heavy context quickly. Qwen-CUA keeps a larger active visual history, then folds older screenshots in blocks so the agent can preserve task state while reusing a stable prefix.

Scaling active visual history to 20 screenshots

More visual memory
Twenty recent screenshots stay active.

Blockwise visual prefix folding for stable cache reuse

Stable long-horizon context
Blockwise folding bounds growth and improves prefix reuse.

Learn from verifiable experience

Qwen-CUA scales computer-use training along two axes: broader verifiable tasks and rollout capacity across model generations, followed by successive training runs in which the current policy exposes unresolved queries and weak domains. Those diagnostics refresh both the supervised data mixture and the verifiable RL task distribution before the next run.

Computer-use performance scaling with model generation, verifiable tasks, and rollout infrastructure

Scaling training resources
From 1k to 40k tasks and nearly 100k vCPUs.

Evaluation scores across successive Qwen-CUA training runs on OSWorld-Verified, OSWorld 2.0, and ScienceBoard

Successive training runs
SFT data and verifiable RL tasks are refreshed between runs.

Each SFT run starts from the same mid-training checkpoint instead of continually fine-tuning the previous agent checkpoint. The resulting SFT model recalibrates the RL pool with eight trial rollouts per task, retaining queries that are neither unreachable nor already saturated. Because teacher policies, data mixtures, domain coverage, and task distributions change between runs, the plotted lines connect development checkpoints rather than measuring controlled convergence or scaling.

Scale the model, scale the ceiling

The same computer-use recipe extends from Qwen-CUA (397B-A17B) to Qwen-CUA-Max (>1T). The larger model reaches 87.6 on OSWorld-Verified and improves both binary and partial-credit performance on OSWorld 2.0.

Qwen-CUA and Qwen-CUA-Max capacity scaling results

From benchmark to real workflows

Qwen-CUA is designed for the interaction loop users actually see: inspect the page, plan, act, recover when the interface changes, and verify the result.

Qwen computer-use agent operating in a Chrome side panel

The self-contained demo/ turns that loop into a local, browser-first reference agent:

Operator console Safety gates Replayable runs
Inspect screenshots, actions, approvals, and raw model responses. Pause sensitive actions and isolate every Playwright browser session. Save events, screenshots, downloads, and deterministic verification evidence.
git clone https://github.com/xlang-ai/Qwen-CUA.git
cd Qwen-CUA/demo
cp .env.example .env

Then follow the demo quick start to connect an OpenAI-compatible multimodal endpoint and launch the operator console.

Repository

Qwen-CUA/
├── paper/          # Technical report
├── demo/           # Runnable browser-agent reference implementation
├── assets/readme/  # Figures used in this overview
├── LICENSE
└── README.md

Note

This release contains the technical report and reference demo. Model weights are not included in the repository.

Citation

If you find Qwen-CUA useful in your work, please cite our technical report:

@misc{lu2026qwencuanativecomputeruse,
      title={Qwen-CUA: Native Computer Use for (almost) Everything},
      author={Dunjie Lu and Shuai Bai and Tianyi Bai and Sicheng Fan and Chang Gao and Jian Guan and Feng Hu and Mianqiu Huang and Xingyang Huang and Yizhen Jiang and Yuheng Jing and Dehui Kong and Ning Li and Dayiheng Liu and Shixuan Liu and Zheng Liu and Que Shen and Bowen Wang and Junli Wang and Chencan Wu and Rui Xie and Tianbao Xie and Zhihui Xie and Haiyang Xu and An Yang and Tao Yu and Wenzhen Yuan and Xi Zhang and Zhenru Zhang and Mingkang Zhu and Zhaoqing Zhu and Yizhong Cao and Kai Dang and Binyuan Hui and Kaixin Li and Junyang Lin and Haiquan Wang and Zekun Wang and Yiheng Xu and Fan Yan and Mengqi Yuan and Danyang Zhang and Jiajun Zhang and Zhipeng Zhang and Fan Zhou and Fan Zhou},
      year={2026},
      eprint={2608.02352},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2608.02352},
}

Safety

Computer-use agents can make mistakes, encounter prompt injection, and trigger consequential interface actions. Use isolated browser contexts, avoid authenticated or high-stakes workflows, and require human approval for sensitive operations. A model declaring success is not proof that the intended real-world outcome was achieved.

License

Apache-2.0. See LICENSE and NOTICE.

About

Qwen-CUA: Native Computer Use for (Almost) Everything — a screenshot-driven agent that operates computers with keyboard and mouse, jointly developed by the Qwen Team and XLang Lab.

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors