Learn where to Click from Yourself: On-Policy Self-Distillation for GUI Grounding

This is the official repository of the paper GUI-SD.

Yan Zhang, Daiqing Wu, Huawen Shen, Yu Zhou, Can Ma

News

2025/04/30

• We are the first to introduce on-policy self-distillation for GUI grounding.
• We release the code and training data.

Installation

conda create -n GUI-SD python=3.10 -y
conda activate GUI-SD
pip install -r requirements.txt

Training

sh ./GUI-SD_scripts/train.sh

Evaluate

sh ./GUI-SD_scripts/test.sh

Statement

This project is for research purpose only. For any other questions please contact zhangyan2022@iie.ac.cn.

Acknowledgements

Thanks for providiong open-source dataset ScaleCuA.