Skip to content

add SwanLab Support 添加SwanLab可视化支持#453

Merged
Yunnglin merged 6 commits into
modelscope:mainfrom
ShaohonChen:integrate-swanlab
Apr 7, 2025
Merged

add SwanLab Support 添加SwanLab可视化支持#453
Yunnglin merged 6 commits into
modelscope:mainfrom
ShaohonChen:integrate-swanlab

Conversation

@ShaohonChen
Copy link
Copy Markdown
Contributor

贡献简介

希望为Evalscope项目增加SwanLab作为可视化支持之一,使用户能够更方便地跟踪和分析评测结果。

主要改动

  1. 新增SwanLab集成功能,支持将评测结果可视化

  2. 添加相关命令行参数和环境变量配置选项

  3. 更新文档说明SwanLab的使用方法

使用说明

安装SwanLab,并获取对应的API Key

pip install swanlab

在评测启动时,额外添加以下参数,即可将测试结果上传swanlab server并进行可视化:

# ...
--swanlab-api-key 'swanlab_api_key'
--name 'name_of_swanlab_log'

效果如下

Screenshot 2025-04-06 at 15 27 55 Screenshot 2025-04-06 at 16 03 27

效果对齐WandB:

Screenshot 2025-04-06 at 15 28 42

如果希望仅使用SwanLab本地看板模式,先安装swanlab离线看板:

pip install 'swanlab[dashboard]'

再通过设置如下参数:

--swanlab-api-key local

并通过swanlab watch <日志路径>打开本地可视化看板。

补充说明:

我看到此前文档中的图片都来自阿里云的对象存储,因此我将所有添加到文档中的图片标注为![swanlab example](waiting for link),如果合并的话烦请替换一下😊

@ShaohonChen
Copy link
Copy Markdown
Contributor Author

@Yunnglin 请帮忙审核一下PR!非常感谢😄

补充测试效果链接: https://swanlab.cn/@ShaohonChen/evalscope_swanlab_support/overview

@ShaohonChen
Copy link
Copy Markdown
Contributor Author

文档中的图片可以使用本PR提供的链接,也可以在上面的链接中截取

@Yunnglin
Copy link
Copy Markdown
Collaborator

Yunnglin commented Apr 7, 2025

@ShaohonChen Thank you for your PR. I have updated the image links and fixed the lint issues. It's now ready to be merged.

@Yunnglin Yunnglin merged commit 002b8fe into modelscope:main Apr 7, 2025
1 check passed
@ShaohonChen
Copy link
Copy Markdown
Contributor Author

Thank you for reviewing and merging the PR! 🎉

@mars171
Copy link
Copy Markdown

mars171 commented Apr 10, 2025

添加--swanlab-api-key后:
1:默认上传的是swanlab云平台,是否可以修改上传地址为私有化部署后的url;
2:目前pip安装最新版本,还未集成swanlab,会提示找不到-swanlab-api-key;

@ShaohonChen ShaohonChen deleted the integrate-swanlab branch May 9, 2025 06:40
yucc-leon pushed a commit to yucc-leon/evalscope that referenced this pull request Oct 27, 2025
* add SwanLab support

* add error message for missing swanlab/wandb package

* fix swanlab log dir error

* add swanlab docs

* update link

* fix lint

---------

Co-authored-by: Yunnglin <mao.looper@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants