Skip to content

Conversation

@Dayuxiaoshui
Copy link
Contributor

  • Add parse_logs_to_data() function to directly parse log files without intermediate JSON
  • Update scan_all_folders() to automatically detect and handle log files
  • Support both Paddle (with subgraph) and PyTorch (without subgraph) samples
  • Update plot_ESt.py and plot_St.py help documentation
  • Remove dependency on log2json intermediate step for analysis workflow

PR Category

Description

Dayuxiaoshui and others added 2 commits November 12, 2025 15:49
- Add parse_logs_to_data() function to directly parse log files without intermediate JSON
- Update scan_all_folders() to automatically detect and handle log files
- Support both Paddle (with subgraph) and PyTorch (without subgraph) samples
- Update plot_ESt.py and plot_St.py help documentation
- Remove dependency on log2json intermediate step for analysis workflow
@paddle-bot
Copy link

paddle-bot bot commented Nov 12, 2025

Thanks for your contribution!

@JewelRoam
Copy link
Collaborator

JewelRoam commented Nov 12, 2025

当前的修改方式同时支持原有json和log解析,我先合入,后面需要更改:

  1. 增加多log解析->多曲线绘制
  2. 测试确认没问题后,去除整个log2json和analysis中对json的处理
  3. 删除注释或者代码中(如有)对log2json的引用,删除def parse_logs_to_data中不必要的单行注释
  4. 通过逻辑检查/不同错误类型的log用例测试,检查analysis_util的健壮性

以上1和2我也会参与。

@JewelRoam JewelRoam merged commit a7fd2e8 into PaddlePaddle:develop Nov 12, 2025
3 checks passed
JewelRoam added a commit that referenced this pull request Nov 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants