From 253d8ad1fd2968408cdfa2a37691ec3c4cf54b64 Mon Sep 17 00:00:00 2001 From: andsonder Date: Tue, 24 Oct 2023 20:05:05 +0800 Subject: [PATCH 1/4] create meetup files --- .../README.md | 4 ++++ .../[Meetup Record]2023.10.13.md | 2 ++ 2 files changed, 6 insertions(+) create mode 100644 Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/README.md create mode 100644 Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md diff --git a/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/README.md b/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/README.md new file mode 100644 index 00000000..2a172f76 --- /dev/null +++ b/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/README.md @@ -0,0 +1,4 @@ +## 🚀 本目录用于「静态图半自动并行执行架构升级」集训营项目会议记录 + +- 👨‍💻 学员: [AndSonder](https://github.com/AndSonder) +- 👦🏻​ 导师: [From00](https://github.com/From00) \ No newline at end of file diff --git a/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md b/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md new file mode 100644 index 00000000..b5c59565 --- /dev/null +++ b/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md @@ -0,0 +1,2 @@ +# 2023.10.13 meeting + From 23a4364c3bca7057dc8e5a5d74c9acf87b7bd09f Mon Sep 17 00:00:00 2001 From: andsonder Date: Tue, 24 Oct 2023 20:20:00 +0800 Subject: [PATCH 2/4] add [Meetup Record] AndSonder 2023.10.13.md --- .../[Meetup Record]2023.10.13.md | 33 +++++++++++++++++++ 1 file changed, 33 insertions(+) diff --git a/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md b/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md index b5c59565..659fe92f 100644 --- a/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md +++ b/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md @@ -1,2 +1,35 @@ # 2023.10.13 meeting +- 主题：可视化流水线并行时序图设计文档讨论 + +- 时间：2023.10.13 14:40 + +- 与会人员： + 1. AndSonder + 2. From00 + +## 主要进展 + +- 完成了可视化静态图自动并行时序图设计文档的初稿 + +## 方案设计探讨 + +1. 如何准确的记录Job开始和结束的时间 + +由于Run里面的Op是多线程执行的，输出 job 结束时，在 Run 里启动的 op 可能还没有执行完毕。经讨论，决定在 Job 开始执行的时候使用 cudaEventRecord 记录开始时间，而在 Job 结束的时候使用 cudaEventRecord 记录结束时间。由于 cudaEvent 是和流绑定的，所以需要在每个流上都记录开始和结束时间。最后取所有流中最早的开始时间和最晚的结束时间作为 Job 的开始和结束时间。 + +2. cudaEvent 只能获取到 GPU 的时间，如何获取 CPU 的时间 + +由于 cudaEvent 只能获取到 GPU 的时间，故在给每个流插入开始的 cudaEvent 的时候，同时也插入一个 CPU 的时间记录。最后用 GPU 上的运行时间加上 CPU 上开始的时间，就可以得到 Job 的运行区间了。 + +3. 采用离线生成log还是在线生成log + +由于在线生成log需要考虑线程通信等问题，故决定采用离线生成log的方式。即生成log文件，然后用python脚本解析log文件，生成时序图。 + +4. 日志信息设置 + +日志信息需要包含特殊标记避免在后续解析时错误解析到其他不相关日志。 + + + + From 659ba18929ebd07743c0656ad79f88701db8078c Mon Sep 17 00:00:00 2001 From: andsonder Date: Tue, 24 Oct 2023 20:21:36 +0800 Subject: [PATCH 3/4] update [Meetup Record] AndSonder 2023.10.13.md --- .../[Meetup Record]2023.10.13.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md b/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md index 659fe92f..ad2e7657 100644 --- a/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md +++ b/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md @@ -30,6 +30,9 @@ 日志信息需要包含特殊标记避免在后续解析时错误解析到其他不相关日志。 +## 下一步任务 +1. 编码实现上述方案 +2. 完善文档 From e5a1ddde8e0fdbce79600bf4472f00483cfa12ce Mon Sep 17 00:00:00 2001 From: Lu Qi <61354321+MarioLulab@users.noreply.github.com> Date: Thu, 26 Oct 2023 14:19:58 +0800 Subject: [PATCH 4/4] Rename [Meetup Record]2023.10.13.md to [MeetupRecord]2023.10.13.md --- .../{[Meetup Record]2023.10.13.md => [MeetupRecord]2023.10.13.md} | 0 1 file changed, 0 insertions(+), 0 deletions(-) rename Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/{[Meetup Record]2023.10.13.md => [MeetupRecord]2023.10.13.md} (100%) diff --git a/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md b/Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[MeetupRecord]2023.10.13.md similarity index 100% rename from Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[Meetup Record]2023.10.13.md rename to Meetup/10_StaticGraph_Semi-AutomaticParallelExecutionFrameworkUpgrade/[MeetupRecord]2023.10.13.md