Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WeeklyReport] fxfxfxfxfxfxfxfx 2024.08.12.~2024.08.25 #354

Merged

Conversation

fxfxfxfxfxfxfxfx
Copy link
Contributor

注意: 请将周报 PR 按以下格式命名:

[WeeklyReport] USERNAME 2024.mm1.dd1~2024.mm2.dd2

@fxfxfxfxfxfxfxfx fxfxfxfxfxfxfxfx added the weekly reports weekly report commits from members label Aug 26, 2024
Copy link

@pkuzyc pkuzyc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

1. 将qwen2moe SparseMoEBlock改成自动并行版本
2. 编写单元测试

### 导师点评
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

尽量在不改动源代码逻辑下实现自动并行版本


1. 将qwen2moe SparseMoEBlock改成自动并行版本,尽量少改动原本的代码,最大化利用自动并行相关api的功能。

### 导师点评
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

熟悉代码中专家并行的实现原理和流程,有助于修改代码和排查问题

@sunzhongkai588 sunzhongkai588 merged commit 04bda06 into PFCCLab:main Oct 17, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
weekly reports weekly report commits from members
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants