Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【PIR Dist Op Reg No.11】 reg dgc_momentum #63013

Merged
merged 3 commits into from
Apr 7, 2024

Conversation

xiaoyewww
Copy link
Contributor

@xiaoyewww xiaoyewww commented Mar 25, 2024

PR Category

Execute Infrastructure

PR Types

Devs

Description

#60436
注册算子dgc_momentum

Copy link

paddle-bot bot commented Mar 25, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@paddle-bot paddle-bot bot added the contributor External developers label Mar 25, 2024
@luotao1 luotao1 added the HappyOpenSource 快乐开源活动issue与PR label Mar 26, 2024
kernel :
func : dgc_momentum
data_type : param
backward : divide_grad
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
backward : divide_grad

是否忘记删除了

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

多谢,已修改

@@ -818,6 +818,12 @@
outputs :
out : Out

- op : dgc_momentum
inputs :
{param : Param, grad : Grad, velocity : Velocity, learning_rate : LearningRate, master_param : MasterParam, float mu, bool use_nesterov, str regularization_method, float regularization_coeff, bool multi_precision, float rescale_grad, float rampup_begin_step}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
{param : Param, grad : Grad, velocity : Velocity, learning_rate : LearningRate, master_param : MasterParam, float mu, bool use_nesterov, str regularization_method, float regularization_coeff, bool multi_precision, float rescale_grad, float rampup_begin_step}
{param : Param, grad : Grad, velocity : Velocity, learning_rate : LearningRate, master_param : MasterParam}

op_compat里面只声明必要的映射就可以了,后面的没必要复制粘贴

args : (Tensor param, Tensor grad, Tensor velocity, Tensor learning_rate, Tensor master_param, Tensor current_step, Tensor nranks, float mu, bool use_nesterov=false, str regularization_method="", float regularization_coeff=0.0f, bool multi_precision=false, float rescale_grad=1.0f, float rampup_begin_step=-1.0f)
output : Tensor(param_out), Tensor(velocity_out), Tensor(master_param_out), Tensor(grad_out)
kernel :
func : dgc_momentum
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
func : dgc_momentum
func : dgc_momentum
param: [和kernel一致的参数顺序]

args的参数顺序是可以调整的,有时也是必要的。但是这个时候 kernel和infermeta中就需要指定一个和函数调用所需参数一致的顺序,可以参考 #61293 ,也遇到了类似问题。

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

多谢,但我这里好像是参数后面写错了,后面顺序是一致的

@xiaoyewww
Copy link
Contributor Author

@kangguangli 这里ci都过了,麻烦再review一下~

Copy link

paddle-ci-bot bot commented Apr 4, 2024

Sorry to inform you that d7923a9's CIs have passed for more than 7 days. To prevent PR conflicts, you need to re-run all CIs manually.

@kangguangli kangguangli merged commit 6d715a3 into PaddlePaddle:develop Apr 7, 2024
30 checks passed
co63oc pushed a commit to co63oc/Paddle that referenced this pull request Apr 9, 2024
* feat(pir): reg dgc_momentum

* feat(pir): reg dgc_momentum

* feat(pir): reg dgc_momentum
co63oc pushed a commit to co63oc/Paddle that referenced this pull request Apr 10, 2024
* feat(pir): reg dgc_momentum

* feat(pir): reg dgc_momentum

* feat(pir): reg dgc_momentum
@xiaoyewww xiaoyewww deleted the pir/dgc_momentum branch May 10, 2024 15:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contributor External developers HappyOpenSource 快乐开源活动issue与PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants