Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【Hackathon 6th Fundable Projects 3 No.374】fluid operator tdm_sampler #63707

Merged
merged 5 commits into from
Apr 24, 2024

Conversation

co63oc
Copy link
Contributor

@co63oc co63oc commented Apr 19, 2024

PR Category

Others

PR Types

Others

Description

Migrate fluid operator tdm_sampler

Copy link

paddle-bot bot commented Apr 19, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@paddle-bot paddle-bot bot added the contributor External developers label Apr 19, 2024
@co63oc co63oc marked this pull request as ready for review April 19, 2024 10:28
Copy link
Contributor

@wanghuancoder wanghuancoder left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 请 @luotao1 协调日升也Review一下~

Copy link
Contributor

@YuanRisheng YuanRisheng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

原先Fluid的sampler.h/cc也需要删掉

@co63oc
Copy link
Contributor Author

co63oc commented Apr 24, 2024

原先Fluid的sampler.h/cc也需要删掉

可能其他文件使用,比如paddle/fluid/distributed/index_dataset/index_sampler.h,其他算子迁移后再删除

@YuanRisheng
Copy link
Contributor

YuanRisheng commented Apr 24, 2024

原先Fluid的sampler.h/cc也需要删掉

可能其他文件使用,比如paddle/fluid/distributed/index_dataset/index_sampler.h,其他算子迁移后再删除

我看用的地方并不多,可以删掉,然后用到的地方全部改成调用phi下的sampler.h,尽量减少俩套相同代码的存在,减少维护成本

@co63oc
Copy link
Contributor Author

co63oc commented Apr 24, 2024

原先Fluid的sampler.h/cc也需要删掉

可能其他文件使用,比如paddle/fluid/distributed/index_dataset/index_sampler.h,其他算子迁移后再删除

我看用的地方并不多,可以删掉,然后用到的地方全部改成调用phi下的sampler.h,尽量减少俩套相同代码的存在,减少维护成本

不是修改sampler.h就可以,有关联的链接库,phi下的链接库不同

@YuanRisheng
Copy link
Contributor

原先Fluid的sampler.h/cc也需要删掉

可能其他文件使用,比如paddle/fluid/distributed/index_dataset/index_sampler.h,其他算子迁移后再删除

我看用的地方并不多,可以删掉,然后用到的地方全部改成调用phi下的sampler.h,尽量减少俩套相同代码的存在,减少维护成本

不是修改sampler.h就可以,有关联的链接库,phi下的链接库不同

这个应该不复杂吧,链库的话只需要链接一个phi target就可以了,如果说等其他算子迁移删除也行,那就必须优先搞一下, 不然如果拖的时间太长后边有人对sampler修改就容易造成逻辑不一致的问题了,因为后边改的人他未必会俩个地方都改

@co63oc
Copy link
Contributor Author

co63oc commented Apr 24, 2024

原先Fluid的sampler.h/cc也需要删掉

可能其他文件使用,比如paddle/fluid/distributed/index_dataset/index_sampler.h,其他算子迁移后再删除

我看用的地方并不多,可以删掉,然后用到的地方全部改成调用phi下的sampler.h,尽量减少俩套相同代码的存在,减少维护成本

不是修改sampler.h就可以,有关联的链接库,phi下的链接库不同

这个应该不复杂吧,链库的话只需要链接一个phi target就可以了,如果说等其他算子迁移删除也行,那就必须优先搞一下, 不然如果拖的时间太长后边有人对sampler修改就容易造成逻辑不一致的问题了,因为后边改的人他未必会俩个地方都改

好的,那等其他算子迁移修改

@luotao1 luotao1 merged commit 7230e5f into PaddlePaddle:develop Apr 24, 2024
28 of 29 checks passed
@co63oc co63oc deleted the fix_tdm_sampler branch April 27, 2024 22:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants