Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Have to use generators when returning from _deploy_ray_func remote function. #7004

Closed
arunjose696 opened this issue Mar 4, 2024 · 0 comments · Fixed by #7005
Closed

Have to use generators when returning from _deploy_ray_func remote function. #7004

arunjose696 opened this issue Mar 4, 2024 · 0 comments · Fixed by #7005
Labels
new feature/request 💬 Requests and pull requests for new features Performance 🚀 Performance related issues and pull requests. Ray ⚡ Issues related to the Ray engine

Comments

@arunjose696
Copy link
Collaborator

Using generators to reduce heap memory usage in remote functions.

The function _deploy_ray_func currently returns a list, this can be replaced to return generators which is ray pattern suggested to reduce memory usage.

Note:This isssue is a subtask of #5524
@arunjose696 arunjose696 mentioned this issue Mar 4, 2024
Merged
7 tasks
@anmyachev anmyachev added Ray ⚡ Issues related to the Ray engine new feature/request 💬 Requests and pull requests for new features Performance 🚀 Performance related issues and pull requests. labels Mar 7, 2024
YarShev pushed a commit that referenced this issue Mar 13, 2024
@arunjose696
FEAT-#7004: use generators when returning from _deploy_ray_func remot…
eb740b9 
…e function. (#7005)

Signed-off-by: arunjose696 <arunjose696@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
new feature/request 💬 Requests and pull requests for new features Performance 🚀 Performance related issues and pull requests. Ray ⚡ Issues related to the Ray engine
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

FEAT-#7004: use generators when returning from _deploy_ray_func remote function. arunjose696/modin
2 participants
@arunjose696 @anmyachev