You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi @dpittner. Yeah, we have not supported dynamic executor allocation currently. We will add it support recently.
If you use spark on ray only, it should be easy to add the support. If you want to use spark on ray couple with estimator API, we should add the support of ray object ownership transfer.
What:
https://github.com/Intel-bigdata/oap-raydp/search?q=dynamic suggests that dynamic executor allocation may be added later.
Are there plans to add this, are there fundamental challenges in the ray context for supporting this?
The text was updated successfully, but these errors were encountered: