-
Notifications
You must be signed in to change notification settings - Fork 5.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[tune] Add hook to get project/group for W&B integration #31035
Conversation
Signed-off-by: Nikita Vemuri <nikitavemuri@gmail.com>
Signed-off-by: Nikita Vemuri <nikitavemuri@gmail.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me. Should this also be included in setup_wandb()
?
Signed-off-by: Nikita Vemuri <nikitavemuri@gmail.com>
Signed-off-by: Nikita Vemuri <nikitavemuri@gmail.com>
Yes, good point. I updated |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a nit
python/ray/_private/test_utils.py
Outdated
os.environ["WANDB_PROJECT_NAME"] = "test_project" | ||
os.environ["WANDB_GROUP_NAME"] = "test_group" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we import WANDB_PROJECT_ENV_VAR
and WANDB_GROUP_ENV_VAR
here? (locally)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I was seeing a ModuleNotFoundError: No module named 'pandas'
error on the minimal install tests (https://buildkite.com/ray-project/oss-ci-build-pr/builds/7359#01850810-6f61-4017-82c0-f953782b0e9b) when I tried that previously because the test_utils
files was importing various files from tune
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does this happen also with local imports in the function?
Signed-off-by: Nikita Vemuri <nikitavemuri@gmail.com>
…#31035) - Allow setting the W&B project and group environment variables from an external hook if it is not already passed to the `WandbLoggerCallback` and `setup_wandb` - Add remaining external hooks to `setup_wandb` Signed-off-by: Nikita Vemuri <nikitavemuri@gmail.com> Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
- Allow setting the W&B project and group environment variables from an external hook if it is not already passed to the `WandbLoggerCallback` and `setup_wandb` - Add remaining external hooks to `setup_wandb` Signed-off-by: Nikita Vemuri <nikitavemuri@gmail.com>
…#31035) - Allow setting the W&B project and group environment variables from an external hook if it is not already passed to the `WandbLoggerCallback` and `setup_wandb` - Add remaining external hooks to `setup_wandb` Signed-off-by: Nikita Vemuri <nikitavemuri@gmail.com> Signed-off-by: tmynn <hovhannes.tamoyan@gmail.com>
Why are these changes needed?
WandbLoggerCallback
andsetup_wandb
setup_wandb
Related issue number
Checks
git commit -s
) in this PR.scripts/format.sh
to lint the changes in this PR.