Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[App]: Charting is showing values across experiments & random seeds are the exact same #7082

Closed
reginald-mclean opened this issue Mar 1, 2024 · 3 comments
Labels
a:app Area: Frontend/Backend

Comments

@reginald-mclean
Copy link

Current Behavior

Hi! I am currently running some RL experiments. The charts shown for certain important metrics (ie mean episodic returns, success rates) are currently plotted as if they are exactly the same. The data is also logged via print statements and I can confirm that they are not the same. For example here is the mean episodic return at step 677500:

Seed 1: global_step=677500, mean_episodic_return=4830.2783203125
Seed 2: global_step=677500, mean_episodic_return=4825.92041015625

But the charts report the returns as the same:

Screenshot 2024-03-01 at 8 35 04 AM

Expected Behavior

No response

Steps To Reproduce

No response

Screenshots

No response

Environment

OS: Linux Server 20.0

Browsers: Firefox 123.0

Version: W&B 0.16.3

Additional Context

No response

@reginald-mclean reginald-mclean added the a:app Area: Frontend/Backend label Mar 1, 2024
@reginald-mclean
Copy link
Author

It even seems like it works correctly for the first few steps and then the values converge even though they shouldn't.

Screenshot 2024-03-01 at 9 02 12 AM

@reginald-mclean
Copy link
Author

I can also confirm that this occurs on Chrome and Safari on Mac. The experiments run on a remote linux machine, using the mac locally to view results.

@reginald-mclean
Copy link
Author

Sorry this was a bug on our end!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
a:app Area: Frontend/Backend
Projects
None yet
Development

No branches or pull requests

1 participant