Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Selection slider for parallel coordinates #7445

Closed
yermandy opened this issue Apr 22, 2024 · 6 comments
Closed

[Feature]: Selection slider for parallel coordinates #7445

yermandy opened this issue Apr 22, 2024 · 6 comments

Comments

@yermandy
Copy link

Description

Hello, I stumbled across a feature that is present in the Optuna's parallel coordinate plot. Namely, you can specify (select) which parallel coordinates you want to highlight. I found the feature super useful as it signifies which coordinates (and runs) led to the expected results.

Examples

Unselected:

Screenshot 2024-04-22 at 15 03 26

Selected objective

Screenshot 2024-04-22 at 15 04 33

Selected objective + some parameter

Screenshot 2024-04-22 at 15 04 55

In W&B:

I am sweeping over some hyperparameters and I would like to see which parallel coordinates led to the best results. When there are more runs, I can barely see what is going on there and what I should select.

Screenshot 2024-04-22 at 15 06 29

For now, I am filtering runs by selecting fitness to be more than some constant but this solution is not ideal as I miss some information (cases where the model performs worse).

Suggested Solution

You can see the functionality here

Alternatives

No response

Additional Context

No response

@umakrishnaswamy
Copy link
Contributor

hey @yermandy - I attached a short video for how you can accomplish this by selecting the parallel coordinates you want to highlight, which automatically performs a filter. Would this satisfy the feature request? or is there additional functionality you'd like to include? thank you so much!

video: https://github.com/wandb/wandb/assets/63944839/668b3ded-43af-43ac-a215-31c10d1a7c32

@yermandy
Copy link
Author

@umakrishnaswamy wow, this is incredible, exactly what I am looking for! Besides the fact, that it has some small bug somewhere.

Here, for instance, it does not remove runs with alpha out of selected range, it is a perfect feature.

Screenshot 2024-04-23 at 7 29 24

A very good feature is that I can also select a region in a scatter plot and it will automatically filter parallel coordinates. But again, there is a bug somewhere with proper filtering

Screen.Recording.2024-04-23.at.7.32.46.mov

Thank you!

@yermandy
Copy link
Author

I am very sorry, it is not a bug precisely. I realized that I had some manually selected runs (👁️) in the left pane. If I hide everything (visualize none), it works as expected. Thank you very much, it is very helpful!

Screen.Recording.2024-04-23.at.8.00.43.mov

@yermandy
Copy link
Author

Here is my workflow (for future generations):

Screen.Recording.2024-04-23.at.8.03.41.mov

@yermandy
Copy link
Author

A small question @umakrishnaswamy, has it already been implemented and I missed it or you have just added that?

@umakrishnaswamy
Copy link
Contributor

hey @yermandy - this was already implemented, and thanks again for the level of detail you've provided!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants