Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dashboard plots (fairness) - Use user performance metric #541

Open
michaelamoako opened this issue May 14, 2021 · 1 comment
Open

Dashboard plots (fairness) - Use user performance metric #541

michaelamoako opened this issue May 14, 2021 · 1 comment
Labels
enhancement New feature or request Fairness javascript Pull requests that update Javascript code

Comments

@michaelamoako
Copy link
Contributor

The Fairness dashboard currently shows selection rate and fpr/fnr for binary classification. It would be useful if instead of these, the displayed plot depended on the user's chosen metrics (i.e: if Recall is the chosen metric, the plot below should be for Recall)

@michaelamoako
Copy link
Contributor Author

michaelamoako commented May 15, 2021

The above is achievable without the dashboard using the following code (similar to @romanlutz, fairlearn/fairlearn#766):

A. metric_frame.by_group.plot(kind='pie', y='Count', figsize=[12,8])
B. metric_frame.by_group.plot(kind='bar', y='Recall', figsize=[12,8])

Where metric_frame is a MetricFrame that includes Recall and Count (defined by the user). I separate the plots because for Recall for example I would like a bar chart, while for Count I would like a Pie chart. If the same customizability could be added to the dashboard (instead of default selection rate, fpr/fnr) that would be very useful.

(Documentation here: https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.plot.html)

@romanlutz romanlutz added enhancement New feature or request Fairness javascript Pull requests that update Javascript code labels Dec 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Fairness javascript Pull requests that update Javascript code
Projects
None yet
Development

No branches or pull requests

2 participants