Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FIX correct functional as labels in plot_reliability_diagram #125

Merged
merged 4 commits into from
Dec 5, 2023

Conversation

m-maggi
Copy link
Contributor

@m-maggi m-maggi commented Dec 1, 2023

Fixes #124

@m-maggi m-maggi changed the title FIX Instead of hardcoded labels: Define x and y labels in plots.py according to functional and level FIX Instead of hardcoded labels: define x and y labels in plots.py according to functional and level Dec 1, 2023
@@ -177,7 +178,7 @@
"│ str ┆ f64 ┆ u32 ┆ f64 ┆ f64 ┆ f64 │\n",
"╞══════════════════╪═══════════╪════════════╪══════════════╪═════════════╪══════════╡\n",
"│ linear_quant_reg ┆ 0.005 ┆ 200 ┆ 200.0 ┆ 0.030488 ┆ 0.869899 │\n",
"│ hgbt_quant_reg ┆ 0.0 ┆ 200 ┆ 200.0 ┆ 0.0306951.0 │\n",
"│ hgbt_quant_reg ┆ -0.025 ┆ 200 ┆ 200.0 ┆ 0.0316530.43057 │\n",
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm suprised to see a model change here. Maybe we should fix the random_state parameter of HGBT to some integer.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lorentzenchr thanks for spotting this. I looked at the random_state parameter and it seems to me that due to the small sample size the early stopping is disabled, hence it should not have an impact on the results.
I just tried to change environment and re-run the notebook with the code as of 0113d5a and got results almost identical to the version in the main branch (the table to which your comment refers to is exactly the same).

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As info: As written in the development doc, you can run hatch run jupyter:lab. This will create a virtual environment with all you need to run the notebooks, and run jupyter lab.

Copy link
Owner

@lorentzenchr lorentzenchr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
Just some nitpicks.

src/model_diagnostics/calibration/plots.py Outdated Show resolved Hide resolved
src/model_diagnostics/calibration/plots.py Outdated Show resolved Hide resolved
src/model_diagnostics/calibration/plots.py Outdated Show resolved Hide resolved
src/model_diagnostics/calibration/plots.py Outdated Show resolved Hide resolved
src/model_diagnostics/calibration/plots.py Outdated Show resolved Hide resolved
src/model_diagnostics/calibration/tests/test_plots.py Outdated Show resolved Hide resolved
src/model_diagnostics/calibration/tests/test_plots.py Outdated Show resolved Hide resolved
src/model_diagnostics/calibration/tests/test_plots.py Outdated Show resolved Hide resolved
src/model_diagnostics/calibration/tests/test_plots.py Outdated Show resolved Hide resolved
src/model_diagnostics/calibration/tests/test_plots.py Outdated Show resolved Hide resolved
@lorentzenchr lorentzenchr changed the title FIX Instead of hardcoded labels: define x and y labels in plots.py according to functional and level FIX correct functional as labels in plot_reliability_diagram Dec 5, 2023
@lorentzenchr lorentzenchr merged commit 37d43bc into lorentzenchr:main Dec 5, 2023
5 checks passed
@lorentzenchr
Copy link
Owner

@m-maggi Thanks for the fix.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Wrong axis labels on reliability diagrams for non-mean functionals
2 participants