You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Complete the issue definition above, including the Time Estimate and Funding Source.
Fork this repository or create a branch of main_<Version>.
Branch name: bugfix_<Issue Number>_main_<Version>_<Description>
Fix the bug and test your changes.
Add/update log messages for easier debugging.
Add/update unit tests.
Add/update documentation.
Push local changes to GitHub.
Submit a pull request to merge into main_<Version>.
Pull request: bugfix <Issue Number> main_<Version> <Description>
Define the pull request metadata, as permissions allow.
Select: Reviewer(s) and Development issues
Select: Organization level software support Project for the current coordinated release
Select: Milestone as the next bugfix version
Iterate until the reviewer(s) accept and merge your changes.
Delete your fork or branch.
Complete the steps above to fix the bug on the develop branch.
Branch name: bugfix_<Issue Number>_develop_<Description>
Pull request: bugfix <Issue Number> develop <Description>
Select: Reviewer(s) and Development issues
Select: Repository level development cycle Project for the next official release
Select: Milestone as the next official version
Close this issue.
The text was updated successfully, but these errors were encountered:
The problem was in incorrect indexes in the final DataFrame. After concatenation the indexes were not reset and the roc_auc calculation was performed using wrong indexes.
After adding 'reset_index' roc_auc was calculated correctly. I also added 'reset_index' to other statistic calculations
* make sure that the parameters file is closed#306
* perform dataframe reindexing before statistic calculation #306
* add new test to test roc_auc #306
* initial version #306
* replace deprecated argument 'interpolation' to 'method' in percentile method #306
Describe the Problem
Aggregation statistic doesn't calculate correct values for PSTD_ROC_AUC statistic.
plot_20230512_203500.agg_stat.info.txt
plot_20230512_203500.data.agg_stat.txt
Expected Behavior
values should be like this:
RRFSE_CONUS_ICperts_nostoch.rrfs_conuscompact_3km_prob 160000 PSTD_ROC_AUC 0.954596669974263
RRFSE_CONUS_ICperts_nostoch.rrfs_conuscompact_3km_prob 170000 PSTD_ROC_AUC 0.951804745793181
RRFSE_CONUS_ICperts_nostoch.rrfs_conuscompact_3km_prob 180000 PSTD_ROC_AUC 0.952286333211654
RRFSE_CONUS_ICperts_nostoch.rrfs_conuscompact_3km_prob 190000 PSTD_ROC_AUC 0.950166505972019
RRFSE_CONUS_ICperts_stoch.rrfs_conuscompact_3km_prob 160000 PSTD_ROC_AUC 0.959631793570794
RRFSE_CONUS_ICperts_stoch.rrfs_conuscompact_3km_prob 170000 PSTD_ROC_AUC 0.959012367604244
RRFSE_CONUS_ICperts_stoch.rrfs_conuscompact_3km_prob 180000 PSTD_ROC_AUC 0.95513305325736
RRFSE_CONUS_ICperts_stoch.rrfs_conuscompact_3km_prob 190000 PSTD_ROC_AUC 0.950740286744192
Environment
Describe your runtime environment:
1. Machine: (e.g. HPC name, Linux Workstation, Mac Laptop)
2. OS: (e.g. RedHat Linux, MacOS)
3. Software version number(s)
To Reproduce
Describe the steps to reproduce the behavior:
1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error
Post relevant sample data following these instructions:
https://dtcenter.org/community-code/model-evaluation-tools-met/met-help-desk#ftp
Relevant Deadlines
List relevant project deadlines here or state NONE.
Funding Source
2771021
Define the Metadata
Assignee
Labels
Projects and Milestone
Define Related Issue(s)
Consider the impact to the other METplus components.
Bugfix Checklist
See the METplus Workflow for details.
Branch name:
bugfix_<Issue Number>_main_<Version>_<Description>
Pull request:
bugfix <Issue Number> main_<Version> <Description>
Select: Reviewer(s) and Development issues
Select: Organization level software support Project for the current coordinated release
Select: Milestone as the next bugfix version
Branch name:
bugfix_<Issue Number>_develop_<Description>
Pull request:
bugfix <Issue Number> develop <Description>
Select: Reviewer(s) and Development issues
Select: Repository level development cycle Project for the next official release
Select: Milestone as the next official version
The text was updated successfully, but these errors were encountered: