Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration method for time-dependent measures #9

Closed
mikolajsp opened this issue Oct 19, 2022 · 1 comment · Fixed by #20
Closed

Integration method for time-dependent measures #9

mikolajsp opened this issue Oct 19, 2022 · 1 comment · Fixed by #20
Labels
feature 💡 New feature or request

Comments

@mikolajsp
Copy link
Collaborator

At this time, for calculation of Integrated Brier Score and Integrated AUC is performed as Riemann integral. This leads to a great influence of times at the end of the considered time-frame (where there might be few observations) on the integrated score.

Two proposed normalization methods are in [1]. We should try to implement (one of/both of) these methods.

There should also be a possibility to cut off the integration at different quantiles of times in the data (Q25, Q50, Q75) [2]

@mikolajsp mikolajsp added the feature 💡 New feature or request label Oct 19, 2022
@hbaniecki
Copy link
Member

Also, later use it to update the choice of max_vars in feature importance.

subs <- aggregate(plotting_df$value, by = list(var = plotting_df$ind), function(x) sum(abs(x)))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature 💡 New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants