Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Qini score larger than 1 or smaller than 0 #577

Closed
Leo-T-Zang opened this issue Nov 16, 2022 · 2 comments
Closed

Qini score larger than 1 or smaller than 0 #577

Leo-T-Zang opened this issue Nov 16, 2022 · 2 comments
Labels
question Further information is requested

Comments

@Leo-T-Zang
Copy link

Hi,

When I compute the qini score of meta learners, sometimes I get Qini larger than 1 (like 12) and sometimes smaller than 0 (like -0.4). Based on my understanding, qini score should be within the interval of 0 and 1.

Is this a bug? If not, could you please tell me how to explain such values?

Thanks.

@Leo-T-Zang Leo-T-Zang added the bug Something isn't working label Nov 16, 2022
@vincewu51
Copy link
Collaborator

Without normalization, Qini score can be larger than 1. If model is worse than random, it can be less than 0.

(Qini score: the area between the Qini curves of a model and random.
For details, see Radcliffe (2007), Using Control Group to Target on Predicted Lift: Building and Assessing Uplift Models)

@vincewu51 vincewu51 added question Further information is requested and removed bug Something isn't working labels Aug 19, 2023
@vincewu51
Copy link
Collaborator

Close for now. Feel free to re-open is needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants