Intro
The order of questions (parameters) is determined via their importance via XAI values. Since, XAI values are only defined for those who came from data pipeline and not instances of ParameterBuilderBase, our system never suggests these manual parameters.
Description
A logical fix would be to incorporate these manual parameters into the XAI values, and hence let the model itself suggest them as the next variables. The issue here is that invitation_letter and travel_history both have the highest XAI value, and are always the first questions. Also, since most of the people gonna response "none" to both of these questions, the chance will get low and stays low to the end. This is not interesting for the users.
Note: Other manual parameters such as occupation must be ordered by XAI value
Another fix is to add them at the end and since such behavior has to be independent of the XAI values, a separate function handling these manual parameters is required.
For implementation, vizard.xai.utils already contains methods that control the logical order (e.g., vizard.xai.utils.logical_order of suggested questions. We can add the aforementioned method for handling the order of manual parameters in the same module.
Intro
The order of questions (parameters) is determined via their importance via XAI values. Since, XAI values are only defined for those who came from data pipeline and not instances of
ParameterBuilderBase, our system never suggests these manual parameters.Description
A logical fix would be to incorporate these manual parameters into the XAI values, and hence let the model itself suggest them as the next variables. The issue here is that
invitation_letterandtravel_historyboth have the highest XAI value, and are always the first questions. Also, since most of the people gonna response"none"to both of these questions, the chance will get low and stays low to the end. This is not interesting for the users.Note: Other manual parameters such as
occupationmust be ordered by XAI valueAnother fix is to add them at the end and since such behavior has to be independent of the XAI values, a separate function handling these manual parameters is required.
For implementation,
vizard.xai.utilsalready contains methods that control the logical order (e.g.,vizard.xai.utils.logical_orderof suggested questions. We can add the aforementioned method for handling the order of manual parameters in the same module.