Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not getting an expected output #21

Open
ShraddhaDevaiya opened this issue Aug 19, 2022 · 9 comments
Open

Not getting an expected output #21

ShraddhaDevaiya opened this issue Aug 19, 2022 · 9 comments

Comments

@ShraddhaDevaiya
Copy link

Hello, I am using the pyexplainer to explain the data regarding the bug report. following is my input data :

image

and the feature data is like this:

image

and for this pyexplainer is giving output like this:

image

which doesn't seem like an explanation. can you please suggest, am I missing anything?

@MichaelFu1998-create
Copy link
Collaborator

Hi @ShraddhaDevaiya,
I just tested the current version of the package and found no issues with the front-end components.
There could be a case where the "RuleFit" local model (it is used to generate rules which will be presented in the UI as explanations) used by pyexplainer could not generate rules for your input.
May I ask a few questions
(1) what kind of model did you try to explain?
(2) did you use default parameters when calling the "explain" function?

@ShraddhaDevaiya
Copy link
Author

Hello,

the random forest model you are asking, that only I tried to explain, and the explain function I am using like this :

rules = py_explainer.explain(X_explain=X_explain,
y_explain=y_explain,
search_function='crossoverinterpolation')

Did you ask this?

@MichaelFu1998-create
Copy link
Collaborator

Hi @ShraddhaDevaiya,
It looks alright to me.

Did you train your own RF model?
What is the approximate size of your training data?

@ShraddhaDevaiya
Copy link
Author

yes, I trained the RF model. and the training data size is only 10 items. so that could be the issue, means very less data to train the model?

@MichaelFu1998-create
Copy link
Collaborator

Hi @ShraddhaDevaiya ,
Yes, I think that could be the case.
We trained the RF model using around 9k data points in our original experiments.
However, I'm not sure how much data should be to train the model.
You may grab more data and try if it works.

Also, I find that the current version of pyexplainer can be improved,
the UI should tell the user in the case that the rules can't be generated,
otherwise, it would be confusing like what you've just encountered.
Thanks for opening this issue, I'll improve the UI accordingly.

@ShraddhaDevaiya
Copy link
Author

Thanks for helping. Let me check with the more number of training data.

@MichaelFu1998-create
Copy link
Collaborator

Okay, I'll leave this open for a while then
If you still have any concerns, feel free to comment here.

@ShraddhaDevaiya
Copy link
Author

sure, thanks !

@ShraddhaDevaiya
Copy link
Author

Hello @MichaelFu1998-create , I have tried with 2k data inputs for training, but still it is giving the same kind of output. It is not showing any explanation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants