Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

individual feature importances should be optional #361

Closed
wants to merge 1 commit into from

Conversation

nanounanue
Copy link
Contributor

Not in all the experiments we want that, and it has problems with DummyClassifier (see #360).

This PR:
Individual feature importances is optional for ExperimentBase and for SingleThreadExperiment (Related (Fixes?)to #360). QUESTION: Someone knows how to add this to MultiCore?

SingleThreadExperiment (Related (Fixes?)to #360). QUESTION: Someone knows how to add this to MultiCore?
@thcrock
Copy link
Contributor

thcrock commented Dec 29, 2017

I would recommend doing this by giving the IndividualImportanceCalculator a blank set of methods instead of creating new code paths in the experiment subclasses.

https://github.com/dssg/triage/blob/master/src/triage/component/catwalk/individual_importance/__init__.py#L29

You can trigger this in a config file now by actually making the methods list an empty list, but I do agree that making this behavior default is preferable so the ExperimentBase could treat make empty list the default instead of ['uniform']

Copy link
Member

@jesteria jesteria left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This isn't a ton of new code, but I agree with @thcrock that a no-op / dummy / "uniform" calculator might be cleaner.

@nanounanue
Copy link
Contributor Author

HOLD this PR Inserting NULL in both tables as discussed in the tools meeting 01/18/2018

@thcrock
Copy link
Contributor

thcrock commented Feb 2, 2018

Duplicate of #379

@thcrock thcrock marked this as a duplicate of #379 Feb 2, 2018
@thcrock thcrock closed this Feb 2, 2018
thcrock pushed a commit that referenced this pull request Feb 8, 2018
* inserting null for indi. feature importance - #361
@nanounanue nanounanue deleted the dummy_classifier branch February 12, 2019 21:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants