Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

More sklearn-compatible algorithms #318

Merged
merged 88 commits into from
Jul 1, 2022
Merged

More sklearn-compatible algorithms #318

merged 88 commits into from
Jul 1, 2022

Commits on Dec 19, 2019

  1. Initial sklearn-compatible datasets and metrics

    @hoffmansc
    Samuel Hoffman authored and hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    8cfa9de View commit details
    Browse the repository at this point in the history

  2. added initial dataset tests

    @hoffmansc
    Samuel Hoffman authored and hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    1f4ae57 View commit details
    Browse the repository at this point in the history

  3. fixed to_list for older pandas versions

    @hoffmansc
    Samuel Hoffman authored and hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    2aef3fc View commit details
    Browse the repository at this point in the history

  4. added metrics tests

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    2b1799a View commit details
    Browse the repository at this point in the history

  5. added README and docs

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    9da5abd View commit details
    Browse the repository at this point in the history

  6. simpler dataset loading and 'groups' for metrics 

    * dataset loading is more similar to sklearn.datasets
* label binarization is now done outside standardize_dataset
* metrics use 'groups' and 'priv_group' to signify priv/unpriv split
    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    025ecc1 View commit details
    Browse the repository at this point in the history

  7. fixes to categoricals

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    8e96177 View commit details
    Browse the repository at this point in the history

  8. fixes for tests, updated README

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    8abb897 View commit details
    Browse the repository at this point in the history

  9. added travis badge to README

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    15a8eb2 View commit details
    Browse the repository at this point in the history

  10. updated todo with external blockers

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    3f594a4 View commit details
    Browse the repository at this point in the history

  11. added reweighing workaround to example

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    7754b32 View commit details
    Browse the repository at this point in the history

  12. added Reweighing algorithm

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    17b0c95 View commit details
    Browse the repository at this point in the history

  13. clean up comments

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    cc9246f View commit details
    Browse the repository at this point in the history

  14. fixed package version in docs

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    8c58f65 View commit details
    Browse the repository at this point in the history

  15. adding hyperlinks to SLEPs

    @animeshsingh @hoffmansc
    animeshsingh authored and hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    1e7899c View commit details
    Browse the repository at this point in the history

  16. added binary_age opt to german; fixed NAs in bank

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    c1c1e40 View commit details
    Browse the repository at this point in the history

  17. modified onehot_transformer to return DataFrame

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    93a7cdf View commit details
    Browse the repository at this point in the history

  18. tweaks to reweighing to conform with sklearn

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    8e52268 View commit details
    Browse the repository at this point in the history

  19. updated README

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    0183449 View commit details
    Browse the repository at this point in the history

  20. fixed docstring formatting

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    89b4a79 View commit details
    Browse the repository at this point in the history

  21. changed metrics to use prot_attr

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    d57b6df View commit details
    Browse the repository at this point in the history

  22. added __all__ to __init__s

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    d8958bb View commit details
    Browse the repository at this point in the history

  23. updated notebook with reweighing example

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    0bd3837 View commit details
    Browse the repository at this point in the history

  24. initial adversarial debiasing port

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    4107dd7 View commit details
    Browse the repository at this point in the history

  25. multiclass/multigroup support for adv debiasing

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    df85e42 View commit details
    Browse the repository at this point in the history

  26. fix build errors

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    d2d0ddc View commit details
    Browse the repository at this point in the history

  27. Add ensure_binary option to check_groups

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    7a2414a View commit details
    Browse the repository at this point in the history

  28. numeric_only converts index and label as well

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    aac9954 View commit details
    Browse the repository at this point in the history

  29. changed Reweighing to return X, sample_weight 

    removed Reweighing.sample_weight_ attribute
    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    dc317cf View commit details
    Browse the repository at this point in the history

  30. made sample_weight optional in check_inputs

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    0f184c3 View commit details
    Browse the repository at this point in the history

  31. matched tests to new numeric dataset format

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    ec4a1de View commit details
    Browse the repository at this point in the history

  32. added generalized_fnr/fpr metrics 

    also added warning when dividing by zero in ratio
    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    f8c4fc5 View commit details
    Browse the repository at this point in the history

  33. fixed dataset_processing 

    changed bank dataset target to return bool
    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    7ce2f42 View commit details
    Browse the repository at this point in the history

  34. initial calibrated equalized odds port 

    bug fix in old implementation (weighted cost was calculated incorrectly)
    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    973a774 View commit details
    Browse the repository at this point in the history

  35. fixed adversarial debiasing reproducibility

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    40cad96 View commit details
    Browse the repository at this point in the history

  36. updated Getting Started notebook

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    dc410a2 View commit details
    Browse the repository at this point in the history

  37. updated readme

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    e0856e3 View commit details
    Browse the repository at this point in the history

  38. fixed tests and added additional tests

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    8f8cd76 View commit details
    Browse the repository at this point in the history

  39. added COMPAS and other dataset fixes* fixed german dataset to match p… 

    …aper* added ColumnAlreadyDroppedWarnings in standardize_dataset* added compas test and fixed old tests to match new drop warnings
    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    e01f23f View commit details
    Browse the repository at this point in the history

  40. fix more edge cases in metrics

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    e92f846 View commit details
    Browse the repository at this point in the history

  41. removed unused import

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    27aa55c View commit details
    Browse the repository at this point in the history

  42. make cache dir if necessary

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    831775c View commit details
    Browse the repository at this point in the history

  43. docstring, formatting, and typo fixes

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    a0e56b0 View commit details
    Browse the repository at this point in the history

  44. more gitignores

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    0e48ead View commit details
    Browse the repository at this point in the history

  45. docstrings and add alpha=sqrt(global_step) option

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    0cbc3f4 View commit details
    Browse the repository at this point in the history

  46. docstrings and input is now predict_proba output 

    also added score function (compute weighted cost)
    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    8be6449 View commit details
    Browse the repository at this point in the history

  47. moved tests to main test folder

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    994bdf0 View commit details
    Browse the repository at this point in the history

  48. more docs and formatting changes

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    372e111 View commit details
    Browse the repository at this point in the history

  49. postprocessor takes DataFrame if use_proba 

    added additional tests to check this
    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    8d10893 View commit details
    Browse the repository at this point in the history

  50. readme changes overwritten in the merge

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    e0ff2b6 View commit details
    Browse the repository at this point in the history

  51. train, test were swapped for adult

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    a2cd77e View commit details
    Browse the repository at this point in the history

  52. remove branch mentions

    @hoffmansc
    hoffmansc committed Dec 19, 2019
    Configuration menu
    Copy the full SHA
    ee7f23c View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2019

  1. remove "attributes" line if none present

    @hoffmansc
    hoffmansc committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    c8154ec View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2019

  1. moved example to main folder

    @hoffmansc
    hoffmansc committed Dec 28, 2019
    Configuration menu
    Copy the full SHA
    7ef94e7 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2020

  1. use_proba -> needs_proba

    @hoffmansc
    hoffmansc committed Jan 31, 2020
    Configuration menu
    Copy the full SHA
    c5af647 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2020

  1. fixed/renamed/reordered/added some attributes 

    * fixed German 'age' from being dropped
* renamed two_year_recid labels to 'Survived' and 'Recidivated' to match ProPublica article
* reordered COMPAS categories to 'Male' < 'Female'
* added 'foreign_worker' protected attribute for German
    @hoffmansc
    hoffmansc committed Feb 5, 2020
    Configuration menu
    Copy the full SHA
    042bb12 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2020

  1. fixed sample_weight=None bug and classes_ typo

    @hoffmansc
    hoffmansc committed Feb 6, 2020
    Configuration menu
    Copy the full SHA
    ff9e70c View commit details
    Browse the repository at this point in the history

  2. improved specificity_score and added fpr/fnr error

    @hoffmansc
    hoffmansc committed Feb 6, 2020
    Configuration menu
    Copy the full SHA
    57b2ab5 View commit details
    Browse the repository at this point in the history

  3. made foreign_worker and education (bank) ordered

    @hoffmansc
    hoffmansc committed Feb 6, 2020
    Configuration menu
    Copy the full SHA
    8fdd6dc View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2020

  1. various fixes to address PR comments 

    * added one-hot encoding example and random_states to demo notebook
* added 'prefit' option to PostProcessingMeta
* multiple fixes to docstring wordings
* added additional links/disclaimers in docstrings
* renamed CalibratedEqualizedOdds args to X and y
    @hoffmansc
    hoffmansc committed Feb 19, 2020
    Configuration menu
    Copy the full SHA
    2cf455f View commit details
    Browse the repository at this point in the history

  2. added comments to tests

    @hoffmansc
    hoffmansc committed Feb 19, 2020
    Configuration menu
    Copy the full SHA
    789e96b View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2020

  1. initial ROC and LFR + other WIP

    @hoffmansc
    hoffmansc committed Apr 22, 2020
    Configuration menu
    Copy the full SHA
    9867938 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2020

  1. Merge branch 'master' into sklearn-compat

    Samuel Hoffman committed Jun 3, 2020
    Configuration menu
    Copy the full SHA
    478e9a9 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2020

  1. Merge branch 'sklearn-compat' of https://github.com/IBM/AIF360 into s… 

    …klearn-compat
    @hoffmansc
    hoffmansc committed Jun 18, 2020
    Configuration menu
    Copy the full SHA
    e75f1a0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into sklearn-compat

    @hoffmansc
    hoffmansc committed Jun 18, 2020
    Configuration menu
    Copy the full SHA
    35d49e5 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2020

  1. allow prot_attr/target input to be Series

    @hoffmansc
    hoffmansc committed Jul 27, 2020
    Configuration menu
    Copy the full SHA
    f09b941 View commit details
    Browse the repository at this point in the history

  2. default to predict if no predict_proba

    @hoffmansc
    hoffmansc committed Jul 27, 2020
    Configuration menu
    Copy the full SHA
    2d8cdf1 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into sklearn-compat

    @hoffmansc
    hoffmansc committed Jul 27, 2020
    Configuration menu
    Copy the full SHA
    cab9bb9 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2020

  1. matches old lfr

    @hoffmansc
    hoffmansc committed Jul 31, 2020
    Configuration menu
    Copy the full SHA
    351259b View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2020

  1. use pytorch to calculate grad

    @hoffmansc
    hoffmansc committed Aug 5, 2020
    Configuration menu
    Copy the full SHA
    f08cf7d View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2021

  1. standardize defaults in metaestimators 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    1fdb02e View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2022

  1. clean up tests 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    debae37 View commit details
    Browse the repository at this point in the history

  2. ROC improvements 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    c46affb View commit details
    Browse the repository at this point in the history

  3. minor tweaks 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    3018660 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into sklearn-compat

    @hoffmansc
    hoffmansc committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    532d83d View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2022

  1. infer proba behavior from estimator tag 

    * postprocessors need 'requires_proba' tag
* no default postprocessor
* fix prefit, score PostProcessingMeta bugs

Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    c61728f View commit details
    Browse the repository at this point in the history

  2. rename LFR 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    ad69dc4 View commit details
    Browse the repository at this point in the history

  3. use scores instead of costs (higher is better) 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    0c7fe69 View commit details
    Browse the repository at this point in the history

  4. fix test imports 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    16d800e View commit details
    Browse the repository at this point in the history

  5. add new algorithms to docs 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    78ece3e View commit details
    Browse the repository at this point in the history

  6. suppress zero division warnings 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    2918d36 View commit details
    Browse the repository at this point in the history

  7. new notebooks 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    6a710d0 View commit details
    Browse the repository at this point in the history

  8. adjust tests 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    01090f9 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2022

  1. small fixes 

    * add fit_predict
* add sample_weight warning

Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    35c3e2d View commit details
    Browse the repository at this point in the history

  2. fix tests 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    f978b5f View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2022

  1. additional checks and errors 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jul 1, 2022
    Configuration menu
    Copy the full SHA
    304586a View commit details
    Browse the repository at this point in the history

  2. add note to notebook 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jul 1, 2022
    Configuration menu
    Copy the full SHA
    2effc0b View commit details
    Browse the repository at this point in the history

  3. propagate classes_ in metaestimators 

    Signed-off-by: Samuel Hoffman <hoffman.sc@gmail.com>
    @hoffmansc
    hoffmansc committed Jul 1, 2022
    Configuration menu
    Copy the full SHA
    35f87a7 View commit details
    Browse the repository at this point in the history