Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce shadow model training for inference attacks #1395

Merged
merged 17 commits into from
Nov 9, 2021

Conversation

beat-buesser
Copy link
Collaborator

Description

This pull request introduces shadow model training for inference attacks. This PR is a continuation of #1345 to adress review comments.

Type of change

Please check all relevant options.

  • Improvement (non-breaking)
  • Bug fix (non-breaking)
  • New feature (non-breaking)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

GalHorowitz and others added 14 commits September 12, 2021 15:31
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
…ts fit method

Signed-off-by: GalHorowitz <gal@galhorowitz.com>
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
…-robustness-toolbox into shadow_model_training

� Conflicts:
�	art/attacks/inference/membership_inference/black_box.py
�	art/estimators/classification/classifier.py
�	art/estimators/classification/scikitlearn.py
�	notebooks/README.md
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
Signed-off-by: GalHorowitz <gal@galhorowitz.com>
@beat-buesser beat-buesser self-assigned this Nov 4, 2021
@beat-buesser beat-buesser added the enhancement New feature or request label Nov 4, 2021
@beat-buesser beat-buesser added this to Pull request open in ART 1.9.0 via automation Nov 4, 2021
@beat-buesser beat-buesser added this to the ART 1.9.0 milestone Nov 4, 2021
@codecov-commenter
Copy link

codecov-commenter commented Nov 4, 2021

Codecov Report

Merging #1395 (48a59b0) into dev_1.9.0 (98627f8) will increase coverage by 0.13%.
The diff coverage is 90.54%.

Impacted file tree graph

@@              Coverage Diff              @@
##           dev_1.9.0    #1395      +/-   ##
=============================================
+ Coverage      90.43%   90.57%   +0.13%     
=============================================
  Files            232      233       +1     
  Lines          18885    19002     +117     
  Branches        3089     3111      +22     
=============================================
+ Hits           17079    17211     +132     
+ Misses          1042     1030      -12     
+ Partials         764      761       -3     
Impacted Files Coverage Δ
art/estimators/classification/catboost.py 91.30% <50.00%> (-4.16%) ⬇️
art/estimators/classification/classifier.py 96.49% <60.00%> (-3.51%) ⬇️
...ks/inference/membership_inference/shadow_models.py 90.56% <90.56%> (ø)
...attacks/inference/membership_inference/__init__.py 100.00% <100.00%> (ø)
...ttacks/inference/membership_inference/black_box.py 96.57% <100.00%> (+0.08%) ⬆️
art/defences/detector/evasion/detector.py 74.02% <100.00%> (+1.18%) ⬆️
...fences/detector/evasion/subsetscanning/detector.py 83.80% <100.00%> (+0.63%) ⬆️
...mators/certification/randomized_smoothing/numpy.py 87.09% <100.00%> (ø)
art/estimators/classification/GPy.py 89.09% <100.00%> (ø)
art/estimators/classification/blackbox.py 98.00% <100.00%> (ø)
... and 16 more

Beat Buesser and others added 3 commits November 4, 2021 11:51
Signed-off-by: Beat Buesser <beat.buesser@ie.ibm.com>
Signed-off-by: Beat Buesser <beat.buesser@ie.ibm.com>
@beat-buesser beat-buesser merged commit 1a8b1cf into dev_1.9.0 Nov 9, 2021
ART 1.9.0 automation moved this from Pull request open to Pull request done Nov 9, 2021
@beat-buesser beat-buesser deleted the shadow_model_training branch November 9, 2021 10:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
No open projects
ART 1.9.0
  
Pull request done
Development

Successfully merging this pull request may close these issues.

None yet

3 participants