Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add adversarial laser beam attack and tests #1398

Merged

Conversation

mateuszGorczany
Copy link
Contributor

@mateuszGorczany mateuszGorczany commented Nov 10, 2021

Description

Please include a summary of the change, motivation and which issue is fixed. Any dependencies changes should also be included.

Fixes #1327

Type of change

Please check all relevant options.

  • Improvement (non-breaking)
  • Bug fix (non-breaking)
  • New feature (non-breaking)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

Testing

Please describe the tests that you ran to verify your changes. Consider listing any relevant details of your test configuration.

  • Test A
  • Test B

Test Configuration:

  • OS
  • Python version
  • ART version or commit number
  • TensorFlow / Keras / PyTorch / MXNet version

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes

@mateuszGorczany mateuszGorczany marked this pull request as draft November 10, 2021 01:30
@beat-buesser beat-buesser self-assigned this Nov 10, 2021
@beat-buesser beat-buesser changed the base branch from main to dev_1.9.0 November 10, 2021 10:12
@beat-buesser beat-buesser added the enhancement New feature or request label Nov 10, 2021
@beat-buesser beat-buesser added this to Pull request open in ART 1.9.0 via automation Nov 10, 2021
@beat-buesser beat-buesser added this to the ART 1.9.0 milestone Nov 10, 2021
@beat-buesser beat-buesser changed the title add laser attack implementation and tests add adversarial laser beam attack and tests Nov 10, 2021
@beat-buesser beat-buesser linked an issue Nov 10, 2021 that may be closed by this pull request
@codecov-commenter
Copy link

codecov-commenter commented Nov 10, 2021

Codecov Report

Merging #1398 (d9e791d) into dev_1.9.0 (3015edf) will decrease coverage by 0.40%.
The diff coverage is 80.85%.

Impacted file tree graph

@@              Coverage Diff              @@
##           dev_1.9.0    #1398      +/-   ##
=============================================
- Coverage      90.44%   90.03%   -0.41%     
=============================================
  Files            237      240       +3     
  Lines          19387    19669     +282     
  Branches        3438     3487      +49     
=============================================
+ Hits           17534    17709     +175     
- Misses          1074     1163      +89     
- Partials         779      797      +18     
Impacted Files Coverage Δ
art/attacks/evasion/laser_attack/algorithms.py 69.56% <69.56%> (ø)
art/attacks/evasion/laser_attack/laser_attack.py 78.94% <78.94%> (ø)
art/attacks/evasion/laser_attack/utils.py 84.92% <84.92%> (ø)
...poison_mitigation/neural_cleanse/neural_cleanse.py 54.05% <0.00%> (-32.44%) ⬇️
...timators/poison_mitigation/neural_cleanse/keras.py 84.50% <0.00%> (-9.16%) ⬇️
art/estimators/certification/abstain.py 90.90% <0.00%> (-9.10%) ⬇️
art/estimators/poison_mitigation/strip/strip.py 94.44% <0.00%> (-5.56%) ⬇️
art/defences/detector/poison/activation_defence.py 84.84% <0.00%> (-0.34%) ⬇️

Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
reformat files
return list of images in the LaserAttack generate function

Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
add new version of the notebook

Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
@mateuszGorczany mateuszGorczany force-pushed the development_issue_1327 branch 3 times, most recently from bd77786 to ff69bfb Compare December 13, 2021 15:15
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
…-robustness-toolbox into development_issue_1327

Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
rewrite exemplary notebook - use cifar10 model

Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
regenerate the notebook

Signed-off-by: mateuszGorczany <mateusz.g64@interia.pl>
Copy link
Collaborator

@beat-buesser beat-buesser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @mateuszGorczany Thank you very much for your first contribution to ART by implementing an evasion attack against image classifiers based on laser pointers that can easily be physically realised!

@beat-buesser beat-buesser merged commit e578d5b into Trusted-AI:dev_1.9.0 Dec 15, 2021
ART 1.9.0 automation moved this from Pull request review to Pull request done Dec 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
No open projects
ART 1.9.0
  
Pull request done
Development

Successfully merging this pull request may close these issues.

Implement Adversarial Laser Beam attack
3 participants