Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PGD attack on multi-modal CLIP model #2340

Open
wants to merge 46 commits into
base: dev_1.18.0
Choose a base branch
from
Open

PGD attack on multi-modal CLIP model #2340

wants to merge 46 commits into from

Commits on Aug 28, 2023

  1. initial demo attack on clip 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    d37aa67 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. initial POC of attacking CLIP with ART tools 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    a1f3b6a View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. fix assignment with torch.no_grad 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    8bbb18e View commit details
    Browse the repository at this point in the history

  2. fix bug in which x.copy() required a deepcopy for the new hf input type 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    852229e View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. general updates 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    988d348 View commit details
    Browse the repository at this point in the history

  2. Rename of input, type hinting, function commenting 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    5483e81 View commit details
    Browse the repository at this point in the history

  3. initial adversarial training scripts 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    699527b View commit details
    Browse the repository at this point in the history

  4. adding initial notebook and cuda compatibility 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    c4b28a1 View commit details
    Browse the repository at this point in the history

  5. pylint and mypy edits 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    f04f132 View commit details
    Browse the repository at this point in the history

  6. refactor to experimental 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    f75ef03 View commit details
    Browse the repository at this point in the history

  7. run ci 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    f5774b5 View commit details
    Browse the repository at this point in the history

  8. commenting and formatting edits 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    9aa1365 View commit details
    Browse the repository at this point in the history

  9. move pgd changes to experimental 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    109905c View commit details
    Browse the repository at this point in the history

  10. restore orignal fgsm and pgd files 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    7589750 View commit details
    Browse the repository at this point in the history

  11. moving to experimental 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    b6f9cf0 View commit details
    Browse the repository at this point in the history

  12. moving labels to correct device, remove repeated code 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    4356c08 View commit details
    Browse the repository at this point in the history

  13. update notebook and formatting edits 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    95b6629 View commit details
    Browse the repository at this point in the history

  14. update tests 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    45616bd View commit details
    Browse the repository at this point in the history

  15. adding comments to mm_inputs 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    469f6bf View commit details
    Browse the repository at this point in the history

  16. remove old files and redundant changes 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    70f01cb View commit details
    Browse the repository at this point in the history

  17. moving functionality to experimental 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    3d2e075 View commit details
    Browse the repository at this point in the history

  18. re-add original test bash script 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    9241fea View commit details
    Browse the repository at this point in the history

  19. updated naming 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    19f6493 View commit details
    Browse the repository at this point in the history

  20. mypy fixes 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    09c8461 View commit details
    Browse the repository at this point in the history

  21. updating tests 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    a372550 View commit details
    Browse the repository at this point in the history

  22. fix spelling error 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    a084756 View commit details
    Browse the repository at this point in the history

  23. moving some tests to new script for estimator 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    5afe1e3 View commit details
    Browse the repository at this point in the history

  24. remove development files 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    d85b267 View commit details
    Browse the repository at this point in the history

  25. updates to tests 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    a6ccea1 View commit details
    Browse the repository at this point in the history

  26. consistancy in naming 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    9df9d14 View commit details
    Browse the repository at this point in the history

  27. remove feature branch in ci pipeline 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    4bb4139 View commit details
    Browse the repository at this point in the history

  28. mypy fixes 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    48391d1 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2023

  1. mypy fixes 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    0defd9d View commit details
    Browse the repository at this point in the history

  2. checking codeql error 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    0b5b773 View commit details
    Browse the repository at this point in the history

  3. Formatting fix. Check if deepcopy is the problem with codeQL 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    e8e4746 View commit details
    Browse the repository at this point in the history

  4. check sentinel fix 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    c7573ee View commit details
    Browse the repository at this point in the history

  5. refactor to address codeQL 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    8bbf92c View commit details
    Browse the repository at this point in the history

  6. refactor for codeQL 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    ae9a261 View commit details
    Browse the repository at this point in the history

  7. refactor for codeQL 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    455f31e View commit details
    Browse the repository at this point in the history

  8. refactor for codeQL 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    fc37e87 View commit details
    Browse the repository at this point in the history

  9. try sentinel fix 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    689777e View commit details
    Browse the repository at this point in the history

  10. refactor with setter method for codeQL 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    5a92140 View commit details
    Browse the repository at this point in the history

  11. refactor for codeQl fix 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    105c881 View commit details
    Browse the repository at this point in the history

  12. refactor for codeQl fix 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    31cbcca View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. explicitly removing random restarts as ART currently only supports re… 

    …starts for classical classification tasks

Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    ea35d39 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. updating notebook 

    Signed-off-by: GiulioZizzo <giulio.zizzo@yahoo.co.uk>
    @GiulioZizzo
    GiulioZizzo committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    6951923 View commit details
    Browse the repository at this point in the history