Skip to content

josephdviviano/saliency-red-herring

master
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 

saliency-red-herring

NB: I NEED TO UPDATE THIS README

installation:

conda env create -n activmask --file environment.yml

source install.sh.

training:

A config file needs to be defined to run the experiments, e.g.:

gradmask train --config gradmask/config/mnist.yml

monitoring:

The code right now will log all experiments in the logs/experiments.csv file. The time of saving, git hash, config, and best accuracy on the valid set is saved.

skopt

Steps to launch bayesian hyperparameters search:

  1. In your .yml config file, choose the parameters you want to optimize (i.e. learning rate).
  2. Replace the value with the search parameters. For example:
    # Optimizer
    optimizer:
      Adam:
        lr: "Real(10**-4, 10**-2, 'log-uniform')"
    
    search the learning rate in the range (0.01, 0.0001), on a log scale. Examples..
  3. Launch your config file with activmask train-skopt --config config/path.yml

An config example can be found in config/mnist_skopt.yml

About

Code for Saliency is a Possible Red Herring When Diagnosing Poor Generalization, Viviano et al ICLR 2021

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published