Plugins for Neural Network Console (English/日本語)

What is the plugins for Neural Network Console ?

The plugins enable pre-processing and post-processing on Neural Network Console. There are already plugins on Neural Network Console, but you can use the latest release of the pulings from this repository.

Current lineup of the plugins

Dataset

• Fairness
  • Demographic Parity Difference
  • Disparate Impact

Pre-processing

• Create dataset
  • Object detection (from Yolo v2 format)
  • Object detection (for CenterNet from Yolo v2 format)
  • Simple (Japanese) text classification
  • String classification
  • Simple tabular data
  • Split image
  • Split wav

Post-processing

• Utils

  • Cross tabulation
  • CSV to wav
  • Inference
  • Parameter stats
  • Restore split images / wav
  • Similar words
  • Simple (Japanese) text generation
  • tSNE

• Visualization

  • Scatter plot
  • Tile images

• eXplainable AI (XAI)

  • Attention Editor
  • SGD influence
  • Influence Functions
  • Face evaluation
  • Grad-CAM
  • LIME
  • SHAP
  • Smooth Grad
  • TracIn
  • RepresenterPoint
  • Attention Map Visualization

• Fairness

  • CV Score
  • Demogrphic Parity
  • Disparate Impact
  • Equal Opportunity
  • Equalised Odds
  • Theil Index
  • Reweighing

How to use the latest plugins

The plugins run on Neural Network Console. If you do not have Neural Network Console, please download from here (https://dl.sony.com/).

1. Download the zip files from this repository.
2. Extract the zip files on your PC.
3. Delete the existing plugins folder. You can find it from neural_network_console > libs > plugins.

• NOTE If you do not want to turn off some plugins, please leave them.

4. Put the downloaded plugins folders in the same place, neural_network_console > libs > plugins.
5. Restart Neural Network Console.

Pre-processing

• To execute the plugins of the pre-processing, select the "DATASET" on the left of the top screen. Then click "Create Dataset", you can select the plugins of the pre-processing.

Post-processing

• To execute the plugins of the post-processing, right-click the evaluation results on the Evaluation tab to open a shortcut menu and select the plugins.

Sample projects

XAI

• Attention branch network resnet110-attention-branch-network.sdcproj
• TracIn resnet56-tracin.sdcproj
• RepresenterPoint vgg16-representer-point.sdcproj

Fairness

• Prejudice Remover Regularizer prejudice_remover_regularizer.sdcproj

How to use the latest sample projects

The sample projects run on Neural Network Console.

1. Download the zip files from this repository.
2. Extract the zip files on your PC.
3. You can place the downloaded sample projects anywhere, but it must be a folder without double-byte characters.