This minor release notably adds new high-level interfaces for black-box object detector and image similarity saliency generation. We provide some reference implementations for these interfaces, notably the D-RISE and SBSM algorithms, respectively.
Other improvements include the addition of more examples notebooks, improvements/fixes to existing implementations and a revision to the CLI object detection saliency generation tool.
See below for more details.
CI
- Added the ATARI example notebook to the list of notebooks to run during CI.
Documentation
- Update saliency algorithms table with perturbation-based saliency for reinforcement learning and add corresponding section to README.
- Added a lighter color version of the logo that will appear better is both light- and dark-theme contexts. The main README file has been updated to refer to this image.
- Added introductory sentence to the style sheet document.
- Updated the release process to be incrementally more comprehensive and now
includes the specification of a
release
branch with better patch release instructions. This also now includes a step to update the version referenced in the xaitk.org source.
Examples
- Updated demo resource download links from Google Drive to data.kitware.com
- Added example using saliency to qualitatively compare two object detection models.
- Updated SimilarityScoring example to use new high-level image similarity saliency interface and follow new similarity interface inputs.
Interfaces
- Added new high-level interface for black-box object detector saliency,
GenerateObjectDetectorBlackboxSaliency
. - Updated image similarity interface
GenerateDescriptorSimilaritySaliency
to accept multiple query images and compute a saliency map for each one, relative to the reference image. - Added new high-level interface for image similarity saliency,
GenerateImageSimilarityBlackboxSaliency
.
Implementations
- Added three
GenerateObjectDetectorBlackboxSaliency
implementations: the genericPerturbationOcclusion
, and two usable classesDRISEStack
andRandomGridStack
. - Updated behavior of the
SlidingWindow
PerturbImage
implementation. For a given stride, the number of masks generated is now agnostic to the window size. - Updated
SimilarityScoring
to return [N x H x W] instead of [1 x H x W] saliency heatmaps matrix. This is inline with the similarity interface update. - Added two implementations of
GenerateImageSimilarityBlackboxSaliency
:PerturbationOcclusion
andSBSMStack
.
Misc.
- Updated poetry-core build backend to version 1.0.8, which now supports pip editable installs (pip install -e .).
Utils
- Updated COCO utility functions to use new high-level detector interface. gen_coco_sal() is now deprecated in exchange for parse_coco_dset() which parses a kwcoco.CocoDataset object into the inputs used with an implementation of GenerateObjectDetectorBlackboxSaliency.
Dependency Versions
- Update pinned jupyter notebook transitive dependency version due to vulnerability warning.
Examples
- Fixed inconsistency of dependency package installs at the head of the
examples/SerializedDetectionSaliency.ipynb
notebook.