ARMORY v0.6.0

Release Notes

This is the first stable release of Armory, which includes Scenarios to be evaluated against. If you've previously ran Armory we recommend that you clear your ~/.armory directory. Going forward transitions should be handled gracefully and this won't be needed.

0.6.0 is a major overhaul of the underlying framework.

Changelog

Documentation

• Significantly more documentation has been published regarding how to utilize the armory framework:
  https://github.com/twosixlabs/armory/tree/r0.6/docs

Scenarios

• Instead of eval_files the underlying evaluation is ran on a Scenario. Please see the documentation for more information: https://github.com/twosixlabs/armory/blob/r0.6/docs/scenarios.md
• These scenarios wrap underlying functionality like returning outputs into serialized files

Configuration Files

• We now have semi-strict schema verification. Detailed information regarding the new schema can be found in the docs: https://github.com/twosixlabs/armory/blob/r0.6/docs/configuration_files.md

Metrics

• New baseline metrics such as categorical_accuracy have been added for convenience. Users can still generate their own statistics in a custom scenario and simply return them as a dictionary. See the documentaiton for more information on metrics: https://github.com/twosixlabs/armory/blob/r0.6/docs/metrics.md

Baseline models and pretrained weights

• Baseline models and pretrained weights are available. Please see the documentation for more detailed information: https://github.com/twosixlabs/armory/blob/r0.6/docs/baseline_models.md

Examples

• Official scenarios as well as examples of how to create custom scenarios and configs have been added to armory-example repo