ARMORY v0.6.0
Release Notes
This is the first stable release of Armory, which includes Scenarios to be evaluated against. If you've previously ran Armory we recommend that you clear your ~/.armory directory. Going forward transitions should be handled gracefully and this won't be needed.
0.6.0 is a major overhaul of the underlying framework.
Changelog
Documentation
- Significantly more documentation has been published regarding how to utilize the armory framework:
https://github.com/twosixlabs/armory/tree/r0.6/docs
Scenarios
- Instead of
eval_filesthe underlying evaluation is ran on aScenario. Please see the documentation for more information: https://github.com/twosixlabs/armory/blob/r0.6/docs/scenarios.md - These scenarios wrap underlying functionality like returning outputs into serialized files
Configuration Files
- We now have semi-strict schema verification. Detailed information regarding the new schema can be found in the docs: https://github.com/twosixlabs/armory/blob/r0.6/docs/configuration_files.md
Metrics
- New baseline metrics such as
categorical_accuracyhave been added for convenience. Users can still generate their own statistics in a custom scenario and simply return them as a dictionary. See the documentaiton for more information on metrics: https://github.com/twosixlabs/armory/blob/r0.6/docs/metrics.md
Baseline models and pretrained weights
- Baseline models and pretrained weights are available. Please see the documentation for more detailed information: https://github.com/twosixlabs/armory/blob/r0.6/docs/baseline_models.md
Examples
- Official scenarios as well as examples of how to create custom scenarios and configs have been added to armory-example repo