Armory v0.16.0

Scenario / Dataset / Model Updates

• New scenarios for CARLA multi-object tracking (carla-mot), CARLA overhead [multimodal] object detection, sleeper agent poisoning, and audio poisoning. See scenario_configs/eval6 for evaluation configs. A baseline HuBERT model is also provided there for ASR.
• New datasets to support the above scenarios, including two CARLA datasets (MOT and overhead [multimodal] object detection), and speech commands.

Dependency / Environment Updates

• Updated to ART 1.12.1, Pytorch 1.12, TensorFlow 2.10, and CUDA 11.6
• Updated docker / conda / pip installations to use environment.yml for conda and pyproject.toml for pip.
• Updated dockerfiles to leverage conda/pip installations.
• Removed all *requirements.txt files in favor of single installation pipeline.
• New Docker image carla-mot, for the new scenario. NOTE: may not be supported in version 0.17+

installing extra dependencies with pip

Previously you had to make complex selections from the *-requirements.txt files to run armory. Those dependencies now get installed along with armory. For example:

pip install armory-testbed[pytorch]

will bring the needed pytorch packages when installing armory. The other sets are named tensorflow and deepspeech. As always editable installations are supported, for example:

pip install --editable armory-testbed[tensorflow]

Detailed Changelog with PRs

• Task metrics by @davidslater in #1495
• Release fix by @davidslater in #1535
• Mkdocs update by @davidslater in #1534
• add global meter by @davidslater in #1528
• update mkdoc structure by @davidslater in #1551
• Remove unneeded scripts by @davidslater in #1544
• migrate adaptive attack tutorial by @lcadalzo in #1541
• allow total_wer() to take in list or np array by @lcadalzo in #1555
• Revert "omit push to pypi temporarily" by @mwartell in #1594
• bring v0.15.4 master back into develop by @mwartell in #1602
• speech commands dataset by @swsuggs in #1611
• Sleeper agent integration by @swsuggs in #1609
• Audio poisoning by @swsuggs in #1615
• Update Build System by @christopherwoodall in #1617
• black + yamllint + flake by @davidslater in #1629
• Build update by @davidslater in #1630
• Launch / Exec - better defaults by @davidslater in #1636
• remove [all] target from pyproject and CI because it lags CI badly by @mwartell in #1642
• buildable docker containers by @davidslater in #1640
• version take 2 by @davidslater in #1635
• version and ci omnibus merge by @mwartell in #1653
• Carla mutli-object tracking by @swsuggs in #1648
• Eval 6 - CARLA MOT Patch Attacks by @yusong-tan in #1624
• Eval 6 - CARLA MOT Baseline Model by @yusong-tan in #1625
• Eval 6 - CARLA MOT Dev Data by @yusong-tan in #1626
• Eval 6 - CARLA MOT Example Configs by @yusong-tan in #1627
• Baseline poison configs and bug fix by @swsuggs in #1632
• update imagenette version by @lcadalzo in #1568
• Total wer fix by @davidslater in #1643
• dockerfile for MOT by @davidslater in #1667
• Hubert ASR - replacement for deep speech without the dependencies by @davidslater in #1644
• update scenario for configurability by @davidslater in #1668
• Carla mot dataset by @swsuggs in #1658
• Pre release documentation cleanup by @christopherwoodall in #1650
• build and release new docker image to support MOT scenario by @christopherwoodall in #1663
• Eval6 Object Detection Integration by @jprokos26 in #1628
• Eval6 - CARLA Object Detection Dev Data by @yusong-tan in #1605
• Eval6 - CARLA Object Detection Train/Val Data by @yusong-tan in #1604
• Eval 6 - CARLA Object Detection Depth Attack Update by @yusong-tan in #1606
• Eval6 - CARLA Object Detection Scenario Configs by @yusong-tan in #1607
• Export carla MOT by @swsuggs in #1665
• Mot metrics meter by @davidslater in #1672
• WIP: MOT: update task results by @davidslater in #1669
• release 0.16.0 by @mwartell in #1673

New Contributors

• @christopherwoodall made their first contribution in #1617
• @jprokos26 made their first contribution in #1628

Full Changelog: v0.15.4...v0.16.0