EdgeAI-TorchVision

Note: This repository is under development. Please revisit after a few days.

Develop Embedded Friendly Deep Neural Network Models in PyTorch

This is an extension of the popular github repository pytorch/vision that implements PyTorch based datasets, model architectures, and common image transformations for computer vision.

The scripts in this repository requires torchvision to be installed using this repository - the standard torchvision will not support all the features in this repository. Please install our torchvision extension using the instructions below.

Notice

• If you have not visited the landing page of at https://github.com/TexasInstruments/edgeai, please do so before attempting to use this repository. We skip most of the introduction in this repository.
• This repository is located in Github at: https://github.com/TexasInstruments/edgeai-torchvision

---

Installation Instructions

These installation instructions were tested using Miniconda Python 3.7 on a Linux Machine with Ubuntu 18.04 OS.

Make sure that your Python version is indeed 3.7 or higher by typing:

python --version

Clone this repository into your local folder

Execute the following shell script to install the dependencies:

./setup.sh

---

Categories of Models and Scripts

We have two three categories of models in this repository:

• Models and scripts that can be used to train a Lite version of the original torchvision models. These models will carry keywords such as "lite" or "tvlite". The training scripts for these are in the folder references have been altered to train these "lite" models.
• Models and scripts that we have implemented and are best suited for our devices. The training scripts for these are in the folder references/edgeailite - and they invoke "our extensions to torchvision". The models trained using these scripts will carry a keyword "edgeailite".
• Then there are the original torchvision models, without any change. It is best that the original torchvision repository be used for training those models. These models will carry keyword "tv" when we add then in our ModelZoo.

---

Our Extensions to Torchvision

We have added extensions to Torchvision that allows training of low complexity, embedded friendly Deep Neural Network models.

Scripts provided for training low complexity DNN models for tasks such as:

• Image Classification
• Semantic Segmentation
• Motion Segmentation
• Depth Estimation
• Multi-Task Estimation
• And more...

Tools and scripts for Quantization Aware Training (QAT) that is best suited for our devices are also provided.

See Our Extensions to TorchVision

---

Original Torchvision documentation

See the Original TorchVision documentation

---