AI Benchmark Alpha is an open source python library for evaluating AI performance of various hardware platforms, including CPUs, GPUs and TPUs. The benchmark is relying on TensorFlow machine learning library, and is providing a lightweight and accurate solution for assessing inference and training speed for key Deep Learning models.

In total, AI Benchmark consists of 42 tests and 19 sections provided below:

1. MobileNet-V2  [classification]
2. Inception-V3  [classification]
3. Inception-V4  [classification]
4. Inception-ResNet-V2  [classification]
5. ResNet-V2-50  [classification]
6. ResNet-V2-152  [classification]
7. VGG-16  [classification]
8. SRCNN 9-5-5  [image-to-image mapping]
9. VGG-19  [image-to-image mapping]
10. ResNet-SRGAN  [image-to-image mapping]
11. ResNet-DPED  [image-to-image mapping]
12. U-Net  [image-to-image mapping]
13. Nvidia-SPADE  [image-to-image mapping]
14. ICNet  [image segmentation]
15. PSPNet  [image segmentation]
16. DeepLab  [image segmentation]
17. Pixel-RNN  [inpainting]
18. LSTM  [sentence sentiment analysis]
19. GNMT  [text translation]

For more information and results, please visit the project website: http://ai-benchmark.com/alpha

Run Instructions

sudo docker build -t odyssee/ai-benchmark:latest" sudo docker run --gpus all -it odyssee/ai-benchmark:latest"