update GPU(T4) benchmarks

Lednik7 · May 3, 2022 · 761a5da · 761a5da
1 parent 36133b6
commit 761a5da
Showing 1 changed file with 15 additions and 15 deletions.
diff --git a/benchmark.md b/benchmark.md
@@ -18,20 +18,20 @@ Run on Intel (R) Xeon (R) CPU @ 2.30 GHz with 2 cores (Google Colab session)
 | ViT-B/32 |      64 |          8.07  |         6.212 |  14.282 |
 
 # GPU benchmarks
-Run on NVIDIA Tesla K80 (Google Colab session)
+Run on NVIDIA Tesla T4 (Google Colab session)
 
-| ONNX     |   batch |   encode_image |   encode_text |  total |
-|:---------|--------:|---------------:|--------------:|----------:|
-| ViT-B/32 |       2 |          0.073 |         0.032 |     0.105 |
-| ViT-B/32 |       8 |          0.088 |         0.052 |     0.14  |
-| ViT-B/32 |      16 |          0.123 |         0.08  |     0.203 |
-| ViT-B/32 |      32 |          0.196 |         0.138 |     0.334 |
-| ViT-B/32 |      64 |          0.352 |         0.252 |     0.604 |
+| ONNX     |   batch |   encode_image |   encode_text |   total |
+|:---------|--------:|---------------:|--------------:|--------:|
+| ViT-B/32 |       2 |          0.155 |         0.01  |   0.165 |
+| ViT-B/32 |       8 |          0.032 |         0.014 |   0.046 |
+| ViT-B/32 |      16 |          0.037 |         0.029 |   0.066 |
+| ViT-B/32 |      32 |          0.076 |         0.059 |   0.135 |
+| ViT-B/32 |      64 |          0.169 |         0.117 |   0.286 |
 
-| TORCH    |   batch |   encode_image |   encode_text |  total |
-|:---------|--------:|---------------:|--------------:|----------:|
-| ViT-B/32 |       2 |          0.041 |         0.033 |     0.074 |
-| ViT-B/32 |       8 |          0.128 |         0.102 |     0.23  |
-| ViT-B/32 |      16 |          0.258 |         0.201 |     0.459 |
-| ViT-B/32 |      32 |          0.505 |         0.386 |     0.891 |
-| ViT-B/32 |      64 |          0.995 |         0.754 |     1.749 |
+| TORCH    |   batch |   encode_image |   encode_text |   total |
+|:---------|--------:|---------------:|--------------:|--------:|
+| ViT-B/32 |       2 |          0.017 |         0.009 |   0.026 |
+| ViT-B/32 |       8 |          0.008 |         0.008 |   0.016 |
+| ViT-B/32 |      16 |          0.009 |         0.012 |   0.021 |
+| ViT-B/32 |      32 |          0.008 |         0.025 |   0.033 |
+| ViT-B/32 |      64 |          0.009 |         0.049 |   0.058 |