New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update weight and parameter counts in documentation #85

Merged

leonoverweel merged 11 commits into master from update-params

Apr 22, 2020

Contributor

leonoverweel commented Apr 22, 2020

How I got these numbers:

from larq.models import summary
from larq_zoo.literature import BinaryDenseNet37Dilated, BinaryDenseNet37, BinaryDenseNet28, BinaryResNetE18, BiRealNet, DoReFaNet, XNORNet, BinaryAlexNet
from larq_zoo.sota import QuickNet, QuickNetLarge, QuickNetXL

summary(BinaryDenseNet37Dilated(weights=None))  # for all models

See each commit for the corresponding model's summary. QuickNetXL already had the correct numbers.

Closes #71.

leonoverweel added 11 commits

April 22, 2020 13:13


          Update params/memory for BinaryDenseNet45

af15d30

+binary_densenet45 summary--------------------+
| Total params                      13.9 M    |
| Trainable params                  13.8 M    |
| Non-trainable params              49.7 k    |
| Model size                        7.35 MiB  |
| Model size (8-bit FP weights)     2.94 MiB  |
| Float-32 Equivalent               52.98 MiB |
| Compression Ratio of Memory       0.14      |
| Number of MACs                    6.67 B    |
| Ratio of MACs that are binarized  0.9634    |
+---------------------------------------------+


          Update params/memory for BinaryDenseNet37Dilated

08d025d

+binary_densenet37_dilated summary------------+
| Total params                      8.7 M     |
| Trainable params                  8.67 M    |
| Non-trainable params              31.9 k    |
| Model size                        5.13 MiB  |
| Model size (8-bit FP weights)     1.96 MiB  |
| Float-32 Equivalent               33.20 MiB |
| Compression Ratio of Memory       0.15      |
| Number of MACs                    8.23 B    |
| Ratio of MACs that are binarized  0.9450    |
+---------------------------------------------+


          Update params/memory for BinaryDenseNet37

877bea6

+binary_densenet37 summary--------------------+
| Total params                      8.7 M     |
| Trainable params                  8.67 M    |
| Non-trainable params              31.9 k    |
| Model size                        5.13 MiB  |
| Model size (8-bit FP weights)     1.96 MiB  |
| Float-32 Equivalent               33.20 MiB |
| Compression Ratio of Memory       0.15      |
| Number of MACs                    4.71 B    |
| Ratio of MACs that are binarized  0.9576    |
+---------------------------------------------+


          Update params/memory for BinaryDenseNet28

88a57d8

+binary_densenet28 summary--------------------+
| Total params                      5.13 M    |
| Trainable params                  5.11 M    |
| Non-trainable params              19 k      |
| Model size                        4.04 MiB  |
| Model size (8-bit FP weights)     1.39 MiB  |
| Float-32 Equivalent               19.58 MiB |
| Compression Ratio of Memory       0.21      |
| Number of MACs                    3.79 B    |
| Ratio of MACs that are binarized  0.9466    |
+---------------------------------------------+


          Update params/memory for BinaryResNetE18

cf37fd4

+binary_resnet_e_18 summary-------------------+
| Total params                      11.7 M    |
| Trainable params                  11.7 M    |
| Non-trainable params              9.73 k    |
| Model size                        4.00 MiB  |
| Model size (8-bit FP weights)     1.98 MiB  |
| Float-32 Equivalent               44.59 MiB |
| Compression Ratio of Memory       0.09      |
| Number of MACs                    1.81 B    |
| Ratio of MACs that are binarized  0.9240    |
+---------------------------------------------+


          Update params/memory for Bi-Real Net

13d7a3d

+birealnet18 summary--------------------------+
| Total params                      11.7 M    |
| Trainable params                  11.7 M    |
| Non-trainable params              9.6 k     |
| Model size                        4.00 MiB  |
| Model size (8-bit FP weights)     1.98 MiB  |
| Float-32 Equivalent               44.59 MiB |
| Compression Ratio of Memory       0.09      |
| Number of MACs                    1.81 B    |
| Ratio of MACs that are binarized  0.9240    |
+---------------------------------------------+


          Update params/memory for DoReFaNet

76edca8

+dorefanet summary------------------------------+
| Total params                       62.4 M     |
| Trainable params                   62.4 M     |
| Non-trainable params               18.9 k     |
| Model size                         22.80 MiB  |
| Model size (8-bit FP weights)      10.91 MiB  |
| Float-32 Equivalent                238.02 MiB |
| Compression Ratio of Memory        0.10       |
| Number of MACs                     3.05 B     |
| Ratio of MACs that are ternarized  0.9590     |
+-----------------------------------------------+


          Update params/memory for XNOR-Net

6797f80

+xnornet summary-------------------------------+
| Total params                      62.4 M     |
| Trainable params                  62.4 M     |
| Non-trainable params              19.3 k     |
| Model size                        22.77 MiB  |
| Model size (8-bit FP weights)     10.90 MiB  |
| Float-32 Equivalent               237.99 MiB |
| Compression Ratio of Memory       0.10       |
| Number of MACs                    1.14 B     |
| Ratio of MACs that are binarized  0.9005     |
+----------------------------------------------+


          Update params/memory for Binary AlexNet

23236e4

+binary_alexnet summary------------------------+
| Total params                      61.8 M     |
| Trainable params                  61.8 M     |
| Non-trainable params              20.9 k     |
| Model size                        7.45 MiB   |
| Model size (8-bit FP weights)     7.39 MiB   |
| Float-32 Equivalent               235.93 MiB |
| Compression Ratio of Memory       0.03       |
| Number of MACs                    841 M      |
| Ratio of MACs that are binarized  0.9134     |
+----------------------------------------------+


          Update params/memory for QuickNet

d425e7d

+quicknet summary-----------------------------+
| Total params                      10.5 M    |
| Trainable params                  10.5 M    |
| Non-trainable params              7.3 k     |
| Model size                        3.18 MiB  |
| Model size (8-bit FP weights)     1.69 MiB  |
| Float-32 Equivalent               40.10 MiB |
| Compression Ratio of Memory       0.08      |
| Number of MACs                    1.25 B    |
| Ratio of MACs that are binarized  0.9960    |
+---------------------------------------------+


          Update params/memory for QuickNetLarge

1e2799d

+quicknet_large summary-----------------------+
| Total params                      11.8 M    |
| Trainable params                  11.8 M    |
| Non-trainable params              9.6 k     |
| Model size                        4.49 MiB  |
| Model size (8-bit FP weights)     2.10 MiB  |
| Float-32 Equivalent               45.09 MiB |
| Compression Ratio of Memory       0.10      |
| Number of MACs                    1.7 B     |
| Ratio of MACs that are binarized  0.9856    |
+---------------------------------------------+

leonoverweel added the documentation label

leonoverweel requested a review from a team

April 22, 2020 11:32

lgeiger approved these changes

View reviewed changes

Member

lgeiger left a comment •

edited

Loading

This looks reasonable since we now properly account for the batchnorms. I think we also need to update the docstrings in zoo as well.

docs/zoo/index.md Show resolved Hide resolved

leonoverweel mentioned this pull request

Update weights and parameters in docstrings larq/zoo#155

Open

leonoverweel merged commit 0d3dbbb into master

leonoverweel deleted the update-params branch

April 22, 2020 11:41

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment