New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DL4J: ComputationGraph summary formatting is bad for some large nets #6502

Closed
AlexDBlack opened this Issue Oct 1, 2018 · 1 comment

Comments

Projects
None yet
1 participant
@AlexDBlack
Copy link
Member

AlexDBlack commented Oct 1, 2018

We could definitely improve this...
(Also should check MultiLayerNetwork for the same problem)

==========================================================================================================================================================================================================================================================
VertexName (VertexType)                 nIn,nOut  TotalParams ParamsShape                             Vertex Inputs                 InputShape                                                                 OutputShape                                                                
==========================================================================================================================================================================================================================================================
input_3 (InputVertex)                   -,-       -           -                                       -                             -                                                                          -                                                                          
block1_conv1 (ConvolutionLayer)         3,32      864         W:{32,3,3,3}                            [input_3]                     InputTypeConvolutional(h=299,w=299,c=3)                                    InputTypeConvolutional(h=149,w=149,c=32)                                   
block1_conv1_bn (BatchNormalization)    32,32     128         gamma:{1,32}, beta:{1,32}, mean:{1,32}, var:{1,32}[block1_conv1]                InputTypeConvolutional(h=149,w=149,c=32)                                   InputTypeConvolutional(h=149,w=149,c=32)                                   
block1_conv1_act (ActivationLayer)      -,-       0           -                                       [block1_conv1_bn]             InputTypeConvolutional(h=149,w=149,c=32)                                   InputTypeConvolutional(h=149,w=149,c=32)                                   
block1_conv2 (ConvolutionLayer)         32,64     18432       W:{64,32,3,3}                           [block1_conv1_act]            InputTypeConvolutional(h=149,w=149,c=32)                                   InputTypeConvolutional(h=147,w=147,c=64)                                   
block1_conv2_bn (BatchNormalization)    64,64     256         gamma:{1,64}, beta:{1,64}, mean:{1,64}, var:{1,64}[block1_conv2]                InputTypeConvolutional(h=147,w=147,c=64)                                   InputTypeConvolutional(h=147,w=147,c=64)                                   
block1_conv2_act (ActivationLayer)      -,-       0           -                                       [block1_conv2_bn]             InputTypeConvolutional(h=147,w=147,c=64)                                   InputTypeConvolutional(h=147,w=147,c=64)                                   
block2_sepconv1 (SeparableConvolution2DLayer)64,128    8768        W:{1,64,3,3}, pW:{128,64,1,1}           [block1_conv2_act]            InputTypeConvolutional(h=147,w=147,c=64)                                   InputTypeConvolutional(h=147,w=147,c=128)                                  
conv2d_5 (ConvolutionLayer)             64,128    8192        W:{128,64,1,1}                          [block1_conv2_act]            InputTypeConvolutional(h=147,w=147,c=64)                                   InputTypeConvolutional(h=74,w=74,c=128)                                    
block2_sepconv1_bn (BatchNormalization) 128,128   512         gamma:{1,128}, beta:{1,128}, mean:{1,128}, var:{1,128}[block2_sepconv1]             InputTypeConvolutional(h=147,w=147,c=128)                                  InputTypeConvolutional(h=147,w=147,c=128)                                  
batch_normalization_5 (BatchNormalization)128,128   512         gamma:{1,128}, beta:{1,128}, mean:{1,128}, var:{1,128}[conv2d_5]                    InputTypeConvolutional(h=74,w=74,c=128)                                    InputTypeConvolutional(h=74,w=74,c=128)                                    
block2_sepconv2_act (ActivationLayer)   -,-       0           -                                       [block2_sepconv1_bn]          InputTypeConvolutional(h=147,w=147,c=128)                                  InputTypeConvolutional(h=147,w=147,c=128)                                  
block2_sepconv2 (SeparableConvolution2DLayer)128,128   17536       W:{1,128,3,3}, pW:{128,128,1,1}         [block2_sepconv2_act]         InputTypeConvolutional(h=147,w=147,c=128)                                  InputTypeConvolutional(h=147,w=147,c=128)                                  
block2_sepconv2_bn (BatchNormalization) 128,128   512         gamma:{1,128}, beta:{1,128}, mean:{1,128}, var:{1,128}[block2_sepconv2]             InputTypeConvolutional(h=147,w=147,c=128)                                  InputTypeConvolutional(h=147,w=147,c=128)                                  
block2_pool (SubsamplingLayer)          -,-       0           -                                       [block2_sepconv2_bn]          InputTypeConvolutional(h=147,w=147,c=128)                                  InputTypeConvolutional(h=74,w=74,c=128)                                    
add_29 (ElementWiseVertex)              -,-       -           -                                       [block2_pool, batch_normalization_5]-                                                                          InputTypeConvolutional(h=74,w=74,c=128)                                    
block3_sepconv1_act (ActivationLayer)   -,-       0           -                                       [add_29]                      InputTypeConvolutional(h=74,w=74,c=128)                                    InputTypeConvolutional(h=74,w=74,c=128)                                    
conv2d_6 (ConvolutionLayer)             128,256   32768       W:{256,128,1,1}                         [add_29]                      InputTypeConvolutional(h=74,w=74,c=128)                                    InputTypeConvolutional(h=37,w=37,c=256)                                    
block3_sepconv1 (SeparableConvolution2DLayer)128,256   33920       W:{1,128,3,3}, pW:{256,128,1,1}         [block3_sepconv1_act]         InputTypeConvolutional(h=74,w=74,c=128)                                    InputTypeConvolutional(h=74,w=74,c=256)                                    
batch_normalization_6 (BatchNormalization)256,256   1024        gamma:{1,256}, beta:{1,256}, mean:{1,256}, var:{1,256}[conv2d_6]                    InputTypeConvolutional(h=37,w=37,c=256)                                    InputTypeConvolutional(h=37,w=37,c=256)                                    
block3_sepconv1_bn (BatchNormalization) 256,256   1024        gamma:{1,256}, beta:{1,256}, mean:{1,256}, var:{1,256}[block3_sepconv1]             InputTypeConvolutional(h=74,w=74,c=256)                                    InputTypeConvolutional(h=74,w=74,c=256)                                    
block3_sepconv2_act (ActivationLayer)   -,-       0           -                                       [block3_sepconv1_bn]          InputTypeConvolutional(h=74,w=74,c=256)                                    InputTypeConvolutional(h=74,w=74,c=256)                                    
block3_sepconv2 (SeparableConvolution2DLayer)256,256   67840       W:{1,256,3,3}, pW:{256,256,1,1}         [block3_sepconv2_act]         InputTypeConvolutional(h=74,w=74,c=256)                                    InputTypeConvolutional(h=74,w=74,c=256)                                    
block3_sepconv2_bn (BatchNormalization) 256,256   1024        gamma:{1,256}, beta:{1,256}, mean:{1,256}, var:{1,256}[block3_sepconv2]             InputTypeConvolutional(h=74,w=74,c=256)                                    InputTypeConvolutional(h=74,w=74,c=256)                                    
block3_pool (SubsamplingLayer)          -,-       0           -                                       [block3_sepconv2_bn]          InputTypeConvolutional(h=74,w=74,c=256)                                    InputTypeConvolutional(h=37,w=37,c=256)                                    
add_30 (ElementWiseVertex)              -,-       -           -                                       [block3_pool, batch_normalization_6]-                                                                          InputTypeConvolutional(h=37,w=37,c=256)                                    
conv2d_7 (ConvolutionLayer)             256,728   186368      W:{728,256,1,1}                         [add_30]                      InputTypeConvolutional(h=37,w=37,c=256)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block4_sepconv1_act (ActivationLayer)   -,-       0           -                                       [add_30]                      InputTypeConvolutional(h=37,w=37,c=256)                                    InputTypeConvolutional(h=37,w=37,c=256)                                    
batch_normalization_7 (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[conv2d_7]                    InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block4_sepconv1 (SeparableConvolution2DLayer)256,728   188672      W:{1,256,3,3}, pW:{728,256,1,1}         [block4_sepconv1_act]         InputTypeConvolutional(h=37,w=37,c=256)                                    InputTypeConvolutional(h=37,w=37,c=728)                                    
block4_sepconv1_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block4_sepconv1]             InputTypeConvolutional(h=37,w=37,c=728)                                    InputTypeConvolutional(h=37,w=37,c=728)                                    
block4_sepconv2_act (ActivationLayer)   -,-       0           -                                       [block4_sepconv1_bn]          InputTypeConvolutional(h=37,w=37,c=728)                                    InputTypeConvolutional(h=37,w=37,c=728)                                    
block4_sepconv2 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block4_sepconv2_act]         InputTypeConvolutional(h=37,w=37,c=728)                                    InputTypeConvolutional(h=37,w=37,c=728)                                    
block4_sepconv2_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block4_sepconv2]             InputTypeConvolutional(h=37,w=37,c=728)                                    InputTypeConvolutional(h=37,w=37,c=728)                                    
block4_pool (SubsamplingLayer)          -,-       0           -                                       [block4_sepconv2_bn]          InputTypeConvolutional(h=37,w=37,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
add_31 (ElementWiseVertex)              -,-       -           -                                       [block4_pool, batch_normalization_7]-                                                                          InputTypeConvolutional(h=19,w=19,c=728)                                    
block5_sepconv1_act (ActivationLayer)   -,-       0           -                                       [add_31]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block5_sepconv1 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block5_sepconv1_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block5_sepconv1_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block5_sepconv1]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block5_sepconv2_act (ActivationLayer)   -,-       0           -                                       [block5_sepconv1_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block5_sepconv2 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block5_sepconv2_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block5_sepconv2_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block5_sepconv2]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block5_sepconv3_act (ActivationLayer)   -,-       0           -                                       [block5_sepconv2_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block5_sepconv3 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block5_sepconv3_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block5_sepconv3_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block5_sepconv3]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
add_32 (ElementWiseVertex)              -,-       -           -                                       [block5_sepconv3_bn, add_31]  -                                                                          InputTypeConvolutional(h=19,w=19,c=728)                                    
block6_sepconv1_act (ActivationLayer)   -,-       0           -                                       [add_32]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block6_sepconv1 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block6_sepconv1_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block6_sepconv1_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block6_sepconv1]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block6_sepconv2_act (ActivationLayer)   -,-       0           -                                       [block6_sepconv1_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block6_sepconv2 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block6_sepconv2_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block6_sepconv2_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block6_sepconv2]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block6_sepconv3_act (ActivationLayer)   -,-       0           -                                       [block6_sepconv2_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block6_sepconv3 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block6_sepconv3_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block6_sepconv3_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block6_sepconv3]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
add_33 (ElementWiseVertex)              -,-       -           -                                       [block6_sepconv3_bn, add_32]  -                                                                          InputTypeConvolutional(h=19,w=19,c=728)                                    
block7_sepconv1_act (ActivationLayer)   -,-       0           -                                       [add_33]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block7_sepconv1 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block7_sepconv1_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block7_sepconv1_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block7_sepconv1]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block7_sepconv2_act (ActivationLayer)   -,-       0           -                                       [block7_sepconv1_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block7_sepconv2 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block7_sepconv2_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block7_sepconv2_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block7_sepconv2]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block7_sepconv3_act (ActivationLayer)   -,-       0           -                                       [block7_sepconv2_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block7_sepconv3 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block7_sepconv3_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block7_sepconv3_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block7_sepconv3]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
add_34 (ElementWiseVertex)              -,-       -           -                                       [block7_sepconv3_bn, add_33]  -                                                                          InputTypeConvolutional(h=19,w=19,c=728)                                    
block8_sepconv1_act (ActivationLayer)   -,-       0           -                                       [add_34]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block8_sepconv1 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block8_sepconv1_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block8_sepconv1_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block8_sepconv1]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block8_sepconv2_act (ActivationLayer)   -,-       0           -                                       [block8_sepconv1_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block8_sepconv2 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block8_sepconv2_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block8_sepconv2_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block8_sepconv2]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block8_sepconv3_act (ActivationLayer)   -,-       0           -                                       [block8_sepconv2_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block8_sepconv3 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block8_sepconv3_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block8_sepconv3_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block8_sepconv3]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
add_35 (ElementWiseVertex)              -,-       -           -                                       [block8_sepconv3_bn, add_34]  -                                                                          InputTypeConvolutional(h=19,w=19,c=728)                                    
block9_sepconv1_act (ActivationLayer)   -,-       0           -                                       [add_35]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block9_sepconv1 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block9_sepconv1_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block9_sepconv1_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block9_sepconv1]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block9_sepconv2_act (ActivationLayer)   -,-       0           -                                       [block9_sepconv1_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block9_sepconv2 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block9_sepconv2_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block9_sepconv2_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block9_sepconv2]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block9_sepconv3_act (ActivationLayer)   -,-       0           -                                       [block9_sepconv2_bn]          InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block9_sepconv3 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block9_sepconv3_act]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block9_sepconv3_bn (BatchNormalization) 728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block9_sepconv3]             InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
add_36 (ElementWiseVertex)              -,-       -           -                                       [block9_sepconv3_bn, add_35]  -                                                                          InputTypeConvolutional(h=19,w=19,c=728)                                    
block10_sepconv1_act (ActivationLayer)  -,-       0           -                                       [add_36]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block10_sepconv1 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block10_sepconv1_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block10_sepconv1_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block10_sepconv1]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block10_sepconv2_act (ActivationLayer)  -,-       0           -                                       [block10_sepconv1_bn]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block10_sepconv2 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block10_sepconv2_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block10_sepconv2_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block10_sepconv2]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block10_sepconv3_act (ActivationLayer)  -,-       0           -                                       [block10_sepconv2_bn]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block10_sepconv3 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block10_sepconv3_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block10_sepconv3_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block10_sepconv3]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
add_37 (ElementWiseVertex)              -,-       -           -                                       [block10_sepconv3_bn, add_36] -                                                                          InputTypeConvolutional(h=19,w=19,c=728)                                    
block11_sepconv1_act (ActivationLayer)  -,-       0           -                                       [add_37]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block11_sepconv1 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block11_sepconv1_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block11_sepconv1_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block11_sepconv1]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block11_sepconv2_act (ActivationLayer)  -,-       0           -                                       [block11_sepconv1_bn]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block11_sepconv2 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block11_sepconv2_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block11_sepconv2_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block11_sepconv2]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block11_sepconv3_act (ActivationLayer)  -,-       0           -                                       [block11_sepconv2_bn]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block11_sepconv3 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block11_sepconv3_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block11_sepconv3_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block11_sepconv3]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
add_38 (ElementWiseVertex)              -,-       -           -                                       [block11_sepconv3_bn, add_37] -                                                                          InputTypeConvolutional(h=19,w=19,c=728)                                    
block12_sepconv1_act (ActivationLayer)  -,-       0           -                                       [add_38]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block12_sepconv1 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block12_sepconv1_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block12_sepconv1_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block12_sepconv1]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block12_sepconv2_act (ActivationLayer)  -,-       0           -                                       [block12_sepconv1_bn]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block12_sepconv2 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block12_sepconv2_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block12_sepconv2_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block12_sepconv2]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block12_sepconv3_act (ActivationLayer)  -,-       0           -                                       [block12_sepconv2_bn]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block12_sepconv3 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block12_sepconv3_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block12_sepconv3_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block12_sepconv3]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
add_39 (ElementWiseVertex)              -,-       -           -                                       [block12_sepconv3_bn, add_38] -                                                                          InputTypeConvolutional(h=19,w=19,c=728)                                    
block13_sepconv1_act (ActivationLayer)  -,-       0           -                                       [add_39]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
conv2d_8 (ConvolutionLayer)             728,1024  745472      W:{1024,728,1,1}                        [add_39]                      InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=10,w=10,c=1024)                                   
block13_sepconv1 (SeparableConvolution2DLayer)728,728   536536      W:{1,728,3,3}, pW:{728,728,1,1}         [block13_sepconv1_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
batch_normalization_8 (BatchNormalization)1024,1024 4096        gamma:{1,1024}, beta:{1,1024}, mean:{1,1024}, var:{1,1024}[conv2d_8]                    InputTypeConvolutional(h=10,w=10,c=1024)                                   InputTypeConvolutional(h=10,w=10,c=1024)                                   
block13_sepconv1_bn (BatchNormalization)728,728   2912        gamma:{1,728}, beta:{1,728}, mean:{1,728}, var:{1,728}[block13_sepconv1]            InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block13_sepconv2_act (ActivationLayer)  -,-       0           -                                       [block13_sepconv1_bn]         InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=728)                                    
block13_sepconv2 (SeparableConvolution2DLayer)728,1024  752024      W:{1,728,3,3}, pW:{1024,728,1,1}        [block13_sepconv2_act]        InputTypeConvolutional(h=19,w=19,c=728)                                    InputTypeConvolutional(h=19,w=19,c=1024)                                   
block13_sepconv2_bn (BatchNormalization)1024,1024 4096        gamma:{1,1024}, beta:{1,1024}, mean:{1,1024}, var:{1,1024}[block13_sepconv2]            InputTypeConvolutional(h=19,w=19,c=1024)                                   InputTypeConvolutional(h=19,w=19,c=1024)                                   
block13_pool (SubsamplingLayer)         -,-       0           -                                       [block13_sepconv2_bn]         InputTypeConvolutional(h=19,w=19,c=1024)                                   InputTypeConvolutional(h=10,w=10,c=1024)                                   
add_40 (ElementWiseVertex)              -,-       -           -                                       [block13_pool, batch_normalization_8]-                                                                          InputTypeConvolutional(h=10,w=10,c=1024)                                   
block14_sepconv1 (SeparableConvolution2DLayer)1024,1536 1582080     W:{1,1024,3,3}, pW:{1536,1024,1,1}      [add_40]                      InputTypeConvolutional(h=10,w=10,c=1024)                                   InputTypeConvolutional(h=10,w=10,c=1536)                                   
block14_sepconv1_bn (BatchNormalization)1536,1536 6144        gamma:{1,1536}, beta:{1,1536}, mean:{1,1536}, var:{1,1536}[block14_sepconv1]            InputTypeConvolutional(h=10,w=10,c=1536)                                   InputTypeConvolutional(h=10,w=10,c=1536)                                   
block14_sepconv1_act (ActivationLayer)  -,-       0           -                                       [block14_sepconv1_bn]         InputTypeConvolutional(h=10,w=10,c=1536)                                   InputTypeConvolutional(h=10,w=10,c=1536)                                   
block14_sepconv2 (SeparableConvolution2DLayer)1536,2048 3159552     W:{1,1536,3,3}, pW:{2048,1536,1,1}      [block14_sepconv1_act]        InputTypeConvolutional(h=10,w=10,c=1536)                                   InputTypeConvolutional(h=10,w=10,c=2048)                                   
block14_sepconv2_bn (BatchNormalization)2048,2048 8192        gamma:{1,2048}, beta:{1,2048}, mean:{1,2048}, var:{1,2048}[block14_sepconv2]            InputTypeConvolutional(h=10,w=10,c=2048)                                   InputTypeConvolutional(h=10,w=10,c=2048)                                   
block14_sepconv2_act (ActivationLayer)  -,-       0           -                                       [block14_sepconv2_bn]         InputTypeConvolutional(h=10,w=10,c=2048)                                   InputTypeConvolutional(h=10,w=10,c=2048)                                   
avg_pool (GlobalPoolingLayer)           -,-       0           -                                       [block14_sepconv2_act]        InputTypeConvolutional(h=10,w=10,c=2048)                                   InputTypeConvolutional(h=1,w=1,c=2048)                                     
predictions (DenseLayer)                2048,1000 2049000     W:{2048,1000}, b:{1,1000}               [avg_pool]                    InputTypeConvolutional(h=1,w=1,c=2048)-->InputTypeFeedForward(2048)        InputTypeFeedForward(1000)                                                 
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
            Total Parameters:  22910480
        Trainable Parameters:  22910480
           Frozen Parameters:  0
==========================================================================================================================================================================================================================================================

@AlexDBlack AlexDBlack added the DL4J label Oct 1, 2018

@AlexDBlack AlexDBlack self-assigned this Oct 1, 2018

AlexDBlack added a commit that referenced this issue Oct 1, 2018

@AlexDBlack AlexDBlack referenced this issue Oct 1, 2018

Merged

Misc fixes #6504

AlexDBlack added a commit that referenced this issue Oct 3, 2018

Misc fixes (#6504)
* #6501 Fix multiple issues with Xception configuration

* #6500 Fix SqueezeNet (non-pretrained) config + add tests

* #6497 Fix multi-output net evaluation for ComputationGraph

* #6502 fix formatting for ComputationGraph summary

* #6502 fix formatting for MultiLayerNetwork summary

* #6489 fix JSON mapping for keras import preprocessors

* Switch default output layer activation to softmax

* Fix transposei issues with autoencoder

* Minor test fixes

* ComputationGraph: Fix possible double application of preprocessors and setting input for output layers when doing backprop

* Workspace fix for output layer dropout in compgraph
@lock

This comment has been minimized.

Copy link

lock bot commented Nov 2, 2018

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked and limited conversation to collaborators Nov 2, 2018

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.