[one-optimize] shape changed <-1x...> to <0x...> after pad op

[zetwhite]

What?

While converting mobileNetV2 tflite to circle file, ? 0 appeared in the shape of Pad's output.

• I found this issue while trying : tflite -> circle -> optimized circle

• tflite
  

• circle
  

• optimized circle

  • suddenly ? appeared in output of pad shape
  

How to reproduce

• (+) Here is tflite file and cfg for onecc

  • you could download and reproduce it
  • mobile_net.zip

• get mobile-net-v2 tflite file

   import tensorflow as tf 
   
   mv2 = tf.keras.applications.MobileNetV2(
       input_shape=(224, 224, 3),
   )
   
   converter= tf.lite.TFLiteConverter.from_keras_model(mv2)
   tflite_model = converter.convert()
   
   with open('mv2.tflite', 'wb') as f: 
     f.write(tflite_model)

• convert to circle

  • save as mv.cfg and run onecc -C mv.cfg
  • I tested with onecc version 1.28.0.

   [onecc]
   one-import-tflite=True
   one-optimize=True
   
   [one-import-tflite]
   model_format=tflite
   input_path=mv2.tflite
   output_path=mv2.circle
   input_arrays=input
   input_shapes=1,224,224,3
   output_arrays=predictions
   converter_version=v2
   
   [one-optimize]
   input_path=mv2.circle
   output_path=mv2.opt.circle
  

[seanshpark]

suddenly ? appeared in output of pad shape

Have you recently updated Netron?
Or, do you have circle model without ? ?

[zetwhite]

I also checked circledump log, and the output of pad is <0X113x113x96> in the log.
It looks like 0 is expressed as ? in netron.

➜ circledump mv2.opt.circle | grep -A 5 PAD 

O(0:4) PAD 
    I T(0:12) mobilenetv2_1.00_224/block_1_expand_relu/Relu6;mobilenetv2_1.00_224/block_1_expand_BN/FusedBatchNormV3;mobilenetv2_1.00_224/block_12_project/Conv2D;mobilenetv2_1.00_224/block_1_expand/Conv2D
    I T(0:13) mobilenetv2_1.00_224/block_13_pad/Pad/paddings
    O T(0:14) mobilenetv2_1.00_224/block_1_pad/Pad

➜ circledump mv2.opt.circle | grep 'T(0:14) FLOAT32'
T(0:14) FLOAT32 (0, 113, 113, 96) B(15) mobilenetv2_1.00_224/block_1_pad/Pad

[zetwhite]

Have you recently updated Netron?

No, I didn't update Netron, recently.

Or, do you have circle model without ?

Before running one-optimize, the circle model does not have ?.

[seanshpark]

you could download and reproduce it
mobile_net.zip

from attached tflite file, I see it begins with unknown

I am using Netron 7.8.1, Windows version.

with circle file from tflite2cicle,

circledump gave me

Operands: T(subgraph index : tensor index) TYPE (shape) (shape_signature) B(buffer index) (variable) OperandName
T(0:0) FLOAT32 (1, 224, 224, 3) (-1, 224, 224, 3) B(1) serving_default_input_1:0

where -1 in (-1, 224, 224, 3) is for unknown.

[zetwhite]

Thank you for checking.
If you don't mind could you check the shape of mv2.opt.circle (optimized circle)?

I figured out my netron version is old ( I used netron 7.4... ).
And when I checked with https://netron.app (netron 7.8.1), -1 changed to 0 after pad op.

(+) I changed this issue's title, because I figured out that the problem is that the shape changed -1 to 0 after pad node. ? or 1 .. is just from netron version. sorry for confusion.

[seanshpark]

-1 changed to 0 after pad op.

Yes, reproduced. I'll analysis the cause...

[seanshpark]

Current implementation has a bug with unknown shape. it doesn't check it's status(unknown/known).
Main cause is that circle we are (only) interested with known shapes (for our NPU backend).

I assume there will be other Ops that will have this same error.

Are you urgent with this issue? If not, fix will go with low urgency.

[zetwhite]

Are you urgent with this issue? If not, fix will go with low urgency.

It is NOT urgent. Fixing it slowly doesn't problem at all.

[zetwhite]

This issue might be related - #5683

[shs-park]

This issue might be related to #13697