Retrained MobileNet and failed to load it for prediction #7431

rtao · 2017-07-26T05:30:39Z

TF: 1.2.1-gpu
Keras: 2.0.6

I am trying to retrain the MobileNet modle from the latest version using the following script,

Training.py
https://gist.github.com/rtao/50eb8c96b06f4deddec2b7888da1d062

And when I try to load it back with the following, I got an error of "ValueError: Unknown activation function:relu6"

Predict.py
https://gist.github.com/rtao/c6773e7e430552a54a3812d5fae91bfe

fchollet · 2017-07-26T05:35:26Z

MobileNet uses several custom functions. You need to use a CustomObjectScope to load a saved model (see docs entry about it). The custom objects can be imported from keras.applications.mobilenet.

…

On Jul 25, 2017 19:30, "Ronald Tao" ***@***.***> wrote: TF: 1.2.1-gpu Keras: 2.0.6 I am trying to retrain the MobileNet modle from the latest version using the following script, Training.py https://gist.github.com/rtao/50eb8c96b06f4deddec2b7888da1d062 And when I try to load it back with the following, I got an error of "ValueError: Unknown activation function:relu6" Predict.py https://gist.github.com/rtao/c6773e7e430552a54a3812d5fae91bfe — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#7431>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AArWb2oDqQe1FT94akwlpvfEd6SDEO1kks5sRs8DgaJpZM4OjctN> .

drscotthawley · 2017-10-07T19:16:19Z

Just to make @fchollet's comment explicit for fellow n00bs like me...this works:

from keras.utils.generic_utils import CustomObjectScope

with CustomObjectScope({'relu6': keras.applications.mobilenet.relu6,'DepthwiseConv2D': keras.applications.mobilenet.DepthwiseConv2D}):
    model = load_model('weights.hdf5')

bkou · 2018-03-27T22:15:51Z

If your keras is at "from tensorflow.python import keras" instead of at "import keras" then here is what worked for me:

from tensorflow.python.keras._impl.keras.utils.generic_utils import CustomObjectScope
from tensorflow.python.keras._impl.keras.applications import mobilenet
from tensorflow.python.keras._impl.keras.models import load_model
with CustomObjectScope({'relu6': mobilenet.relu6,'DepthwiseConv2D': mobilenet.DepthwiseConv2D}):
    model = load_model('weights.hdf5')

edumucelli · 2018-06-26T23:28:44Z

Is still possible to import mobilenet.DepthwiseConv2D and mobilenet.relu6 on Keras 2.2.0? I have seen that DepthwiseConv2D is now on keras.layers, but not sure about relu6. Where can I find it?

koichirokamoto · 2018-07-02T09:20:48Z

I have found relu6 at here.

flyfj · 2018-07-16T20:01:47Z

had same issue with keras 2.2.0, no relu6 is found.

flyfj · 2018-07-16T20:33:15Z

i downgraded to 2.1.4, it works fine. noticed pr on removing relu6 in 2.2, but the pretrained model still has it.

haitham-b · 2018-07-24T13:58:53Z

im using Keras 2.2 with tensorflow 1.9
trying to load a mobilenet and mobilenetV2 models that were generated with tensorflow 1.8.
im able to find relu6 in (from keras_applications import mobilenet as mn) , but can't find
DepthwiseConv2D.

any idea how the import for DepthwiseConv2D should look like ?

edumucelli · 2018-07-25T22:13:15Z

Found them,

from keras.layers import DepthwiseConv2D
from keras_applications.mobilenet import relu6

Just for information, before they were imported as

from keras.applications.mobilenet import DepthwiseConv2D, relu6

warren30815 · 2018-08-16T07:20:03Z

In Keras2.2, modified to
from keras.utils.generic_utils import CustomObjectScope

with CustomObjectScope({'relu6': keras.layers.ReLU(6.),'DepthwiseConv2D': keras.layers.DepthwiseConv2D}):
model = load_model('weights.hdf5')

SteveIb · 2018-10-14T12:14:42Z

Im still facing the same issue!
Keras = 2.2.0, TF = 1.9?

mrgloom · 2018-10-18T17:42:50Z

How to convert MobileNet from Keras 2.1.3 to CoreML?

from keras.applications import MobileNet
from keras.applications.mobilenet import relu6
from keras.applications.mobilenet import DepthwiseConv2D

import coremltools.converters.keras as k

def save_model():
    model = MobileNet(input_shape=(128,128,3), include_top=False)
    model.save('temp.h5')

def convert():
    model = k.convert('temp.h5',
                      input_names=['input'],
                      output_names=['output'],
                      model_precision='float16',
                      add_custom_layers = True,
                      custom_conversion_functions={'relu6': relu6, 'DepthwiseConv2D': DepthwiseConv2D})
    model.save('temp.model')

save_model()
convert()

This also gives ValueError: Unknown activation function:relu6

mrgloom · 2018-10-18T17:58:25Z

Here is solution based on apple/coremltools#38

from keras.applications import MobileNet
import keras

import coremltools.converters.keras as k
from keras.utils.generic_utils import CustomObjectScope

def save_model():
    model = MobileNet(input_shape=(128,128,3), include_top=False)
    model.save('temp.h5')

def convert():
    with CustomObjectScope({'relu6': keras.applications.mobilenet.relu6,
                            'DepthwiseConv2D': keras.applications.mobilenet.DepthwiseConv2D}):
        model = k.convert("temp.h5",
                          input_names=['input'],
                          output_names=['output'],
                          model_precision='float16')

    model.save('temp.mlmodel')

save_model()
convert()

And here is as solution for keras to tflite
tensorflow/tensorflow#17289

SteveIb · 2018-10-25T12:59:19Z

In Keras2.2, modified to
from keras.utils.generic_utils import CustomObjectScope

with CustomObjectScope({'relu6': keras.layers.ReLU(6.),'DepthwiseConv2D': keras.layers.DepthwiseConv2D}):
model = load_model('weights.hdf5')

I have tried
with CustomObjectScope({'relu6': keras.layers.ReLU(6.),'DepthwiseConv2D': keras.layers.DepthwiseConv2D}):
model = load_model('****.hdf5')

but I got the following error:
ValueError: axes don't match array

my TF is 1.11 my keras is 2.2.4, python 2.7.
Im trying to convert the model on the same machine and environment i have trained on.
any suggestions?

poria-cat · 2019-01-26T12:42:15Z

in version >= 2.2.4, you can write like this:

from keras.layers import DepthwiseConv2D, ReLU
relu6 = ReLU(6.)
....
return Activation(relu6)(x)

sonfire186 · 2019-02-04T11:42:06Z

in version >= 2.2.4, you can write like this:

from keras.layers import DepthwiseConv2D, ReLU
relu6 = ReLU(6.)
....
return relu6(x)

hernandezfelipe · 2019-02-26T22:25:01Z

I am having some trouble with this error and I don't know what to do. I am having a hard time because the way I am saving my trained model is different.

What should I do?

Saving

model_json = model.to_json()
with open("model_pretrained.json", "w") as json_file:
json_file.write(model_json)

model.save_weights("model_pretrained.h5")
print("Saved model to disk")

Loading

json_file = open('model_pretrained.json', 'r')
loaded_model_json = json_file.read()
json_file.close()

loaded_model = model_from_json(loaded_model_json)
loaded_model.load_weights("model_pretrained.h5")

ValueError: Unknown activation function:relu6

ymodak · 2019-03-22T21:25:29Z

Closing this issue since its resolved. Feel free to reopen if have further problems. Thanks!

Ezra521 · 2019-04-24T05:23:53Z

I am having some trouble with this error and I don't know what to do. I am having a hard time because the way I am saving my trained model is different.

What should I do?

Saving

model_json = model.to_json()
with open("model_pretrained.json", "w") as json_file:
json_file.write(model_json)

model.save_weights("model_pretrained.h5")
print("Saved model to disk")

Loading

json_file = open('model_pretrained.json', 'r')
loaded_model_json = json_file.read()
json_file.close()

loaded_model = model_from_json(loaded_model_json)
loaded_model.load_weights("model_pretrained.h5")

ValueError: Unknown activation function:relu6

i don't know,

Ruomei · 2020-08-11T09:14:59Z

TF: 1.2.1-gpu
Keras: 2.0.6

I am trying to retrain the MobileNet modle from the latest version using the following script,

Training.py
https://gist.github.com/rtao/50eb8c96b06f4deddec2b7888da1d062

And when I try to load it back with the following, I got an error of "ValueError: Unknown activation function:relu6"

Predict.py
https://gist.github.com/rtao/c6773e7e430552a54a3812d5fae91bfe

@rtao
I am wondering whether you have managed to reproduce the accuracy results after training mobilenet from scratch.

@fchollet
Isn't the graph we import from keras applications only for inference?

greis mentioned this issue Nov 29, 2017

Keras mobilenet can't be imported (missing Relu6 / DepthwiseConv2D) apple/coremltools#38

Closed

amir-abdi mentioned this issue Jan 12, 2018

Can not convert the keras - moiblenet, H5 model to tensorflow Pb model amir-abdi/keras_to_tensorflow#16

Closed

pavithrasv mentioned this issue Feb 24, 2018

ValueError: Unknown activation function:relu6 while converting MobileNet under Keras to estimator using model_to_estimator tensorflow/tensorflow#17191

Closed

kimamula mentioned this issue Mar 16, 2018

MobileNet support transcranial/keras-js#119

Open

amir-abdi mentioned this issue Apr 22, 2018

Getting error with weight_file_path and relu 6 amir-abdi/keras_to_tensorflow#31

Closed

aaronjanse mentioned this issue Jul 30, 2018

AttributeError: module 'keras.applications.mobilenet' has no attribute 'relu6' microsoft/MMdnn#268

Closed

amir-abdi mentioned this issue Oct 11, 2018

Convert Keras model to TensorFlow #3223

Closed

ymodak added the backend:tensorflow label Mar 22, 2019

ymodak closed this as completed Mar 22, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Retrained MobileNet and failed to load it for prediction #7431

Retrained MobileNet and failed to load it for prediction #7431

rtao commented Jul 26, 2017

fchollet commented Jul 26, 2017 via email

drscotthawley commented Oct 7, 2017 •

edited

Loading

bkou commented Mar 27, 2018

edumucelli commented Jun 26, 2018 •

edited

Loading

koichirokamoto commented Jul 2, 2018

flyfj commented Jul 16, 2018

flyfj commented Jul 16, 2018

haitham-b commented Jul 24, 2018

edumucelli commented Jul 25, 2018 •

edited

Loading

warren30815 commented Aug 16, 2018 •

edited

Loading

SteveIb commented Oct 14, 2018

mrgloom commented Oct 18, 2018 •

edited

Loading

mrgloom commented Oct 18, 2018 •

edited

Loading

SteveIb commented Oct 25, 2018

poria-cat commented Jan 26, 2019

sonfire186 commented Feb 4, 2019

hernandezfelipe commented Feb 26, 2019

ymodak commented Mar 22, 2019

Ezra521 commented Apr 24, 2019

Saving

Loading

Ruomei commented Aug 11, 2020 •

edited

Loading

Retrained MobileNet and failed to load it for prediction #7431

Retrained MobileNet and failed to load it for prediction #7431

Comments

rtao commented Jul 26, 2017

fchollet commented Jul 26, 2017 via email

drscotthawley commented Oct 7, 2017 • edited Loading

bkou commented Mar 27, 2018

edumucelli commented Jun 26, 2018 • edited Loading

koichirokamoto commented Jul 2, 2018

flyfj commented Jul 16, 2018

flyfj commented Jul 16, 2018

haitham-b commented Jul 24, 2018

edumucelli commented Jul 25, 2018 • edited Loading

warren30815 commented Aug 16, 2018 • edited Loading

SteveIb commented Oct 14, 2018

mrgloom commented Oct 18, 2018 • edited Loading

mrgloom commented Oct 18, 2018 • edited Loading

SteveIb commented Oct 25, 2018

poria-cat commented Jan 26, 2019

sonfire186 commented Feb 4, 2019

hernandezfelipe commented Feb 26, 2019

Saving

Loading

ymodak commented Mar 22, 2019

Ezra521 commented Apr 24, 2019

Saving

Loading

Ruomei commented Aug 11, 2020 • edited Loading

drscotthawley commented Oct 7, 2017 •

edited

Loading

edumucelli commented Jun 26, 2018 •

edited

Loading

edumucelli commented Jul 25, 2018 •

edited

Loading

warren30815 commented Aug 16, 2018 •

edited

Loading

mrgloom commented Oct 18, 2018 •

edited

Loading

mrgloom commented Oct 18, 2018 •

edited

Loading

Ruomei commented Aug 11, 2020 •

edited

Loading