Keras - Python 3.6 support #7297

erinjerri · 2017-07-11T00:51:47Z

Will #Keras work with Python 3.6? I'm really tired of downgrading my different versions of Python at this point.

yuyang-huang · 2017-07-11T01:56:31Z

Yes. Currently using 3.6.0 with Keras 2.0.6, no problem with it.

hutauf · 2017-07-11T08:29:57Z

Let me welcome you to the flexible and also beautiful world of Anaconda environments, where you don't need to downgrade anything, you just install exactly that version that you need in parallel to your existing python distribution on whatever platform you are on.

fchollet · 2017-07-11T18:13:28Z

In any case if you find anything in the codebase that is incompatible with Py3.6, that should be fixed, so either report it, or send a PR to fix it (preferred).

…

On 11 July 2017 at 01:30, hutauf ***@***.***> wrote: Let me welcome you to the flexible and also beautiful world of Anaconda environments, where you don't need to downgrade anything, you just install exactly that version that you need in parallel to your existing python distribution on whatever platform you are on. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#7297 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AArWb5CwRjCfaACU8n4zAOJNRo4wm3HPks5sMzKJgaJpZM4OTl4N> .

cclauss · 2017-07-12T06:45:33Z

I found two Python 3 issues below.

For the first one, the fix would be something along the lines of
https://docs.python.org/3/library/2to3.html?highlight=reload#2to3fixer-reload

The second is an issue that a linter like flake8 would catch but should not be a problem for users, I put a fix in anyway in #7300.

I tried to add flake8 to the testing but I failed:
https://github.com/fchollet/keras/pull/7315/files

$ flake8 . --count --select=E901,E999,F821,F822,F823 --show-source --statistics
./docs/autogen.py:71:5: F821 undefined name 'reload'
    reload(sys)
    ^
./keras/utils/io_utils.py:145:21: F821 undefined name 'raw_input'
        get_input = raw_input
                    ^

ryanfox · 2017-07-23T22:48:39Z

With Windows 10, Keras 2.0.6, Python 3.6.1 I'm getting a SystemError: Unknown opcode when I run the line

keras.models.load_model('yolo.h5')

The model is as described here. I have no problems when I switch to Python 3.5.3.

fchollet · 2017-07-23T22:56:05Z

A "SystemError" cannot be a problem with Keras. Semantically, it's an internal problem encountered by your Python interpreter.

…

On 23 July 2017 at 15:48, Ryan Fox ***@***.***> wrote: With Windows 10, Keras 2.0.6, Python 3.6.1 I'm getting a SystemError: Unknown opcode when I run the line keras.models.load_model('yolo.h5') The model is as described here <https://github.com/allanzelener/YAD2K/blob/a42c760ef868bc115e596b56863dc25624d2e756/README.md#quick-start>. I have no problems when I switch to Python 3.5.3. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#7297 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AArWb6hVLpvLy6TgDM3NwtOl27AVlJDXks5sQ83MgaJpZM4OTl4N> .

ryanfox · 2017-07-23T23:43:39Z

Got it. Possibly a tensorflow issue?

In any case, 3.5 is working for me, so I have a workaround. Thank you.

erinjerri · 2017-07-29T02:36:24Z

Runs just fine with mine now, I think I only had issues before bc I had trouble with TF installation on PC (was 1000x easier on a Mac).

dgorissen · 2017-07-31T09:37:07Z

Had exactly the same problem, dropping to 3.5 also fixed it for me

dmitriyse · 2017-09-18T19:51:29Z

Why this issue is closed ?
I am also facing with this problem, and does not know any workaround/solutions.
I tried python 3.6.0, 3.6.2, Keras 1.2.0, 2.0.6 2.0.8 Ubuntu 16.04/ Windows 10 x64
Always the same result SystemError: unknown opcode
(But it was my model, worked in 3.5.3/Keras 1.2.0)
P.S. I am using Theano as a backend.

dmitriyse · 2017-09-20T16:50:19Z

Sorry, I found my problem.
My model was contained compiled lambda which is incompatible between 3.5 and 3.6.
Once I regenerate my model under python 3.6. Everything becomes working.

P.S. my testing environment was ubuntu 16.04 + conda python 3.6.2 + keras 1.2.0

adityapatadia · 2017-10-16T07:53:45Z

@dmitriyse how did you convert compiled lambda function? I am facing same issue.

To match [setup.py](https://github.com/fchollet/keras/blob/master/setup.py#L34). There are a number of questions raised in keras-team#7297 about Python 3.6 support so let's test that version.

dmitriyse · 2017-10-16T09:06:11Z

@adityapatadia, hopefully I found python sources for my model. I don't know any solution to convert python 3.X binary to python 3.Y binary.

To match [setup.py](https://github.com/fchollet/keras/blob/master/setup.py#L34). There are a number of questions raised in #7297 about Python 3.6 support so let's test that version.

adityapatadia · 2017-11-21T13:49:56Z

@dmitriyse I ended up training my model under python 3.6 and use it.

karanbgsr · 2018-02-21T08:43:23Z

Hi, I was facing a similar issue. I tried the following

Rather from command prompt use Anaconda Prompt
Once you have Opened Anaconda prompt install Tensor flow and Keras by the following
conda install tensorflow
conda install keras
Post this open your spyder application and run
import tensorflow works
import keras

PS : The same worked for me

MyVanitar · 2018-05-28T06:06:50Z

You can use conda install -c hesi_m keras to install the latest version of Keras (2.1.6) and Tensorflow(1.8) for you.

anubhav0fnu · 2019-03-20T02:23:41Z

Sorry, I found my problem.
My model was contained compiled lambda which is incompatible between 3.5 and 3.6.
Once I regenerate my model under python 3.6. Everything becomes working.

P.S. my testing environment was ubuntu 16.04 + conda python 3.6.2 + keras 1.2.0

@dmitriyse , How you have regenerated the model? I have downloaded the weight from someone else google drive and using the "YOLOv2" model from .
Could you please suggest on How you have regenerated the model on python3.6?

My system conda environment configuration:

Python 3.6.7 :: Anaconda, Inc.
keras 2.2.4
Tensorflow 1.13.1 backend

Also, could you please explain how a model could be system specific? any suggestions?

dmitriyse · 2019-03-20T22:43:00Z

@anubhav0fnu, no any magic. I have some another DB with the model and performed transform from this source to Keras model under python 3.6. I haven't found any way to convert from 3.5 to 3.6.

Sparsh-Bansal · 2019-07-25T09:04:48Z

I m getting the same error ''SystemError: unknown opcode'' with Python 3.5,3.6,3.7
Please help

cclauss · 2019-07-25T09:15:57Z

Please provide a full stack trace of the error.

Sparsh-Bansal · 2019-07-25T10:02:49Z

@cclauss
Traceback (most recent call last):
File "D:/ML/One_shot_detection/main.py", line 19, in
loaded_model = model_from_json(loaded_model_json)
File "C:\Users\spars\Anaconda3\envs\One_shot_detection\lib\site-packages\tensorflow\python\keras\saving\model_config.py", line 96, in model_from_json
return deserialize(config, custom_objects=custom_objects)
File "C:\Users\spars\Anaconda3\envs\One_shot_detection\lib\site-packages\tensorflow\python\keras\layers\serialization.py", line 89, in deserialize
printable_module_name='layer')
File "C:\Users\spars\Anaconda3\envs\One_shot_detection\lib\site-packages\tensorflow\python\keras\utils\generic_utils.py", line 192, in deserialize_keras_object
list(custom_objects.items())))
File "C:\Users\spars\Anaconda3\envs\One_shot_detection\lib\site-packages\tensorflow\python\keras\engine\network.py", line 1131, in from_config
process_node(layer, node_data)
File "C:\Users\spars\Anaconda3\envs\One_shot_detection\lib\site-packages\tensorflow\python\keras\engine\network.py", line 1089, in process_node
layer(input_tensors, **kwargs)
File "C:\Users\spars\Anaconda3\envs\One_shot_detection\lib\site-packages\tensorflow\python\keras\engine\base_layer.py", line 634, in call
outputs = call_fn(inputs, *args, **kwargs)
File "C:\Users\spars\Anaconda3\envs\One_shot_detection\lib\site-packages\tensorflow\python\keras\layers\core.py", line 785, in call
return self.function(inputs, **arguments)
File "D:/ML/One_shot_detection/model3.py", line 57, in euclidean_distance
x, y = vects
SystemError: unknown opcode

cclauss · 2019-07-25T10:20:22Z

The first and last calls in this stack trace are D:/ML/One_shot_detection. What package is that?

Sparsh-Bansal · 2019-07-25T10:58:21Z

@cclauss
I'm doing face recognition by Siamese Network , Here is my code :
import tensorflow as tf
from tensorflow.python.keras.layers import Conv2D , MaxPool2D , Lambda , Dense , Input , Flatten
from tensorflow.python.keras.layers import BatchNormalization ,Dropout
from tensorflow.python.keras import Sequential
from tensorflow.python.keras.optimizers import rmsprop ,adam
from tensorflow.python.keras.models import Model , load_model ,model_from_json
from tensorflow.python.keras import backend as K
from tensorflow.python.keras.activations import relu , sigmoid ,tanh
import numpy as np
import os
import time
import cv2

def build_model_network():
model = Sequential()

model.add(Conv2D(input_shape=(128,128,3) , filters=64 ,kernel_size=(10,10), activation=relu))

model.add(BatchNormalization())

model.add(Dropout(0.1))

model.add(MaxPool2D(pool_size=(2,2)))

model.add(Conv2D(filters=128 , kernel_size=(7,7) , activation=relu))

model.add(BatchNormalization())

model.add(MaxPool2D(pool_size=(2,2)))

model.add(Conv2D(filters=128 , kernel_size=(4,4) , activation=relu))

model.add(BatchNormalization())

model.add(MaxPool2D(pool_size=(2,2)))

model.add(Conv2D(filters=256 , kernel_size=(4,4) , activation=relu))

model.add(BatchNormalization())

model.add(Dropout(rate=0.1))

model.add(Flatten())

model.add(Dense(units=4096 , activation=sigmoid))

return model
model = build_model_network()
input_x1 = Input(shape=(128,128,3))
input_x2 = Input(shape=(128,128,3))

output_x1 = model(input_x1)
output_x2 = model(input_x2)

def euclidean_distance(vects):
x, y = vects
return K.sqrt(K.sum(K.square(x - y), axis=1, keepdims=True))

def contrastive_loss(y_true, y_pred):
margin = 1
return K.mean(y_true * K.square(y_pred) + (1 - y_true) * K.square(K.maximum(margin - y_pred, 0)))

distance = Lambda(euclidean_distance)([output_x1 , output_x2])
output_ = Dense(1,activation=sigmoid)(distance)

rms = rmsprop()

model = Model([input_x1 , input_x2] , output_)
model.compile(loss=contrastive_loss , optimizer = 'rmsprop')

X1 = np.load('numpy_files/X1.npy',allow_pickle=True)
X2 = np.load('numpy_files/X2.npy' , allow_pickle=True)
Y = np.load('numpy_files/Y.npy' , allow_pickle=True)
print(X1.shape)
print(X1[0])

data_dimension = 128
X11 = X1.reshape( ( X1.shape[0] , 128,128,3 ) ).astype( np.float32 )
X22 = X2.reshape( ( X2.shape[0] , 128,128,3 ) ).astype( np.float32 )

model.fit([X11,X22] , Y , batch_size=5 , epochs=1 , validation_split=None )

#I tried to save and load my model by two ways but getting the same error in both
First : model.save('siamese.h5')
model = load_model('siamese.h5')
Second: model_json = model.to_json()
with open("model_num.json", "w") as json_file:
json_file.write(model_json)
model.save_weights("model_num.h5")
json_file = open('model_num.json', 'r')
loaded_model_json = json_file.read()
json_file.close()
loaded_model = model_from_json(loaded_model_json)
loaded_model.load_weights("model_num.h5")
loaded_model.save('model_num.hdf5')
loaded_model=load_model('model_num.hdf5')

cclauss · 2019-07-25T11:13:04Z

Pasting code in this way loses all indentation. Please edit the code above to add three backticks ``` on a separate line before the code and another three backticks on a separate line after the code.

Sparsh-Bansal · 2019-07-25T11:34:03Z

Lambda layer was causing the problem , now its resolved.
Thanks @cclauss for coordinating .

fqx · 2019-07-31T07:27:31Z

@Sparsh-Bansal I used Lambda layer and have same error, how to resolve it?

annong · 2020-12-29T09:52:17Z

@Sparsh-Bansal I used Lambda layer and have same error, how to resolve it?
I used class SamplingLayer(Layer): to define myself layer to replace the lambda layer. The problem was solved.

erinjerri closed this as completed Jul 29, 2017

cclauss mentioned this issue Oct 16, 2017

Upgrade Travis testing from Python 3.5 to 3.6 #8148

Merged

Dapid mentioned this issue Mar 8, 2018

A model saved with Python3.5 cannot be loaded in Python3.6 #9595

Closed

yasharmaster mentioned this issue Apr 12, 2019

Trained models not working in Python 3.6+ Vladkryvoruchko/PSPNet-Keras-tensorflow#63

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Keras - Python 3.6 support #7297

Keras - Python 3.6 support #7297

erinjerri commented Jul 11, 2017

yuyang-huang commented Jul 11, 2017 •

edited

hutauf commented Jul 11, 2017

fchollet commented Jul 11, 2017 via email

cclauss commented Jul 12, 2017 •

edited

ryanfox commented Jul 23, 2017

fchollet commented Jul 23, 2017 via email

ryanfox commented Jul 23, 2017

erinjerri commented Jul 29, 2017

dgorissen commented Jul 31, 2017

dmitriyse commented Sep 18, 2017 •

edited

dmitriyse commented Sep 20, 2017

adityapatadia commented Oct 16, 2017

dmitriyse commented Oct 16, 2017

adityapatadia commented Nov 21, 2017

karanbgsr commented Feb 21, 2018

MyVanitar commented May 28, 2018

anubhav0fnu commented Mar 20, 2019

dmitriyse commented Mar 20, 2019

Sparsh-Bansal commented Jul 25, 2019

cclauss commented Jul 25, 2019

Sparsh-Bansal commented Jul 25, 2019

cclauss commented Jul 25, 2019

Sparsh-Bansal commented Jul 25, 2019

cclauss commented Jul 25, 2019

Sparsh-Bansal commented Jul 25, 2019

fqx commented Jul 31, 2019

annong commented Dec 29, 2020

Keras - Python 3.6 support #7297

Keras - Python 3.6 support #7297

Comments

erinjerri commented Jul 11, 2017

yuyang-huang commented Jul 11, 2017 • edited

hutauf commented Jul 11, 2017

fchollet commented Jul 11, 2017 via email

cclauss commented Jul 12, 2017 • edited

ryanfox commented Jul 23, 2017

fchollet commented Jul 23, 2017 via email

ryanfox commented Jul 23, 2017

erinjerri commented Jul 29, 2017

dgorissen commented Jul 31, 2017

dmitriyse commented Sep 18, 2017 • edited

dmitriyse commented Sep 20, 2017

adityapatadia commented Oct 16, 2017

dmitriyse commented Oct 16, 2017

adityapatadia commented Nov 21, 2017

karanbgsr commented Feb 21, 2018

MyVanitar commented May 28, 2018

anubhav0fnu commented Mar 20, 2019

dmitriyse commented Mar 20, 2019

Sparsh-Bansal commented Jul 25, 2019

cclauss commented Jul 25, 2019

Sparsh-Bansal commented Jul 25, 2019

cclauss commented Jul 25, 2019

Sparsh-Bansal commented Jul 25, 2019

cclauss commented Jul 25, 2019

Sparsh-Bansal commented Jul 25, 2019

fqx commented Jul 31, 2019

annong commented Dec 29, 2020

yuyang-huang commented Jul 11, 2017 •

edited

cclauss commented Jul 12, 2017 •

edited

dmitriyse commented Sep 18, 2017 •

edited