Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

W tensorflow/core/grappler/utils/graph_view.cc:830] No registered 'swish_f32' OpKernel for GPU devices compatible with node {{node model_1/swish_38/swish_f32}} #24

Closed
bitwangdan opened this issue Mar 23, 2020 · 5 comments

Comments

@bitwangdan
Copy link

This error occurred when I was training on the GPU,Has anyone else experienced this problem?

@KaqiKaqi
Copy link

same warning.

@bitwangdan
Copy link
Author

@KaqiKaqi have you solved it?

@mingxingtan
Copy link
Member

Hmm, I am surprised that swish doesn't work on GPU. If so, could you replace:

relu_fn = tf.nn.swish

with "relu_fn = x * tf.sigmoid(x)"? (they are equivalent but tf.nn.swish is supposed to be more memory efficient)

@mingxingtan
Copy link
Member

As shown in this tutorial, it seems to run well with GPU. closing this issue for now.

@Cocoalate
Copy link

HI, i'm facing the same problem and replace tf.nn.swish with tf.sigmoid works for me. I suppose it's happenning because I'm using tf.compat.v1 to train main.py under tf2.0 environment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants