Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to download model #53

Closed
mohamedaashraf opened this issue May 20, 2018 · 21 comments
Closed

Failed to download model #53

mohamedaashraf opened this issue May 20, 2018 · 21 comments

Comments

@mohamedaashraf
Copy link

mohamedaashraf commented May 20, 2018

From couple hours ago, I tried to download a new model to make classification... but it gave me this message
`

INFO:tensorflow:Using /tmp/tfhub_modules to cache modules.
INFO:tensorflow:Downloading TF-Hub Module 'https://tfhub.dev/google/imagenet/mobilenet_v2_140_224/classification/1'.
Traceback (most recent call last):
File "retrain.py", line 1333, in
tf.app.run(main=main, argv=[sys.argv[0]] + unparsed)
File "/home/mido/.local/lib/python2.7/site-packages/tensorflow/python/platform/app.py", line 126, in run
_sys.exit(main(argv))
File "retrain.py", line 1017, in main
module_spec = hub.load_module_spec(FLAGS.tfhub_module)
File "/home/mido/.local/lib/python2.7/site-packages/tensorflow_hub/native_module.py", line 99, in load_module_spec
path = compressed_module_resolver.get_default().get_module_path(path)
File "/home/mido/.local/lib/python2.7/site-packages/tensorflow_hub/resolver.py", line 385, in get_module_path
return self._get_module_path(handle)
File "/home/mido/.local/lib/python2.7/site-packages/tensorflow_hub/resolver.py", line 467, in _get_module_path
return resolver.get_module_path(handle)
File "/home/mido/.local/lib/python2.7/site-packages/tensorflow_hub/resolver.py", line 385, in get_module_path
return self._get_module_path(handle)
File "/home/mido/.local/lib/python2.7/site-packages/tensorflow_hub/compressed_module_resolver.py", line 105, in _get_module_path
self._lock_file_timeout_sec())
File "/home/mido/.local/lib/python2.7/site-packages/tensorflow_hub/resolver.py", line 313, in atomic_download
download_fn(handle, tmp_dir)
File "/home/mido/.local/lib/python2.7/site-packages/tensorflow_hub/compressed_module_resolver.py", line 101, in download
response = url_opener.open(request)
File "/usr/lib/python2.7/urllib2.py", line 429, in open
response = self._open(req, data)
File "/usr/lib/python2.7/urllib2.py", line 447, in _open
'_open', req)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/lib/python2.7/urllib2.py", line 1241, in https_open
context=self._context)
File "/usr/lib/python2.7/urllib2.py", line 1198, in do_open
raise URLError(err)
urllib2.URLError: <urlopen error [Errno 101] Network is unreachable>
'

I tried to download an existed model to test the problem, but it gives me the same error!
Any help ??
Note :I tried the image modules links on another PC and Internet connection... The links are not responding!
could anyone try to test the module download process, which have been done by Retrain.py code ?

@mohamedaashraf mohamedaashraf changed the title Failed to dwnload model Failed to download model May 20, 2018
@akhorlin
Copy link
Collaborator

Let us know a bit more info about the environment you are running (py, os versions, are you running on corp network that may have restricted access to some external sites), and the code in question.

@mohamedaashraf
Copy link
Author

I'm running on ubuntu, Python codes
And this is my home network, so there is no restricted access there

@mohamedaashraf
Copy link
Author

mohamedaashraf commented May 20, 2018

And I'm using the same retrain.py code from this repo

@akhorlin
Copy link
Collaborator

akhorlin commented May 21, 2018 via email

@mohamedaashraf
Copy link
Author

It's downloading tar file with size more than 400 MB

@mohamedaashraf
Copy link
Author

I will close this issue, since I have found the solution..
I exchanged the download link
https://tfhub.dev/google/imagenet/inception_resnet_v2/classification/1
with
https://storage.googleapis.com/tensorflow-hub/google/imagenet/inception_resnet_v2/classification/1.tar.gz
and now, the download works!

@hansanjie
Copy link

it does not work anymore. I can not download Tf_mode from any of two directories .otherwith, I want download Inception V3 mode, does anyone know the new directory?

@andreyc0d3r
Copy link

im having the same issue

`INFO:tensorflow:Downloading TF-Hub Module 'https://tfhub.dev/google/imagenet/inception_v3/feature_vector/1'.
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 1318, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1239, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1285, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1234, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1026, in _send_output
self.send(msg)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 964, in send
self.connect()
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/http/client.py", line 1400, in connect
server_hostname=server_hostname)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 401, in wrap_socket
_context=self, _session=session)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 808, in init
self.do_handshake()
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 1061, in do_handshake
self._sslobj.do_handshake()
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/ssl.py", line 683, in do_handshake
self._sslobj.do_handshake()
ssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:748)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "retrain.py", line 1333, in
tf.app.run(main=main, argv=[sys.argv[0]] + unparsed)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 126, in run
_sys.exit(main(argv))
File "retrain.py", line 1017, in main
module_spec = hub.load_module_spec(FLAGS.tfhub_module)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow_hub/native_module.py", line 99, in load_module_spec
path = compressed_module_resolver.get_default().get_module_path(path)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow_hub/resolver.py", line 385, in get_module_path
return self._get_module_path(handle)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow_hub/resolver.py", line 467, in _get_module_path
return resolver.get_module_path(handle)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow_hub/resolver.py", line 385, in get_module_path
return self._get_module_path(handle)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow_hub/compressed_module_resolver.py", line 105, in _get_module_path
self._lock_file_timeout_sec())
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow_hub/resolver.py", line 313, in atomic_download
download_fn(handle, tmp_dir)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow_hub/compressed_module_resolver.py", line 101, in download
response = url_opener.open(request)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 526, in open
response = self._open(req, data)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 544, in _open
'_open', req)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 504, in _call_chain
result = func(*args)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 1361, in https_open
context=self._context, check_hostname=self._check_hostname)
File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py", line 1320, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:748)>`

@JIAZHEN
Copy link

JIAZHEN commented Jul 16, 2018

I have the same issue even after I ran Install Certificates.command. Can you please reopen this issue and have a look?

@andresusanopinto
Copy link
Contributor

andresusanopinto commented Jul 17, 2018

Please see discussion in #97.

It appears many have installed software that takes control over ".dev" domain. TensorFlow Hub library then fails to reach the proper server (either with an SSL issue or other obscure error).

Users are highly recomended to switch off their ".dev" hijacking into ".test" [reserved for that purposed], since the ".dev" is nowadays a gTLD.

@andresusanopinto
Copy link
Contributor

If you believe your issue is not due to ".dev", please create a new issue with an error output of running:

$ wget 'https://tfhub.dev/google/nnlm-en-dim128/1?tf-hub-format=compressed' -O /tmp/module.tar.gz

Avoid fallback to links such as "https://storage.googleapis.com/...", as those may break at anytime with no warning. The only stable url for modules hosted in tfhub.dev are the "https://tfhub.dev/" ones.

@TanLingxiao
Copy link

You can download your the model need from url + '?tf-hub-format=compressed', such as 'https://tfhub.dev/google/imagenet/pnasnet_large/classification/2?tf-hub-format=compressed' . This file will be named 'x.tar.gz', then make two file in ‘/tmp/tfhub_modules’ named such as '67f40766542914aa2dd2ec6923c4f353f6d0663c' and '67f40766542914aa2dd2ec6923c4f353f6d0663c.descriptor.txt' ,decompression 1.tar.gz to 67f40766542914aa2dd2ec6923c4f353f6d0663c.

@sivakotich
Copy link

Same issue is observed with python 2.7 also(error mentioned by andreyc0d3r. Any working solutions?

wget 'https://tfhub.dev/google/nnlm-en-dim128/1?tf-hub-format=compressed' -O /tmp/module.tar.gz works fine without any issue

@xieximing
Copy link

I seem have the similar issue for downloading the module. After I imported the import tensorflow_hub as hub then I tried to download a fast-RCNN Module through detector=hub.Module("https://tfhub.dev/google/faster_rcnn/openimages_v4/inception_resnet_v2/1" ) but I got this feedback:

Traceback (most recent call last):
File "", line 1, in
File "/data/xieximing/venv/lib/python2.7/site-packages/tensorflow_hub/module.py", line 105, in init
self._spec = as_module_spec(spec)
File "/data/xieximing/venv/lib/python2.7/site-packages/tensorflow_hub/module.py", line 31, in as_module_spec
return native_module.load_module_spec(spec)
File "/data/xieximing/venv/lib/python2.7/site-packages/tensorflow_hub/native_module.py", line 99, in load_module_spec
path = compressed_module_resolver.get_default().get_module_path(path)
File "/data/xieximing/venv/lib/python2.7/site-packages/tensorflow_hub/compressed_module_resolver.py", line 141, in get_default
HttpCompressedFileResolver(),
File "/data/xieximing/venv/lib/python2.7/site-packages/tensorflow_hub/compressed_module_resolver.py", line 74, in init
self._cache_dir = resolver.tfhub_cache_dir(cache_dir, use_temp=True)
File "/data/xieximing/venv/lib/python2.7/site-packages/tensorflow_hub/resolver.py", line 67, in tfhub_cache_dir
os.getenv(_TFHUB_CACHE_DIR, "") or FLAGS["tfhub_cache_dir"].value or
TypeError: '_FlagValues' object has no attribute 'getitem'

@arnoegw
Copy link
Contributor

arnoegw commented Oct 2, 2018

xieximing, you also filed that as #169. I will respond there.

@perveil
Copy link

perveil commented Apr 5, 2020

embed = hub.Module("https://storage.googleapis.com/tfhub-modules/google/Wiki-words-500-with-normalization")

i had read above comments and make some improvements, but my request don`t have any reponse

@arnoegw
Copy link
Contributor

arnoegw commented Apr 6, 2020

The module handles for use with hub.Module, hub.resolve, etc. can either be a filesystem path or the URL of a web service following tensorflow.org/hub/hosting#protocol. Please try https://tfhub.dev/google/Wiki-words-500-with-normalization/1 instead.

@wAuner
Copy link

wAuner commented Jul 9, 2020

Please see discussion in #97.

It appears many have installed software that takes control over ".dev" domain. TensorFlow Hub library then fails to reach the proper server (either with an SSL issue or other obscure error).

Users are highly recomended to switch off their ".dev" hijacking into ".test" [reserved for that purposed], since the ".dev" is nowadays a gTLD.

@andresusanopinto
Thanks for your reply. I'm also facing this issue. Could you elaborate on this hijacking issue? How could I find out what's responsible for this?

@robindierckx
Copy link

robindierckx commented Mar 9, 2021

got the same error, although it worked with a wget command and with a minimal python script importing only tensorflow and the hub. It turned out to be dependency related. I fixed it by changing initial dependency order:

  # not working
  import csv, os, sys, time, mysql.connector 
  import tensorflow_hub as hub 

into:

  # working
  import tensorflow_hub as hub # must be imported first to avoid tensorflow error: https://github.com/tensorflow/hub/issues/53
  import csv, os, sys, time, mysql.connector 

@muhammadatifaltaf
Copy link

Solved by using this:
module_handle = "https://tfhub.dev/tensorflow/faster_rcnn/resnet101_v1_640x640/1"

model = hub.load(module_handle)

@jinx2018
Copy link

jinx2018 commented Jun 8, 2022

You can try to access by using the mirror image backup in China, Specifically, suppose you are having trouble in accessing

model = hub.load('https://tfhub.dev/google/yamnet/1')

You switch to the mirror image in China, with following:

model = hub.load('https://hub.tensorflow.google.cn/google/yamnet/1')

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests