You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
import tensorflow as tf
tf.io.gfile.exists("gs://tfds-data")
Link to logs
2019-02-03 02:03:50.095060: I tensorflow/core/platform/cloud/retrying_utils.cc:73] The operation failed and will be automatically retried in 1.92628 seconds (attempt 10 out of 10), caused by: Unavailable: Error executing an HTTP request: libcurl code 6 meaning 'Couldn't resolve host name', error details: Couldn't resolve host 'metadata'
2019-02-03 02:03:52.022467: W tensorflow/core/platform/cloud/google_auth_provider.cc:157] All attempts to get a Google authentication bearer token failed, returning an empty token. Retrieving token from files failed with "Not found: Could not locate the credentials file.". Retrieving token from GCE failed with "Aborted: All 10 retry attempts failed. The last failure: Unavailable: Error executing an HTTP request: libcurl code 6 meaning 'Couldn't resolve host name', error details: Couldn't resolve host 'metadata'".
Additional context
Clearly a problem with TensorFlow. But would be nice to not have these logs dumped (10 retries). They go away on subsequent access to GCS. Seems to be just on first access. And nothing crashes or breaks, just wait for the 10 retries to be done and move on. Annoying.
One alternative for now may be to use requests to use the HTTP API for GCS access to the TFDS bucket (similar to #36).
The text was updated successfully, but these errors were encountered:
Short description
Spurious logging from GCS access when using
tfds.load
. From metadata file access internally.Environment information
tensorflow-datasets
/tfds-nightly
version:tfds-nightly
tensorflow
/tensorflow-gpu
/tf-nightly
/tf-nightly-gpu
version:tf-nightly
Reproduction instructions
Link to logs
Additional context
Clearly a problem with TensorFlow. But would be nice to not have these logs dumped (10 retries). They go away on subsequent access to GCS. Seems to be just on first access. And nothing crashes or breaks, just wait for the 10 retries to be done and move on. Annoying.
One alternative for now may be to use
requests
to use the HTTP API for GCS access to the TFDS bucket (similar to #36).The text was updated successfully, but these errors were encountered: