2020-11-07 22:09:39.155137: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1 org.tensorflow.NativeLibrary: isLoaded: true Hello TensorFlow 2.3.1 org.tensorflow.NativeLibrary: isLoaded: true 2020-11-07 22:09:48.517471: I external/org_tensorflow/tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN)to use the following CPU instructions in performance-critical operations: AVX2 FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2020-11-07 22:09:48.518629: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcuda.so.1 2020-11-07 22:09:48.623310: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties: pciBusID: 0001:00:00.0 name: Tesla V100-PCIE-16GB computeCapability: 7.0 coreClock: 1.38GHz coreCount: 80 deviceMemorySize: 15.78GiB deviceMemoryBandwidth: 836.37GiB/s 2020-11-07 22:09:48.623353: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1 2020-11-07 22:09:48.625366: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10 2020-11-07 22:09:48.626890: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10 2020-11-07 22:09:48.627271: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10 2020-11-07 22:09:48.629184: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10 2020-11-07 22:09:48.630309: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10 2020-11-07 22:09:48.634272: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.7 2020-11-07 22:09:48.635883: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0 2020-11-07 22:09:48.635920: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1 2020-11-07 22:09:49.316855: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix: 2020-11-07 22:09:49.316914: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1263] 0 2020-11-07 22:09:49.316925: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0: N 2020-11-07 22:09:49.319360: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14755 MB memory) -> physical GPU (device: 0, name: Tesla V100-PCIE-16GB, pci bus id: 0001:00:00.0, compute capability: 7.0) 2020-11-07 22:09:49.319885: I external/org_tensorflow/tensorflow/core/common_runtime/direct_session.cc:360] Device mapping: /job:localhost/replica:0/task:0/device:GPU:0 -> device: 0, name: Tesla V100-PCIE-16GB, pci bus id: 0001:00:00.0, compute capability: 7.0 org.tensorflow.NativeLibrary: isLoaded: true 2020-11-07 22:09:52.440368: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Mul: (Mul): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440411: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Mul_1: (Mul): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440423: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Div: (Div): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440431: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Add: (Add): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440439: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] ReduceSum: (Sum): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440448: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] xy: (Mul): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440456: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] xya: (Mul): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440463: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] xyax: (Div): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440470: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] xyaxb: (Add): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440478: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] sum: (Sum): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440487: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const: (Const): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440495: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const_1: (Const): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440502: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const_2: (Const): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440510: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const_3: (Const): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440541: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const_4: (Const): /job:localhost/replica:0/task:0/device:GPU:0 2020-11-07 22:09:52.440551: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const_5: (Const): /job:localhost/replica:0/task:0/device:GPU:0 0.0 Time [s.] 6.260543007 Bye bye Mul: (Mul): /job:localhost/replica:0/task:0/device:GPU:0 Mul_1: (Mul): /job:localhost/replica:0/task:0/device:GPU:0 Div: (Div): /job:localhost/replica:0/task:0/device:GPU:0 Add: (Add): /job:localhost/replica:0/task:0/device:GPU:0 ReduceSum: (Sum): /job:localhost/replica:0/task:0/device:GPU:0 xy: (Mul): /job:localhost/replica:0/task:0/device:GPU:0 xya: (Mul): /job:localhost/replica:0/task:0/device:GPU:0 xyax: (Div): /job:localhost/replica:0/task:0/device:GPU:0 xyaxb: (Add): /job:localhost/replica:0/task:0/device:GPU:0 sum: (Sum): /job:localhost/replica:0/task:0/device:GPU:0 Const: (Const): /job:localhost/replica:0/task:0/device:GPU:0 Const_1: (Const): /job:localhost/replica:0/task:0/device:GPU:0 Const_2: (Const): /job:localhost/replica:0/task:0/device:GPU:0 Const_3: (Const): /job:localhost/replica:0/task:0/device:GPU:0 Const_4: (Const): /job:localhost/replica:0/task:0/device:GPU:0 Const_5: (Const): /job:localhost/replica:0/task:0/device:GPU:0