Vectors of 100 mln elements:

/CPU:0

2020-11-06 07:27:28.631926: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
org.tensorflow.NativeLibrary: isLoaded: true
Hello TensorFlow 2.3.1
org.tensorflow.NativeLibrary: isLoaded: true
2020-11-06 07:27:41.688503: I external/org_tensorflow/tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN)to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2020-11-06 07:27:41.689634: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcuda.so.1
2020-11-06 07:27:41.784424: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties: 
pciBusID: 0001:00:00.0 name: Tesla V100-PCIE-16GB computeCapability: 7.0
coreClock: 1.38GHz coreCount: 80 deviceMemorySize: 15.78GiB deviceMemoryBandwidth: 836.37GiB/s
2020-11-06 07:27:41.784466: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-11-06 07:27:41.786386: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10
2020-11-06 07:27:41.787882: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2020-11-06 07:27:41.788162: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2020-11-06 07:27:41.789950: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2020-11-06 07:27:41.791023: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10
2020-11-06 07:27:41.794868: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.7
2020-11-06 07:27:41.796491: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-11-06 07:27:41.796528: I external/org_tensorflow/tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-11-06 07:27:42.469596: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-11-06 07:27:42.469908: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1263]      0 
2020-11-06 07:27:42.470066: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0:   N 
2020-11-06 07:27:42.472774: I external/org_tensorflow/tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 14755 MB memory) -> physical GPU (device: 0, name: Tesla V100-PCIE-16GB, pci bus id: 0001:00:00.0, compute capability: 7.0)
2020-11-06 07:27:42.473284: I external/org_tensorflow/tensorflow/core/common_runtime/direct_session.cc:360] Device mapping:
/job:localhost/replica:0/task:0/device:GPU:0 -> device: 0, name: Tesla V100-PCIE-16GB, pci bus id: 0001:00:00.0, compute capability: 7.0

org.tensorflow.NativeLibrary: isLoaded: true
2020-11-06 07:27:45.161799: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] xy: (Mul): /job:localhost/replica:0/task:0/device:CPU:0
2020-11-06 07:27:45.161851: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] xya: (Mul): /job:localhost/replica:0/task:0/device:CPU:0
2020-11-06 07:27:45.161864: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] xyax: (Div): /job:localhost/replica:0/task:0/device:CPU:0
2020-11-06 07:27:45.161872: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] xyaxb: (Add): /job:localhost/replica:0/task:0/device:CPU:0
2020-11-06 07:27:45.161880: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] sum: (Sum): /job:localhost/replica:0/task:0/device:CPU:0
2020-11-06 07:27:45.161890: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const: (Const): /job:localhost/replica:0/task:0/device:CPU:0
2020-11-06 07:27:45.161898: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const_1: (Const): /job:localhost/replica:0/task:0/device:CPU:0
2020-11-06 07:27:45.161906: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const_2: (Const): /job:localhost/replica:0/task:0/device:CPU:0
2020-11-06 07:27:45.161914: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const_3: (Const): /job:localhost/replica:0/task:0/device:CPU:0
2020-11-06 07:27:45.161922: I external/org_tensorflow/tensorflow/core/common_runtime/placer.cc:114] Const_4: (Const): /job:localhost/replica:0/task:0/device:CPU:0
9.900320000000021E8
Time [s.] 5.741345239
Bye bye
xy: (Mul): /job:localhost/replica:0/task:0/device:CPU:0
xya: (Mul): /job:localhost/replica:0/task:0/device:CPU:0
xyax: (Div): /job:localhost/replica:0/task:0/device:CPU:0
xyaxb: (Add): /job:localhost/replica:0/task:0/device:CPU:0
sum: (Sum): /job:localhost/replica:0/task:0/device:CPU:0
Const: (Const): /job:localhost/replica:0/task:0/device:CPU:0
Const_1: (Const): /job:localhost/replica:0/task:0/device:CPU:0
Const_2: (Const): /job:localhost/replica:0/task:0/device:CPU:0
Const_3: (Const): /job:localhost/replica:0/task:0/device:CPU:0
Const_4: (Const): /job:localhost/replica:0/task:0/device:CPU:0