Script started on Wed Mar 8 12:32:04 2017 anton@velociti:~$ rm -rf ~/CK_TOOLS/tensorflow-prebuilt-cuda-0.12.1-compiler.cuda-8.0.44-lib.cudnn-api-5.1.5-linux-64/ anton@velociti:~$ rm -rf ~/CK_TOOLS/lib- anton@velociti:~$ ck show env --tags=tensorflow anton@velociti:~$ ck run program:tensorflow OS CK UOA: linux-64 (4258b5fe54828a50) OS name: Ubuntu 16.04.2 LTS Short OS name: Linux 4.4.0 Long OS name: Linux-4.4.0-66-generic-x86_64-with-Ubuntu-16.04-xenial OS bits: 64 OS ABI: x86_64 Platform init UOA: 42818da3a0789331 *************************************************************************************** Current directory: /home/anton/CK_REPOS/ck-tensorflow/program/tensorflow/tmp *************************************************************************************** ----------------------------------- Resolving software dependencies ... *** Dependency 1 = lib-tensorflow (TensorFlow library): More than one environment found for "TensorFlow library" with tags="lib,tensorflow" and setup={"target_os_bits": "64", "host_os_uoa": "linux-64", "target_os_uoa": "linux-64"}: 0) TensorFlow library (prebuilt, cuda) - v1.0.0 (64bits,cuda,host-os-linux-64,lib,prebuilt,target-os-linux-64,tensorflow,tensorflow-cuda,v1,v1.0,v1.0.0 (4b0c4fb7a608c8cf)) - Depends on "python" (env UOA=50438264cd5a391a, tags="compiler,python", version=2.7.12) - Depends on "compiler.gcc" (env UOA=f96e16b894aaa81f, tags="compiler,lang-c,gcc", version=6.2.0) - Depends on "compiler.cuda" (env UOA=164da9a7035e7692, tags="compiler,lang-c-cuda", version=8.0.61) - Depends on "lib.cudnn" (env UOA=d44f59eae8e76e5d, tags="lib,cudnn,dnn,cuda", version=api-5.1.5) 1) TensorFlow library (prebuilt, cpu) - v1.0.0 (64bits,cpu,host-os-linux-64,lib,prebuilt,target-os-linux-64,tensorflow,tensorflow-cpu,v1,v1.0,v1.0.0 (6dca1226a214393b)) - Depends on "python" (env UOA=50438264cd5a391a, tags="compiler,python", version=2.7.12) 2) TensorFlow library (cpu) - vmaster-2e8cf80 (64bits,host-os-linux-64,lib,target-os-linux-64,tensorflow,tensorflow-cpu,v0,v0.0 (bdcf77dc8e5843fb)) - Depends on "bazel" (env UOA=cc9192b944ce8da3, tags="tool,bazel", version=0.4.2) - Depends on "python" (env UOA=50438264cd5a391a, tags="compiler,python", version=2.7.12) - Depends on "compiler.gcc" (env UOA=f96e16b894aaa81f, tags="compiler,lang-c,gcc", version=6.2.0) Select one of the options for "TensorFlow library" with tags="lib,tensorflow" and setup={"target_os_bits": "64", "host_os_uoa": "linux-64", "target_os_uoa": "linux-64"} or press Enter for 0: Resolved. CK environment UID = 4b0c4fb7a608c8cf ----------------------------------- ----------------------------------- Resolving software dependencies ... ----------------------------------- More than one dataset entry is found for this program: 0) benchmark-alexnet (c3507a94b6bb1b06) 1) benchmark-googlenet (4749ebaa906b9b1b) 2) benchmark-overfeat (7f8e2860005615f4) Select dataset UOA (or Enter to select 0): 1 *************************************************************************************** *************************************************************************************** Prepared script: #! /bin/bash export PATH=/home/anton/CK_REPOS/ck-env/platform.init/generic-linux:$PATH . /home/anton/CK_REPOS/local/env/4b0c4fb7a608c8cf/env.sh export BATCH_SIZE=32 export NUM_BATCHES=25 export CK_DATASET_PATH=/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/ export CK_DATASET_FILENAME=benchmark-googlenet.py echo executing code ... ${CK_ENV_COMPILER_PYTHON_FILE} /home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py --batch_size=${BATCH_SIZE} --num_batches=${NUM_BATCHES} *************************************************************************************** (bash -c "chmod 755 ./tmp-pzE8UT.sh; . ./tmp-pzE8UT.sh") (sleep 0.5 sec ...) (run ...) executing code ... I tensorflow/stream_executor/dso_loader.cc:135] successfully opened CUDA library libcublas.so.8.0 locally I tensorflow/stream_executor/dso_loader.cc:135] successfully opened CUDA library libcudnn.so.5 locally I tensorflow/stream_executor/dso_loader.cc:135] successfully opened CUDA library libcufft.so.8.0 locally I tensorflow/stream_executor/dso_loader.cc:135] successfully opened CUDA library libcuda.so.1 locally I tensorflow/stream_executor/dso_loader.cc:135] successfully opened CUDA library libcurand.so.8.0 locally Traceback (most recent call last): File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 264, in tf.app.run() File "/home/anton/CK_TOOLS/tensorflow-prebuilt-cuda-1.0.0-compiler.cuda-8.0.61-lib.cudnn-api-5.1.5-linux-64/lib/tensorflow/python/platform/app.py", line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 260, in main run_benchmark() File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 224, in run_benchmark last_layer = inference(images) File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 154, in inference incept3a = _inception(pool3, 192, 64, 96, 128, 16, 32, 3, 32) File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 131, in _inception incept = tf.concat(channel_dim, [conv1, conv3, conv5, pool]) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-cuda-1.0.0-compiler.cuda-8.0.61-lib.cudnn-api-5.1.5-linux-64/lib/tensorflow/python/ops/array_ops.py", line 1047, in concat dtype=dtypes.int32).get_shape( File "/home/anton/CK_TOOLS/tensorflow-prebuilt-cuda-1.0.0-compiler.cuda-8.0.61-lib.cudnn-api-5.1.5-linux-64/lib/tensorflow/python/framework/ops.py", line 651, in convert_to_tensor as_ref=False) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-cuda-1.0.0-compiler.cuda-8.0.61-lib.cudnn-api-5.1.5-linux-64/lib/tensorflow/python/framework/ops.py", line 716, in internal_convert_to_tensor ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-cuda-1.0.0-compiler.cuda-8.0.61-lib.cudnn-api-5.1.5-linux-64/lib/tensorflow/python/framework/constant_op.py", line 176, in _constant_tensor_conversion_function return constant(v, dtype=dtype, name=name) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-cuda-1.0.0-compiler.cuda-8.0.61-lib.cudnn-api-5.1.5-linux-64/lib/tensorflow/python/framework/constant_op.py", line 165, in constant tensor_util.make_tensor_proto(value, dtype=dtype, shape=shape, verify_shape=verify_shape)) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-cuda-1.0.0-compiler.cuda-8.0.61-lib.cudnn-api-5.1.5-linux-64/lib/tensorflow/python/framework/tensor_util.py", line 367, in make_tensor_proto _AssertCompatible(values, dtype) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-cuda-1.0.0-compiler.cuda-8.0.61-lib.cudnn-api-5.1.5-linux-64/lib/tensorflow/python/framework/tensor_util.py", line 302, in _AssertCompatible (dtype.name, repr(mismatch), type(mismatch).__name__)) TypeError: Expected int32, got list containing Tensors of type '_Message' instead. Execution time: 1.322 sec. Program execution likely failed (return code 1 !=0 )! anton@velociti:~$ ck run program:tensorflow OS CK UOA: linux-64 (4258b5fe54828a50) OS name: Ubuntu 16.04.2 LTS Short OS name: Linux 4.4.0 Long OS name: Linux-4.4.0-66-generic-x86_64-with-Ubuntu-16.04-xenial OS bits: 64 OS ABI: x86_64 Platform init UOA: 42818da3a0789331 *************************************************************************************** Current directory: /home/anton/CK_REPOS/ck-tensorflow/program/tensorflow/tmp *************************************************************************************** ----------------------------------- Resolving software dependencies ... *** Dependency 1 = lib-tensorflow (TensorFlow library): More than one environment found for "TensorFlow library" with tags="lib,tensorflow" and setup={"target_os_bits": "64", "host_os_uoa": "linux-64", "target_os_uoa": "linux-64"}: 0) TensorFlow library (prebuilt, cuda) - v1.0.0 (64bits,cuda,host-os-linux-64,lib,prebuilt,target-os-linux-64,tensorflow,tensorflow-cuda,v1,v1.0,v1.0.0 (4b0c4fb7a608c8cf)) - Depends on "python" (env UOA=50438264cd5a391a, tags="compiler,python", version=2.7.12) - Depends on "compiler.gcc" (env UOA=f96e16b894aaa81f, tags="compiler,lang-c,gcc", version=6.2.0) - Depends on "compiler.cuda" (env UOA=164da9a7035e7692, tags="compiler,lang-c-cuda", version=8.0.61) - Depends on "lib.cudnn" (env UOA=d44f59eae8e76e5d, tags="lib,cudnn,dnn,cuda", version=api-5.1.5) 1) TensorFlow library (prebuilt, cpu) - v1.0.0 (64bits,cpu,host-os-linux-64,lib,prebuilt,target-os-linux-64,tensorflow,tensorflow-cpu,v1,v1.0,v1.0.0 (6dca1226a214393b)) - Depends on "python" (env UOA=50438264cd5a391a, tags="compiler,python", version=2.7.12) 2) TensorFlow library (cpu) - vmaster-2e8cf80 (64bits,host-os-linux-64,lib,target-os-linux-64,tensorflow,tensorflow-cpu,v0,v0.0 (bdcf77dc8e5843fb)) - Depends on "bazel" (env UOA=cc9192b944ce8da3, tags="tool,bazel", version=0.4.2) - Depends on "python" (env UOA=50438264cd5a391a, tags="compiler,python", version=2.7.12) - Depends on "compiler.gcc" (env UOA=f96e16b894aaa81f, tags="compiler,lang-c,gcc", version=6.2.0) Select one of the options for "TensorFlow library" with tags="lib,tensorflow" and setup={"target_os_bits": "64", "host_os_uoa": "linux-64", "target_os_uoa": "linux-64"} or press Enter for 0: 1 Resolved. CK environment UID = 6dca1226a214393b ----------------------------------- ----------------------------------- Resolving software dependencies ... ----------------------------------- More than one dataset entry is found for this program: 0) benchmark-alexnet (c3507a94b6bb1b06) 1) benchmark-googlenet (4749ebaa906b9b1b) 2) benchmark-overfeat (7f8e2860005615f4) Select dataset UOA (or Enter to select 0): 1 *************************************************************************************** *************************************************************************************** Prepared script: #! /bin/bash export PATH=/home/anton/CK_REPOS/ck-env/platform.init/generic-linux:$PATH . /home/anton/CK_REPOS/local/env/6dca1226a214393b/env.sh export BATCH_SIZE=32 export NUM_BATCHES=25 export CK_DATASET_PATH=/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/ export CK_DATASET_FILENAME=benchmark-googlenet.py echo executing code ... ${CK_ENV_COMPILER_PYTHON_FILE} /home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py --batch_size=${BATCH_SIZE} --num_batches=${NUM_BATCHES} *************************************************************************************** (bash -c "chmod 755 ./tmp-l6zG3c.sh; . ./tmp-l6zG3c.sh") (sleep 0.5 sec ...) (run ...) executing code ... Traceback (most recent call last): File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 264, in tf.app.run() File "/home/anton/CK_TOOLS/tensorflow-prebuilt-1.0.0-linux-64/lib/tensorflow/python/platform/app.py", line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 260, in main run_benchmark() File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 224, in run_benchmark last_layer = inference(images) File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 154, in inference incept3a = _inception(pool3, 192, 64, 96, 128, 16, 32, 3, 32) File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 131, in _inception incept = tf.concat(channel_dim, [conv1, conv3, conv5, pool]) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-1.0.0-linux-64/lib/tensorflow/python/ops/array_ops.py", line 1047, in concat dtype=dtypes.int32).get_shape( File "/home/anton/CK_TOOLS/tensorflow-prebuilt-1.0.0-linux-64/lib/tensorflow/python/framework/ops.py", line 651, in convert_to_tensor as_ref=False) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-1.0.0-linux-64/lib/tensorflow/python/framework/ops.py", line 716, in internal_convert_to_tensor ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-1.0.0-linux-64/lib/tensorflow/python/framework/constant_op.py", line 176, in _constant_tensor_conversion_function return constant(v, dtype=dtype, name=name) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-1.0.0-linux-64/lib/tensorflow/python/framework/constant_op.py", line 165, in constant tensor_util.make_tensor_proto(value, dtype=dtype, shape=shape, verify_shape=verify_shape)) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-1.0.0-linux-64/lib/tensorflow/python/framework/tensor_util.py", line 367, in make_tensor_proto _AssertCompatible(values, dtype) File "/home/anton/CK_TOOLS/tensorflow-prebuilt-1.0.0-linux-64/lib/tensorflow/python/framework/tensor_util.py", line 302, in _AssertCompatible (dtype.name, repr(mismatch), type(mismatch).__name__)) TypeError: Expected int32, got list containing Tensors of type '_Message' instead. Execution time: 1.159 sec. Program execution likely failed (return code 1 !=0 )! anton@velociti:~$ ck run program:tensorflow OS CK UOA: linux-64 (4258b5fe54828a50) OS name: Ubuntu 16.04.2 LTS Short OS name: Linux 4.4.0 Long OS name: Linux-4.4.0-66-generic-x86_64-with-Ubuntu-16.04-xenial OS bits: 64 OS ABI: x86_64 Platform init UOA: 42818da3a0789331 *************************************************************************************** Current directory: /home/anton/CK_REPOS/ck-tensorflow/program/tensorflow/tmp *************************************************************************************** ----------------------------------- Resolving software dependencies ... *** Dependency 1 = lib-tensorflow (TensorFlow library): More than one environment found for "TensorFlow library" with tags="lib,tensorflow" and setup={"target_os_bits": "64", "host_os_uoa": "linux-64", "target_os_uoa": "linux-64"}: 0) TensorFlow library (prebuilt, cuda) - v1.0.0 (64bits,cuda,host-os-linux-64,lib,prebuilt,target-os-linux-64,tensorflow,tensorflow-cuda,v1,v1.0,v1.0.0 (4b0c4fb7a608c8cf)) - Depends on "python" (env UOA=50438264cd5a391a, tags="compiler,python", version=2.7.12) - Depends on "compiler.gcc" (env UOA=f96e16b894aaa81f, tags="compiler,lang-c,gcc", version=6.2.0) - Depends on "compiler.cuda" (env UOA=164da9a7035e7692, tags="compiler,lang-c-cuda", version=8.0.61) - Depends on "lib.cudnn" (env UOA=d44f59eae8e76e5d, tags="lib,cudnn,dnn,cuda", version=api-5.1.5) 1) TensorFlow library (prebuilt, cpu) - v1.0.0 (64bits,cpu,host-os-linux-64,lib,prebuilt,target-os-linux-64,tensorflow,tensorflow-cpu,v1,v1.0,v1.0.0 (6dca1226a214393b)) - Depends on "python" (env UOA=50438264cd5a391a, tags="compiler,python", version=2.7.12) 2) TensorFlow library (cpu) - vmaster-2e8cf80 (64bits,host-os-linux-64,lib,target-os-linux-64,tensorflow,tensorflow-cpu,v0,v0.0 (bdcf77dc8e5843fb)) - Depends on "bazel" (env UOA=cc9192b944ce8da3, tags="tool,bazel", version=0.4.2) - Depends on "python" (env UOA=50438264cd5a391a, tags="compiler,python", version=2.7.12) - Depends on "compiler.gcc" (env UOA=f96e16b894aaa81f, tags="compiler,lang-c,gcc", version=6.2.0) Select one of the options for "TensorFlow library" with tags="lib,tensorflow" and setup={"target_os_bits": "64", "host_os_uoa": "linux-64", "target_os_uoa": "linux-64"} or press Enter for 0: 2 Resolved. CK environment UID = bdcf77dc8e5843fb ----------------------------------- ----------------------------------- Resolving software dependencies ... ----------------------------------- More than one dataset entry is found for this program: 0) benchmark-alexnet (c3507a94b6bb1b06) 1) benchmark-googlenet (4749ebaa906b9b1b) 2) benchmark-overfeat (7f8e2860005615f4) Select dataset UOA (or Enter to select 0): 1 *************************************************************************************** *************************************************************************************** Prepared script: #! /bin/bash export PATH=/home/anton/CK_REPOS/ck-env/platform.init/generic-linux:$PATH . /home/anton/CK_REPOS/local/env/bdcf77dc8e5843fb/env.sh export BATCH_SIZE=32 export NUM_BATCHES=25 export CK_DATASET_PATH=/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/ export CK_DATASET_FILENAME=benchmark-googlenet.py echo executing code ... ${CK_ENV_COMPILER_PYTHON_FILE} /home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py --batch_size=${BATCH_SIZE} --num_batches=${NUM_BATCHES} *************************************************************************************** (bash -c "chmod 755 ./tmp-bU7QsQ.sh; . ./tmp-bU7QsQ.sh") (sleep 0.5 sec ...) (run ...) executing code ... Traceback (most recent call last): File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 264, in tf.app.run() File "/home/anton/CK_TOOLS/tensorflow-master-linux-64/lib/tensorflow/python/platform/app.py", line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 260, in main run_benchmark() File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 224, in run_benchmark last_layer = inference(images) File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 154, in inference incept3a = _inception(pool3, 192, 64, 96, 128, 16, 32, 3, 32) File "/home/anton/CK_REPOS/ck-tensorflow/dataset/benchmark-googlenet/benchmark-googlenet.py", line 131, in _inception incept = tf.concat(channel_dim, [conv1, conv3, conv5, pool]) File "/home/anton/CK_TOOLS/tensorflow-master-linux-64/lib/tensorflow/python/ops/array_ops.py", line 1029, in concat dtype=dtypes.int32).get_shape( File "/home/anton/CK_TOOLS/tensorflow-master-linux-64/lib/tensorflow/python/framework/ops.py", line 639, in convert_to_tensor as_ref=False) File "/home/anton/CK_TOOLS/tensorflow-master-linux-64/lib/tensorflow/python/framework/ops.py", line 704, in internal_convert_to_tensor ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref) File "/home/anton/CK_TOOLS/tensorflow-master-linux-64/lib/tensorflow/python/framework/constant_op.py", line 113, in _constant_tensor_conversion_function return constant(v, dtype=dtype, name=name) File "/home/anton/CK_TOOLS/tensorflow-master-linux-64/lib/tensorflow/python/framework/constant_op.py", line 102, in constant tensor_util.make_tensor_proto(value, dtype=dtype, shape=shape, verify_shape=verify_shape)) File "/home/anton/CK_TOOLS/tensorflow-master-linux-64/lib/tensorflow/python/framework/tensor_util.py", line 370, in make_tensor_proto _AssertCompatible(values, dtype) File "/home/anton/CK_TOOLS/tensorflow-master-linux-64/lib/tensorflow/python/framework/tensor_util.py", line 302, in _AssertCompatible (dtype.name, repr(mismatch), type(mismatch).__name__)) TypeError: Expected int32, got list containing Tensors of type '_Message' instead. Execution time: 1.210 sec. Program execution likely failed (return code 1 !=0 )! anton@velociti:~$ exit Script done on Wed Mar 8 12:32:38 2017