17/05/09 17:49:12 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2017-05-09 17:49:15,296 INFO (MainThread-16496) connected to server at ('ladrillo', 42424) 2017-05-09 17:49:15,298 INFO (MainThread-16496) TFSparkNode.reserve: {'authkey': '', 'worker_num': 0, 'host': 'ladrillo', 'tb_port': 0, 'addr': ('ladrillo', 42155), 'ppid': 16446, 'task_index': 0, 'job_name': 'ps', 'tb_pid': 0, 'port': 37124} 2017-05-09 17:49:16,303 INFO (MainThread-16496) node: {'addr': ('ladrillo', 42155), 'task_index': 0, 'job_name': 'ps', 'authkey': '', 'worker_num': 0, 'host': 'ladrillo', 'ppid': 16446, 'port': 37124, 'tb_pid': 0, 'tb_port': 0} 2017-05-09 17:49:16,304 INFO (MainThread-16496) node: {'addr': '/tmp/pymp-w2W0X2/listener-ZJ6Jir', 'task_index': 0, 'job_name': 'worker', 'authkey': '', 'worker_num': 1, 'host': 'ladrillo', 'ppid': 16448, 'port': 41355, 'tb_pid': 0, 'tb_port': 0} 2017-05-09 17:49:16,304 INFO (MainThread-16496) Starting TensorFlow ps:0 on cluster node 0 on background process I tensorflow/stream_executor/dso_loader.cc:128] successfully opened CUDA library libcublas.so locally I tensorflow/stream_executor/dso_loader.cc:128] successfully opened CUDA library libcudnn.so locally I tensorflow/stream_executor/dso_loader.cc:128] successfully opened CUDA library libcufft.so locally I tensorflow/stream_executor/dso_loader.cc:128] successfully opened CUDA library libcuda.so.1 locally I tensorflow/stream_executor/dso_loader.cc:128] successfully opened CUDA library libcurand.so locally 2017-05-09 17:49:21,897 INFO (MainThread-16514) 0: ======== ps:0 ======== 2017-05-09 17:49:21,898 INFO (MainThread-16514) 0: Cluster spec: {'ps': ['ladrillo:37124'], 'worker': ['ladrillo:41355']} 2017-05-09 17:49:21,907 INFO (MainThread-16514) 0: Using GPU: 0 I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:937] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero I tensorflow/core/common_runtime/gpu/gpu_device.cc:885] Found device 0 with properties: name: GeForce GTX 950M major: 5 minor: 0 memoryClockRate (GHz) 0.928 pciBusID 0000:01:00.0 Total memory: 1.96GiB Free memory: 173.69MiB I tensorflow/core/common_runtime/gpu/gpu_device.cc:906] DMA: 0 I tensorflow/core/common_runtime/gpu/gpu_device.cc:916] 0: Y I tensorflow/core/common_runtime/gpu/gpu_device.cc:975] Creating TensorFlow device (/gpu:0) -> (device: 0, name: GeForce GTX 950M, pci bus id: 0000:01:00.0) E tensorflow/stream_executor/cuda/cuda_driver.cc:1002] failed to allocate 173.69M (182124544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY I tensorflow/core/distributed_runtime/rpc/grpc_channel.cc:197] Initialize GrpcChannelCache for job ps -> {0 -> localhost:37124} I tensorflow/core/distributed_runtime/rpc/grpc_channel.cc:197] Initialize GrpcChannelCache for job worker -> {0 -> ladrillo:41355} I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:211] Started server with target: grpc://localhost:37124