WARNING: Logging before flag parsing goes to stderr. W0423 04:03:08.783642 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/ops/py_x_ops.py:26: The name tf.resource_loader.get_path_to_datafile is deprecated. Please use tf.compat.v1.resource_loader.get_path_to_datafile instead. W0423 04:03:08.802489 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/py_utils.py:1234: The name tf.get_variable_scope is deprecated. Please use tf.compat.v1.get_variable_scope instead. W0423 04:03:08.895977 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py:1554: The name tf.app.run is deprecated. Please use tf.compat.v1.app.run instead. W0423 04:03:08.896478 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/model_imports.py:46: The name tf.logging.info is deprecated. Please use tf.compat.v1.logging.info instead. I0423 04:03:08.896559 140323924080384 model_imports.py:46] Importing lingvo.tasks.asr.params W0423 04:03:08.911967 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/model_registry.py:121: The name tf.logging.debug is deprecated. Please use tf.compat.v1.logging.debug instead. I0423 04:03:08.912065 140323924080384 model_registry.py:124] Registering models from module: lingvo.tasks.asr.params.librispeech I0423 04:03:08.914588 140323924080384 model_imports.py:46] Importing lingvo.tasks.image.params I0423 04:03:08.915968 140323924080384 model_registry.py:124] Registering models from module: lingvo.tasks.image.params.mnist I0423 04:03:08.916066 140323924080384 model_imports.py:46] Importing lingvo.tasks.lm.params I0423 04:03:08.917357 140323924080384 model_registry.py:124] Registering models from module: lingvo.tasks.lm.params.one_billion_wds I0423 04:03:08.918967 140323924080384 model_imports.py:46] Importing lingvo.tasks.mt.params I0423 04:03:08.922133 140323924080384 model_registry.py:124] Registering models from module: lingvo.tasks.mt.params.wmt14_en_de I0423 04:03:08.926175 140323924080384 model_registry.py:124] Registering models from module: lingvo.tasks.mt.params.wmtm16_en_de I0423 04:03:08.926271 140323924080384 model_imports.py:46] Importing lingvo.tasks.punctuator.params I0423 04:03:08.927460 140323924080384 model_registry.py:124] Registering models from module: lingvo.tasks.punctuator.params.codelab W0423 04:03:08.927598 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py:1513: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead. W0423 04:03:08.927699 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py:1513: The name tf.logging.INFO is deprecated. Please use tf.compat.v1.logging.INFO instead. W0423 04:03:08.927824 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py:1381: The name tf.train.Server is deprecated. Please use tf.distribute.Server instead. 2019-04-23 04:03:08.928106: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2019-04-23 04:03:08.944434: I tensorflow/stream_executor/platform/default/dso_loader.cc:43] Successfully opened dynamic library libcuda.so.1 2019-04-23 04:03:11.647241: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x6cbe230 executing computations on platform CUDA. Devices: 2019-04-23 04:03:11.647351: I tensorflow/compiler/xla/service/service.cc:175] StreamExecutor device (0): Tesla P100-PCIE-16GB, Compute Capability 6.0 2019-04-23 04:03:11.647373: I tensorflow/compiler/xla/service/service.cc:175] StreamExecutor device (1): Tesla P100-PCIE-16GB, Compute Capability 6.0 2019-04-23 04:03:11.647390: I tensorflow/compiler/xla/service/service.cc:175] StreamExecutor device (2): Tesla P100-PCIE-16GB, Compute Capability 6.0 2019-04-23 04:03:11.647439: I tensorflow/compiler/xla/service/service.cc:175] StreamExecutor device (3): Tesla P100-PCIE-16GB, Compute Capability 6.0 2019-04-23 04:03:11.657959: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2399910000 Hz 2019-04-23 04:03:11.662866: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x6dfd2d0 executing computations on platform Host. Devices: 2019-04-23 04:03:11.662935: I tensorflow/compiler/xla/service/service.cc:175] StreamExecutor device (0): , 2019-04-23 04:03:11.663850: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1595] Found device 0 with properties: name: Tesla P100-PCIE-16GB major: 6 minor: 0 memoryClockRate(GHz): 1.3285 pciBusID: 0000:02:00.0 totalMemory: 15.90GiB freeMemory: 15.61GiB 2019-04-23 04:03:11.664524: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1595] Found device 1 with properties: name: Tesla P100-PCIE-16GB major: 6 minor: 0 memoryClockRate(GHz): 1.3285 pciBusID: 0000:82:00.0 totalMemory: 15.90GiB freeMemory: 15.61GiB 2019-04-23 04:03:11.665177: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1595] Found device 2 with properties: name: Tesla P100-PCIE-16GB major: 6 minor: 0 memoryClockRate(GHz): 1.3285 pciBusID: 0000:85:00.0 totalMemory: 15.90GiB freeMemory: 15.61GiB 2019-04-23 04:03:11.665824: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1595] Found device 3 with properties: name: Tesla P100-PCIE-16GB major: 6 minor: 0 memoryClockRate(GHz): 1.3285 pciBusID: 0000:86:00.0 totalMemory: 15.90GiB freeMemory: 15.61GiB 2019-04-23 04:03:11.674344: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1718] Adding visible gpu devices: 0, 1, 2, 3 2019-04-23 04:03:11.674994: I tensorflow/stream_executor/platform/default/dso_loader.cc:43] Successfully opened dynamic library libcudart.so.10.0 2019-04-23 04:03:11.682835: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1126] Device interconnect StreamExecutor with strength 1 edge matrix: 2019-04-23 04:03:11.682888: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1132] 0 1 2 3 2019-04-23 04:03:11.682909: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1145] 0: N N N N 2019-04-23 04:03:11.682924: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1145] 1: N N Y Y 2019-04-23 04:03:11.682937: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1145] 2: N Y N Y 2019-04-23 04:03:11.682950: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1145] 3: N Y Y N 2019-04-23 04:03:11.685163: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1266] Created TensorFlow device (/job:local/replica:0/task:0/device:GPU:0 with 15190 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:02:00.0, compute capability: 6.0) 2019-04-23 04:03:11.685840: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1266] Created TensorFlow device (/job:local/replica:0/task:0/device:GPU:1 with 15190 MB memory) -> physical GPU (device: 1, name: Tesla P100-PCIE-16GB, pci bus id: 0000:82:00.0, compute capability: 6.0) 2019-04-23 04:03:11.686499: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1266] Created TensorFlow device (/job:local/replica:0/task:0/device:GPU:2 with 15190 MB memory) -> physical GPU (device: 2, name: Tesla P100-PCIE-16GB, pci bus id: 0000:85:00.0, compute capability: 6.0) 2019-04-23 04:03:11.687089: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1266] Created TensorFlow device (/job:local/replica:0/task:0/device:GPU:3 with 15190 MB memory) -> physical GPU (device: 3, name: Tesla P100-PCIE-16GB, pci bus id: 0000:86:00.0, compute capability: 6.0) 2019-04-23 04:03:11.691052: I tensorflow/core/distributed_runtime/rpc/grpc_channel.cc:250] Initialize GrpcChannelCache for job local -> {0 -> localhost:37959} 2019-04-23 04:03:11.698584: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:365] Started server with target: grpc://localhost:37959 I0423 04:03:11.706604 140323924080384 trainer.py:1261] Job controller start I0423 04:03:11.754673 140323924080384 base_runner.py:67] ============================================================ I0423 04:03:11.767694 140323924080384 base_runner.py:69] allow_implicit_capture : NoneType I0423 04:03:11.767899 140323924080384 base_runner.py:69] cls : type/lingvo.core.base_model/SingleTaskModel I0423 04:03:11.768001 140323924080384 base_runner.py:69] cluster.add_summary : NoneType I0423 04:03:11.768093 140323924080384 base_runner.py:69] cluster.cls : type/lingvo.core.cluster/_Cluster I0423 04:03:11.768179 140323924080384 base_runner.py:69] cluster.controller.cpus_per_replica : 1 I0423 04:03:11.768265 140323924080384 base_runner.py:69] cluster.controller.devices_per_split : 1 I0423 04:03:11.768348 140323924080384 base_runner.py:69] cluster.controller.gpus_per_replica : 4 I0423 04:03:11.768431 140323924080384 base_runner.py:69] cluster.controller.name : '/job:local' I0423 04:03:11.768516 140323924080384 base_runner.py:69] cluster.controller.num_tpu_hosts : 0 I0423 04:03:11.768615 140323924080384 base_runner.py:69] cluster.controller.replicas : 1 I0423 04:03:11.768697 140323924080384 base_runner.py:69] cluster.controller.tpus_per_replica : 0 I0423 04:03:11.768778 140323924080384 base_runner.py:69] cluster.decoder.cpus_per_replica : 1 I0423 04:03:11.768860 140323924080384 base_runner.py:69] cluster.decoder.devices_per_split : 1 I0423 04:03:11.768940 140323924080384 base_runner.py:69] cluster.decoder.gpus_per_replica : 1 I0423 04:03:11.769021 140323924080384 base_runner.py:69] cluster.decoder.name : '/job:local' I0423 04:03:11.769103 140323924080384 base_runner.py:69] cluster.decoder.num_tpu_hosts : 0 I0423 04:03:11.769184 140323924080384 base_runner.py:69] cluster.decoder.replicas : 1 I0423 04:03:11.769264 140323924080384 base_runner.py:69] cluster.decoder.tpus_per_replica : 0 I0423 04:03:11.769345 140323924080384 base_runner.py:69] cluster.evaler.cpus_per_replica : 1 I0423 04:03:11.769426 140323924080384 base_runner.py:69] cluster.evaler.devices_per_split : 1 I0423 04:03:11.769505 140323924080384 base_runner.py:69] cluster.evaler.gpus_per_replica : 1 I0423 04:03:11.769586 140323924080384 base_runner.py:69] cluster.evaler.name : '/job:local' I0423 04:03:11.769665 140323924080384 base_runner.py:69] cluster.evaler.num_tpu_hosts : 0 I0423 04:03:11.769746 140323924080384 base_runner.py:69] cluster.evaler.replicas : 1 I0423 04:03:11.769825 140323924080384 base_runner.py:69] cluster.evaler.tpus_per_replica : 0 I0423 04:03:11.769906 140323924080384 base_runner.py:69] cluster.input.cpus_per_replica : 1 I0423 04:03:11.769988 140323924080384 base_runner.py:69] cluster.input.devices_per_split : 1 I0423 04:03:11.770067 140323924080384 base_runner.py:69] cluster.input.gpus_per_replica : 0 I0423 04:03:11.770148 140323924080384 base_runner.py:69] cluster.input.name : '/job:local' I0423 04:03:11.770227 140323924080384 base_runner.py:69] cluster.input.num_tpu_hosts : 0 I0423 04:03:11.770308 140323924080384 base_runner.py:69] cluster.input.replicas : 0 I0423 04:03:11.770387 140323924080384 base_runner.py:69] cluster.input.tpus_per_replica : 0 I0423 04:03:11.770467 140323924080384 base_runner.py:69] cluster.job : 'controller' I0423 04:03:11.770548 140323924080384 base_runner.py:69] cluster.mode : 'sync' I0423 04:03:11.770627 140323924080384 base_runner.py:69] cluster.ps.cpus_per_replica : 1 I0423 04:03:11.770706 140323924080384 base_runner.py:69] cluster.ps.devices_per_split : 1 I0423 04:03:11.770787 140323924080384 base_runner.py:69] cluster.ps.gpus_per_replica : 0 I0423 04:03:11.770876 140323924080384 base_runner.py:69] cluster.ps.name : '/job:local' I0423 04:03:11.770962 140323924080384 base_runner.py:69] cluster.ps.num_tpu_hosts : 0 I0423 04:03:11.771044 140323924080384 base_runner.py:69] cluster.ps.replicas : 1 I0423 04:03:11.771125 140323924080384 base_runner.py:69] cluster.ps.tpus_per_replica : 0 I0423 04:03:11.771204 140323924080384 base_runner.py:69] cluster.task : 0 I0423 04:03:11.771286 140323924080384 base_runner.py:69] cluster.worker.cpus_per_replica : 1 I0423 04:03:11.771365 140323924080384 base_runner.py:69] cluster.worker.devices_per_split : 4 I0423 04:03:11.771456 140323924080384 base_runner.py:69] cluster.worker.gpus_per_replica : 4 I0423 04:03:11.771539 140323924080384 base_runner.py:69] cluster.worker.name : '/job:local' I0423 04:03:11.771620 140323924080384 base_runner.py:69] cluster.worker.num_tpu_hosts : 0 I0423 04:03:11.771702 140323924080384 base_runner.py:69] cluster.worker.replicas : 1 I0423 04:03:11.771783 140323924080384 base_runner.py:69] cluster.worker.tpus_per_replica : 0 I0423 04:03:11.771862 140323924080384 base_runner.py:69] dtype : float32 I0423 04:03:11.771944 140323924080384 base_runner.py:69] fprop_dtype : NoneType I0423 04:03:11.772023 140323924080384 base_runner.py:69] inference_driver_name : NoneType I0423 04:03:11.772104 140323924080384 base_runner.py:69] input.allow_implicit_capture : NoneType I0423 04:03:11.772183 140323924080384 base_runner.py:69] input.bucket_adjust_every_n : 0 I0423 04:03:11.772264 140323924080384 base_runner.py:69] input.bucket_batch_limit : [8] I0423 04:03:11.772344 140323924080384 base_runner.py:69] input.bucket_upper_bound : [100] I0423 04:03:11.772423 140323924080384 base_runner.py:69] input.cls : type/lingvo.tasks.lm.input_generator/LmInput I0423 04:03:11.772505 140323924080384 base_runner.py:69] input.dtype : float32 I0423 04:03:11.772586 140323924080384 base_runner.py:69] input.file_buffer_size : 10000000 I0423 04:03:11.772666 140323924080384 base_runner.py:69] input.file_parallelism : 10 I0423 04:03:11.772747 140323924080384 base_runner.py:69] input.file_pattern : 'text:/tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled/news.en*' I0423 04:03:11.772830 140323924080384 base_runner.py:69] input.file_random_seed : 301 I0423 04:03:11.772910 140323924080384 base_runner.py:69] input.fixed_input_shape : True I0423 04:03:11.772990 140323924080384 base_runner.py:69] input.flush_every_n : 0 I0423 04:03:11.773071 140323924080384 base_runner.py:69] input.fprop_dtype : NoneType I0423 04:03:11.773150 140323924080384 base_runner.py:69] input.inference_driver_name : NoneType I0423 04:03:11.773231 140323924080384 base_runner.py:69] input.is_eval : NoneType I0423 04:03:11.773310 140323924080384 base_runner.py:69] input.is_inference : NoneType I0423 04:03:11.773390 140323924080384 base_runner.py:69] input.name : '1bwds_train_set' I0423 04:03:11.773469 140323924080384 base_runner.py:69] input.num_batcher_threads : 16 I0423 04:03:11.773550 140323924080384 base_runner.py:69] input.num_samples : 0 I0423 04:03:11.773629 140323924080384 base_runner.py:69] input.pad_to_max_seq_length : False I0423 04:03:11.773709 140323924080384 base_runner.py:69] input.params_init.method : 'xavier' I0423 04:03:11.773788 140323924080384 base_runner.py:69] input.params_init.scale : 1.000001 I0423 04:03:11.773869 140323924080384 base_runner.py:69] input.params_init.seed : NoneType I0423 04:03:11.773947 140323924080384 base_runner.py:69] input.random_seed : NoneType I0423 04:03:11.774028 140323924080384 base_runner.py:69] input.require_sequential_order : False I0423 04:03:11.774107 140323924080384 base_runner.py:69] input.skip_lp_regularization : NoneType I0423 04:03:11.774187 140323924080384 base_runner.py:69] input.source_max_length : NoneType I0423 04:03:11.774266 140323924080384 base_runner.py:69] input.target_max_length : 1024 I0423 04:03:11.774346 140323924080384 base_runner.py:69] input.tokenizer.allow_implicit_capture : NoneType I0423 04:03:11.774425 140323924080384 base_runner.py:69] input.tokenizer.append_eos : True I0423 04:03:11.774506 140323924080384 base_runner.py:69] input.tokenizer.cls : type/lingvo.core.tokenizers/VocabFileTokenizer I0423 04:03:11.774586 140323924080384 base_runner.py:69] input.tokenizer.dtype : float32 I0423 04:03:11.774666 140323924080384 base_runner.py:69] input.tokenizer.fprop_dtype : NoneType I0423 04:03:11.774744 140323924080384 base_runner.py:69] input.tokenizer.inference_driver_name : NoneType I0423 04:03:11.774825 140323924080384 base_runner.py:69] input.tokenizer.is_eval : NoneType I0423 04:03:11.774915 140323924080384 base_runner.py:69] input.tokenizer.is_inference : NoneType I0423 04:03:11.775005 140323924080384 base_runner.py:69] input.tokenizer.load_token_ids_from_vocab : True I0423 04:03:11.775088 140323924080384 base_runner.py:69] input.tokenizer.name : 'tokenizer' I0423 04:03:11.775168 140323924080384 base_runner.py:69] input.tokenizer.ngram_separator : '' I0423 04:03:11.775249 140323924080384 base_runner.py:69] input.tokenizer.ngram_vocab_filepath : NoneType I0423 04:03:11.775330 140323924080384 base_runner.py:69] input.tokenizer.pad_to_max_length : True I0423 04:03:11.775409 140323924080384 base_runner.py:69] input.tokenizer.params_init.method : 'xavier' I0423 04:03:11.775489 140323924080384 base_runner.py:69] input.tokenizer.params_init.scale : 1.000001 I0423 04:03:11.775568 140323924080384 base_runner.py:69] input.tokenizer.params_init.seed : NoneType I0423 04:03:11.775648 140323924080384 base_runner.py:69] input.tokenizer.random_seed : NoneType I0423 04:03:11.775727 140323924080384 base_runner.py:69] input.tokenizer.skip_lp_regularization : NoneType I0423 04:03:11.775808 140323924080384 base_runner.py:69] input.tokenizer.target_eos_id : 2 I0423 04:03:11.775887 140323924080384 base_runner.py:69] input.tokenizer.target_sos_id : 1 I0423 04:03:11.775966 140323924080384 base_runner.py:69] input.tokenizer.target_unk_id : 3 I0423 04:03:11.776046 140323924080384 base_runner.py:69] input.tokenizer.token_vocab_filepath : '/tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/vocab.txt' I0423 04:03:11.776128 140323924080384 base_runner.py:69] input.tokenizer.tokens_delimiter : ' ' I0423 04:03:11.776207 140323924080384 base_runner.py:69] input.tokenizer.vn.global_vn : False I0423 04:03:11.776285 140323924080384 base_runner.py:69] input.tokenizer.vn.per_step_vn : False I0423 04:03:11.776365 140323924080384 base_runner.py:69] input.tokenizer.vn.scale : NoneType I0423 04:03:11.776443 140323924080384 base_runner.py:69] input.tokenizer.vn.seed : NoneType I0423 04:03:11.776524 140323924080384 base_runner.py:69] input.tokenizer.vocab_size : 32000 I0423 04:03:11.776602 140323924080384 base_runner.py:69] input.tokenizer_dict : {} I0423 04:03:11.776681 140323924080384 base_runner.py:69] input.tpu_infeed_parallism : 1 I0423 04:03:11.776761 140323924080384 base_runner.py:69] input.use_per_host_infeed : False I0423 04:03:11.776839 140323924080384 base_runner.py:69] input.use_within_batch_mixing : False I0423 04:03:11.776918 140323924080384 base_runner.py:69] input.vn.global_vn : False I0423 04:03:11.776998 140323924080384 base_runner.py:69] input.vn.per_step_vn : False I0423 04:03:11.777079 140323924080384 base_runner.py:69] input.vn.scale : NoneType I0423 04:03:11.777158 140323924080384 base_runner.py:69] input.vn.seed : NoneType I0423 04:03:11.777236 140323924080384 base_runner.py:69] is_eval : NoneType I0423 04:03:11.777317 140323924080384 base_runner.py:69] is_inference : NoneType I0423 04:03:11.777395 140323924080384 base_runner.py:69] model : 'lm.one_billion_wds.OneBWdsGPipeTransformer@/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/tasks/lm/params/one_billion_wds.py:186' I0423 04:03:11.777481 140323924080384 base_runner.py:69] name : '' I0423 04:03:11.777559 140323924080384 base_runner.py:69] params_init.method : 'xavier' I0423 04:03:11.777638 140323924080384 base_runner.py:69] params_init.scale : 1.000001 I0423 04:03:11.777719 140323924080384 base_runner.py:69] params_init.seed : NoneType I0423 04:03:11.777798 140323924080384 base_runner.py:69] random_seed : NoneType I0423 04:03:11.777878 140323924080384 base_runner.py:69] skip_lp_regularization : NoneType I0423 04:03:11.777956 140323924080384 base_runner.py:69] task.allow_implicit_capture : NoneType I0423 04:03:11.778036 140323924080384 base_runner.py:69] task.cls : type/lingvo.tasks.lm.model/FixedShapeInputLanguageModel I0423 04:03:11.778120 140323924080384 base_runner.py:69] task.decoder : NoneType I0423 04:03:11.778198 140323924080384 base_runner.py:69] task.dtype : float32 I0423 04:03:11.778278 140323924080384 base_runner.py:69] task.encoder : NoneType I0423 04:03:11.778368 140323924080384 base_runner.py:69] task.eval.decoder_samples_per_summary : 0 I0423 04:03:11.778450 140323924080384 base_runner.py:69] task.eval.samples_per_summary : 0 I0423 04:03:11.778548 140323924080384 base_runner.py:69] task.fprop_dtype : NoneType I0423 04:03:11.778626 140323924080384 base_runner.py:69] task.inference_driver_name : NoneType I0423 04:03:11.778704 140323924080384 base_runner.py:69] task.input : NoneType I0423 04:03:11.778783 140323924080384 base_runner.py:69] task.is_eval : NoneType I0423 04:03:11.778861 140323924080384 base_runner.py:69] task.is_inference : NoneType I0423 04:03:11.778964 140323924080384 base_runner.py:69] task.lm.allow_implicit_capture : NoneType I0423 04:03:11.779045 140323924080384 base_runner.py:69] task.lm.atten_dropout_prob : 0.1 I0423 04:03:11.779124 140323924080384 base_runner.py:69] task.lm.cls : type/lingvo.tasks.lm.layers/GPipeTransformerLm I0423 04:03:11.779206 140323924080384 base_runner.py:69] task.lm.dtype : float32 I0423 04:03:11.779284 140323924080384 base_runner.py:69] task.lm.emb.allow_implicit_capture : NoneType I0423 04:03:11.779362 140323924080384 base_runner.py:69] task.lm.emb.apply_pruning : False I0423 04:03:11.779441 140323924080384 base_runner.py:69] task.lm.emb.cls : type/lingvo.core.layers/SimpleEmbeddingLayer I0423 04:03:11.779519 140323924080384 base_runner.py:69] task.lm.emb.dtype : float32 I0423 04:03:11.779597 140323924080384 base_runner.py:69] task.lm.emb.embedding_dim : 2048 I0423 04:03:11.779675 140323924080384 base_runner.py:69] task.lm.emb.fprop_dtype : NoneType I0423 04:03:11.779752 140323924080384 base_runner.py:69] task.lm.emb.fprop_mode : NoneType I0423 04:03:11.779829 140323924080384 base_runner.py:69] task.lm.emb.inference_driver_name : NoneType I0423 04:03:11.779907 140323924080384 base_runner.py:69] task.lm.emb.is_eval : NoneType I0423 04:03:11.779985 140323924080384 base_runner.py:69] task.lm.emb.is_inference : NoneType I0423 04:03:11.780064 140323924080384 base_runner.py:69] task.lm.emb.name : '' I0423 04:03:11.780142 140323924080384 base_runner.py:69] task.lm.emb.params_init.method : 'gaussian' I0423 04:03:11.780219 140323924080384 base_runner.py:69] task.lm.emb.params_init.scale : 0.0220970869121 I0423 04:03:11.780297 140323924080384 base_runner.py:69] task.lm.emb.params_init.seed : NoneType I0423 04:03:11.780374 140323924080384 base_runner.py:69] task.lm.emb.qdomain.default : NoneType I0423 04:03:11.780451 140323924080384 base_runner.py:69] task.lm.emb.random_seed : NoneType I0423 04:03:11.780528 140323924080384 base_runner.py:69] task.lm.emb.skip_lp_regularization : NoneType I0423 04:03:11.780605 140323924080384 base_runner.py:69] task.lm.emb.use_3d_weight_tensor : False I0423 04:03:11.780682 140323924080384 base_runner.py:69] task.lm.emb.use_matmul : False I0423 04:03:11.780760 140323924080384 base_runner.py:69] task.lm.emb.vn.global_vn : False I0423 04:03:11.780838 140323924080384 base_runner.py:69] task.lm.emb.vn.per_step_vn : False I0423 04:03:11.780915 140323924080384 base_runner.py:69] task.lm.emb.vn.scale : NoneType I0423 04:03:11.780992 140323924080384 base_runner.py:69] task.lm.emb.vn.seed : NoneType I0423 04:03:11.781069 140323924080384 base_runner.py:69] task.lm.emb.vocab_size : 32000 I0423 04:03:11.781147 140323924080384 base_runner.py:69] task.lm.fprop_dtype : NoneType I0423 04:03:11.781223 140323924080384 base_runner.py:69] task.lm.inference_driver_name : NoneType I0423 04:03:11.781300 140323924080384 base_runner.py:69] task.lm.input_dropout_prob : 0.0 I0423 04:03:11.781378 140323924080384 base_runner.py:69] task.lm.is_eval : NoneType I0423 04:03:11.781455 140323924080384 base_runner.py:69] task.lm.is_inference : NoneType I0423 04:03:11.781532 140323924080384 base_runner.py:69] task.lm.label_smoother : NoneType I0423 04:03:11.781610 140323924080384 base_runner.py:69] task.lm.model_dim : 2048 I0423 04:03:11.781687 140323924080384 base_runner.py:69] task.lm.name : 'transformerlm' I0423 04:03:11.781765 140323924080384 base_runner.py:69] task.lm.params_init.method : 'xavier' I0423 04:03:11.781842 140323924080384 base_runner.py:69] task.lm.params_init.scale : 1.000001 I0423 04:03:11.781928 140323924080384 base_runner.py:69] task.lm.params_init.seed : NoneType I0423 04:03:11.782006 140323924080384 base_runner.py:69] task.lm.position_emb.allow_implicit_capture : NoneType I0423 04:03:11.782084 140323924080384 base_runner.py:69] task.lm.position_emb.cls : type/lingvo.core.layers/PositionalEmbeddingLayer I0423 04:03:11.782164 140323924080384 base_runner.py:69] task.lm.position_emb.dtype : float32 I0423 04:03:11.782242 140323924080384 base_runner.py:69] task.lm.position_emb.embedding_dim : 2048 I0423 04:03:11.782320 140323924080384 base_runner.py:69] task.lm.position_emb.fprop_dtype : NoneType I0423 04:03:11.782398 140323924080384 base_runner.py:69] task.lm.position_emb.inference_driver_name : NoneType I0423 04:03:11.782476 140323924080384 base_runner.py:69] task.lm.position_emb.is_eval : NoneType I0423 04:03:11.782556 140323924080384 base_runner.py:69] task.lm.position_emb.is_inference : NoneType I0423 04:03:11.782634 140323924080384 base_runner.py:69] task.lm.position_emb.max_timescale : 10000 I0423 04:03:11.782711 140323924080384 base_runner.py:69] task.lm.position_emb.min_timescale : 1 I0423 04:03:11.782790 140323924080384 base_runner.py:69] task.lm.position_emb.name : '' I0423 04:03:11.782876 140323924080384 base_runner.py:69] task.lm.position_emb.params_init.method : 'xavier' I0423 04:03:11.782963 140323924080384 base_runner.py:69] task.lm.position_emb.params_init.scale : 1.000001 I0423 04:03:11.783041 140323924080384 base_runner.py:69] task.lm.position_emb.params_init.seed : NoneType I0423 04:03:11.783121 140323924080384 base_runner.py:69] task.lm.position_emb.random_seed : NoneType I0423 04:03:11.783199 140323924080384 base_runner.py:69] task.lm.position_emb.skip_lp_regularization : NoneType I0423 04:03:11.783277 140323924080384 base_runner.py:69] task.lm.position_emb.trainable_scaling : False I0423 04:03:11.783356 140323924080384 base_runner.py:69] task.lm.position_emb.trainable_scaling_init : 1.0 I0423 04:03:11.783435 140323924080384 base_runner.py:69] task.lm.position_emb.vn.global_vn : False I0423 04:03:11.783513 140323924080384 base_runner.py:69] task.lm.position_emb.vn.per_step_vn : False I0423 04:03:11.783591 140323924080384 base_runner.py:69] task.lm.position_emb.vn.scale : NoneType I0423 04:03:11.783669 140323924080384 base_runner.py:69] task.lm.position_emb.vn.seed : NoneType I0423 04:03:11.783747 140323924080384 base_runner.py:69] task.lm.random_seed : NoneType I0423 04:03:11.783826 140323924080384 base_runner.py:69] task.lm.relu_dropout_prob : 0.0 I0423 04:03:11.783904 140323924080384 base_runner.py:69] task.lm.residual_dropout_prob : 0.1 I0423 04:03:11.783982 140323924080384 base_runner.py:69] task.lm.skip_lp_regularization : NoneType I0423 04:03:11.784060 140323924080384 base_runner.py:69] task.lm.softmax.allow_implicit_capture : NoneType I0423 04:03:11.784137 140323924080384 base_runner.py:69] task.lm.softmax.apply_pruning : False I0423 04:03:11.784215 140323924080384 base_runner.py:69] task.lm.softmax.chunk_size : 4194 I0423 04:03:11.784293 140323924080384 base_runner.py:69] task.lm.softmax.cls : type/lingvo.core.layers/SimpleFullSoftmax I0423 04:03:11.784372 140323924080384 base_runner.py:69] task.lm.softmax.dtype : float32 I0423 04:03:11.784449 140323924080384 base_runner.py:69] task.lm.softmax.fprop_dtype : NoneType I0423 04:03:11.784527 140323924080384 base_runner.py:69] task.lm.softmax.inference_driver_name : NoneType I0423 04:03:11.784605 140323924080384 base_runner.py:69] task.lm.softmax.input_dim : 0 I0423 04:03:11.784682 140323924080384 base_runner.py:69] task.lm.softmax.is_eval : NoneType I0423 04:03:11.784760 140323924080384 base_runner.py:69] task.lm.softmax.is_inference : NoneType I0423 04:03:11.784840 140323924080384 base_runner.py:69] task.lm.softmax.logits_abs_max : NoneType I0423 04:03:11.784917 140323924080384 base_runner.py:69] task.lm.softmax.name : '' I0423 04:03:11.784996 140323924080384 base_runner.py:69] task.lm.softmax.num_classes : 32000 I0423 04:03:11.785074 140323924080384 base_runner.py:69] task.lm.softmax.num_sampled : 0 I0423 04:03:11.785159 140323924080384 base_runner.py:69] task.lm.softmax.num_shards : 16 I0423 04:03:11.785238 140323924080384 base_runner.py:69] task.lm.softmax.params_init.method : 'xavier' I0423 04:03:11.785316 140323924080384 base_runner.py:69] task.lm.softmax.params_init.scale : 1.000001 I0423 04:03:11.785394 140323924080384 base_runner.py:69] task.lm.softmax.params_init.seed : NoneType I0423 04:03:11.785473 140323924080384 base_runner.py:69] task.lm.softmax.qdomain.default : NoneType I0423 04:03:11.785551 140323924080384 base_runner.py:69] task.lm.softmax.random_seed : NoneType I0423 04:03:11.785629 140323924080384 base_runner.py:69] task.lm.softmax.skip_lp_regularization : NoneType I0423 04:03:11.785706 140323924080384 base_runner.py:69] task.lm.softmax.vn.global_vn : False I0423 04:03:11.785785 140323924080384 base_runner.py:69] task.lm.softmax.vn.per_step_vn : False I0423 04:03:11.785864 140323924080384 base_runner.py:69] task.lm.softmax.vn.scale : NoneType I0423 04:03:11.785943 140323924080384 base_runner.py:69] task.lm.softmax.vn.seed : NoneType I0423 04:03:11.786020 140323924080384 base_runner.py:69] task.lm.stack.allow_implicit_capture : NoneType I0423 04:03:11.786098 140323924080384 base_runner.py:69] task.lm.stack.apply_dropout_every_n : 1 I0423 04:03:11.786175 140323924080384 base_runner.py:69] task.lm.stack.batch_dim : 1 I0423 04:03:11.786252 140323924080384 base_runner.py:69] task.lm.stack.cls : type/lingvo.core.layers_with_gpipe/GPipeTransformerStack I0423 04:03:11.786330 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.allow_implicit_capture : NoneType I0423 04:03:11.786407 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.cls : type/lingvo.core.layers_with_gpipe/GPipeTransformerLayer I0423 04:03:11.786485 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.dtype : float32 I0423 04:03:11.786564 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.fprop_dtype : NoneType I0423 04:03:11.786642 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.has_aux_atten : True I0423 04:03:11.786720 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.inference_driver_name : NoneType I0423 04:03:11.786798 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.is_decoder : False I0423 04:03:11.786889 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.is_eval : NoneType I0423 04:03:11.786972 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.is_inference : NoneType I0423 04:03:11.787050 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.is_transparent : False I0423 04:03:11.787127 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.mask_self_atten : True I0423 04:03:11.787205 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.name : '' I0423 04:03:11.787282 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.num_transparent_outputs : 0 I0423 04:03:11.787360 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.output_dim : 0 I0423 04:03:11.787439 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.packed_input : False I0423 04:03:11.787517 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.params_init.method : 'xavier' I0423 04:03:11.787595 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.params_init.scale : 1.000001 I0423 04:03:11.787673 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.params_init.seed : NoneType I0423 04:03:11.787753 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.random_seed : NoneType I0423 04:03:11.787832 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.skip_lp_regularization : NoneType I0423 04:03:11.787909 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.source_dim : 0 I0423 04:03:11.787987 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.add_unnormalized_input : False I0423 04:03:11.788065 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.allow_implicit_capture : NoneType I0423 04:03:11.788144 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_dropout_prob : 0.0 I0423 04:03:11.788232 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_hidden_dim : 0 I0423 04:03:11.788311 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.allow_implicit_capture : NoneType I0423 04:03:11.788388 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.atten_dropout_deterministic : False I0423 04:03:11.788466 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.atten_dropout_prob : 0.0 I0423 04:03:11.788544 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.cls : type/lingvo.core.attention/MultiHeadedAttention I0423 04:03:11.788649 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.context_dim : 0 I0423 04:03:11.788726 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.ctx_post_proj_dim : 0 I0423 04:03:11.788801 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.dtype : float32 I0423 04:03:11.788877 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.enable_ctx_post_proj : True I0423 04:03:11.788954 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.enable_ctx_pre_proj : False I0423 04:03:11.789031 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.enable_query_proj : True I0423 04:03:11.789108 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.enable_source_proj : True I0423 04:03:11.789186 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.fprop_dtype : NoneType I0423 04:03:11.789263 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.hidden_dim : 0 I0423 04:03:11.789340 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inference_driver_name : NoneType I0423 04:03:11.789417 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.allow_implicit_capture : NoneType I0423 04:03:11.789494 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.atten_dropout_deterministic : False I0423 04:03:11.789570 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.atten_dropout_prob : 0.0 I0423 04:03:11.789647 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.cls : type/lingvo.core.attention/DotProductAttention I0423 04:03:11.789729 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.dtype : float32 I0423 04:03:11.789804 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.fprop_dtype : NoneType I0423 04:03:11.789881 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.hidden_dim : 0 I0423 04:03:11.789958 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.inference_driver_name : NoneType I0423 04:03:11.790035 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.is_eval : NoneType I0423 04:03:11.790111 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.is_inference : NoneType I0423 04:03:11.790189 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.name : '' I0423 04:03:11.790266 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.packed_input : False I0423 04:03:11.790343 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.method : 'xavier' I0423 04:03:11.790419 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.scale : 1.000001 I0423 04:03:11.790505 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.seed : NoneType I0423 04:03:11.790582 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.default : NoneType I0423 04:03:11.790659 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.fullyconnected : NoneType I0423 04:03:11.790736 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.softmax : NoneType I0423 04:03:11.790813 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.query_dim : 0 I0423 04:03:11.790900 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.random_seed : NoneType I0423 04:03:11.790982 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.skip_lp_regularization : NoneType I0423 04:03:11.791059 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.source_dim : 0 I0423 04:03:11.791136 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.global_vn : False I0423 04:03:11.791213 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.per_step_vn : False I0423 04:03:11.791290 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.scale : NoneType I0423 04:03:11.791367 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.seed : NoneType I0423 04:03:11.791445 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.is_eval : NoneType I0423 04:03:11.791521 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.is_inference : NoneType I0423 04:03:11.791598 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.name : '' I0423 04:03:11.791676 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.num_attention_heads : 2 I0423 04:03:11.791753 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.packed_input : False I0423 04:03:11.791831 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.params_init.method : 'xavier' I0423 04:03:11.791908 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.params_init.scale : 1.0 I0423 04:03:11.791985 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.params_init.seed : NoneType I0423 04:03:11.792062 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.qdomain.atten_context : NoneType I0423 04:03:11.792139 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.qdomain.default : NoneType I0423 04:03:11.792216 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.qdomain.fullyconnected : NoneType I0423 04:03:11.792294 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.qdomain.softmax : NoneType I0423 04:03:11.792371 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.query_dim : 0 I0423 04:03:11.792449 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.random_seed : NoneType I0423 04:03:11.792526 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.skip_lp_regularization : NoneType I0423 04:03:11.792604 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.source_dim : 0 I0423 04:03:11.792682 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.use_source_vec_as_attention_value : False I0423 04:03:11.792768 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.vn.global_vn : False I0423 04:03:11.792846 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.vn.per_step_vn : False I0423 04:03:11.792926 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.vn.scale : NoneType I0423 04:03:11.793004 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.vn.seed : NoneType I0423 04:03:11.793081 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.cls : type/lingvo.core.layers_with_attention/TransformerAttentionLayer I0423 04:03:11.793159 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.dtype : float32 I0423 04:03:11.793236 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.fprop_dtype : NoneType I0423 04:03:11.793313 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.inference_driver_name : NoneType I0423 04:03:11.793390 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.is_eval : NoneType I0423 04:03:11.793468 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.is_inference : NoneType I0423 04:03:11.793545 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.is_masked : False I0423 04:03:11.793622 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.allow_implicit_capture : NoneType I0423 04:03:11.793699 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.cls : type/lingvo.core.layers/LayerNorm I0423 04:03:11.793777 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.dtype : float32 I0423 04:03:11.793854 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.epsilon : 1e-06 I0423 04:03:11.793932 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.fprop_dtype : NoneType I0423 04:03:11.794011 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.inference_driver_name : NoneType I0423 04:03:11.794089 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.input_dim : 0 I0423 04:03:11.794166 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.is_eval : NoneType I0423 04:03:11.794243 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.is_inference : NoneType I0423 04:03:11.794321 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.name : '' I0423 04:03:11.794399 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.params_init.method : 'xavier' I0423 04:03:11.794476 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.params_init.scale : 1.000001 I0423 04:03:11.794553 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.params_init.seed : NoneType I0423 04:03:11.794631 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.random_seed : NoneType I0423 04:03:11.794709 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.skip_lp_regularization : NoneType I0423 04:03:11.794786 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.vn.global_vn : False I0423 04:03:11.794863 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.vn.per_step_vn : False I0423 04:03:11.794955 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.vn.scale : NoneType I0423 04:03:11.795032 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.vn.seed : NoneType I0423 04:03:11.795109 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.name : '' I0423 04:03:11.795186 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.num_attention_heads : 8 I0423 04:03:11.795263 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.packed_input : False I0423 04:03:11.795350 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.params_init.method : 'xavier' I0423 04:03:11.795428 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.params_init.scale : 1.000001 I0423 04:03:11.795507 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.params_init.seed : NoneType I0423 04:03:11.795584 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.random_seed : NoneType I0423 04:03:11.795660 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_prob : 0.0 I0423 04:03:11.795737 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:11.795814 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:11.795892 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.dropout_at_eval : False I0423 04:03:11.795969 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.dtype : float32 I0423 04:03:11.796047 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.fprop_dtype : NoneType I0423 04:03:11.796123 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.inference_driver_name : NoneType I0423 04:03:11.796200 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.is_eval : NoneType I0423 04:03:11.796277 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.is_inference : NoneType I0423 04:03:11.796355 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.keep_prob : 1.0 I0423 04:03:11.796432 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.name : '' I0423 04:03:11.796508 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.noise_shape : NoneType I0423 04:03:11.796583 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:11.796660 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.method : 'xavier' I0423 04:03:11.796736 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.scale : 1.000001 I0423 04:03:11.796813 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.seed : NoneType I0423 04:03:11.796890 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.random_seed : NoneType I0423 04:03:11.796967 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:11.797044 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.global_vn : False I0423 04:03:11.797121 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.per_step_vn : False I0423 04:03:11.797198 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.scale : NoneType I0423 04:03:11.797275 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.seed : NoneType I0423 04:03:11.797352 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.skip_lp_regularization : NoneType I0423 04:03:11.797430 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.source_dim : 0 I0423 04:03:11.797507 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.vn.global_vn : False I0423 04:03:11.797584 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.vn.per_step_vn : False I0423 04:03:11.797671 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.vn.scale : NoneType I0423 04:03:11.797749 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.vn.seed : NoneType I0423 04:03:11.797827 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_aux_atten_tpl : NoneType I0423 04:03:11.797904 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.activation : 'RELU' I0423 04:03:11.797981 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.allow_implicit_capture : NoneType I0423 04:03:11.798060 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.cls : type/lingvo.core.layers_with_attention/TransformerFeedForwardLayer I0423 04:03:11.798139 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.dtype : float32 I0423 04:03:11.798216 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.activation : ['RELU', 'NONE'] I0423 04:03:11.798291 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.allow_implicit_capture : NoneType I0423 04:03:11.798367 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.batch_norm : False I0423 04:03:11.798444 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.bn_fold_weights : NoneType I0423 04:03:11.798521 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.cls : type/lingvo.core.layers/FeedForwardNet I0423 04:03:11.798598 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.allow_implicit_capture : NoneType I0423 04:03:11.798675 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:11.798769 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.dropout_at_eval : False I0423 04:03:11.798845 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.dtype : float32 I0423 04:03:11.798932 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.fprop_dtype : NoneType I0423 04:03:11.799010 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.inference_driver_name : NoneType I0423 04:03:11.799086 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.is_eval : NoneType I0423 04:03:11.799161 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.is_inference : NoneType I0423 04:03:11.799237 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.keep_prob : 1.0 I0423 04:03:11.799314 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.name : '' I0423 04:03:11.799390 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.noise_shape : NoneType I0423 04:03:11.799464 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.noise_shape_broadcast_dims : NoneType I0423 04:03:11.799540 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.method : 'xavier' I0423 04:03:11.799616 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.scale : 1.000001 I0423 04:03:11.799691 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.seed : NoneType I0423 04:03:11.799767 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.random_seed : NoneType I0423 04:03:11.799843 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.skip_lp_regularization : NoneType I0423 04:03:11.799923 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.global_vn : False I0423 04:03:11.800000 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.per_step_vn : False I0423 04:03:11.800076 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.scale : NoneType I0423 04:03:11.800153 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.seed : NoneType I0423 04:03:11.800228 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dtype : float32 I0423 04:03:11.800302 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.fprop_dtype : NoneType I0423 04:03:11.800379 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.inference_driver_name : NoneType I0423 04:03:11.800455 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.input_dim : 0 I0423 04:03:11.800529 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.is_eval : NoneType I0423 04:03:11.800606 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.is_inference : NoneType I0423 04:03:11.800682 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.name : '' I0423 04:03:11.800757 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.method : 'xavier' I0423 04:03:11.800832 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.scale : 1.000001 I0423 04:03:11.800909 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.seed : NoneType I0423 04:03:11.800985 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.qdomain.default : NoneType I0423 04:03:11.801060 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.random_seed : NoneType I0423 04:03:11.801136 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.skip_connections : NoneType I0423 04:03:11.801212 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.skip_lp_regularization : NoneType I0423 04:03:11.801287 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.global_vn : False I0423 04:03:11.801363 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.per_step_vn : False I0423 04:03:11.801440 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.scale : NoneType I0423 04:03:11.801517 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.seed : NoneType I0423 04:03:11.801592 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fprop_dtype : NoneType I0423 04:03:11.801666 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.hidden_dim : 2048 I0423 04:03:11.801742 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.inference_driver_name : NoneType I0423 04:03:11.801817 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.input_dim : 0 I0423 04:03:11.801892 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.is_eval : NoneType I0423 04:03:11.801969 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.is_inference : NoneType I0423 04:03:11.802043 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.allow_implicit_capture : NoneType I0423 04:03:11.802119 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.cls : type/lingvo.core.layers/LayerNorm I0423 04:03:11.802196 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.dtype : float32 I0423 04:03:11.802272 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.epsilon : 1e-06 I0423 04:03:11.802351 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.fprop_dtype : NoneType I0423 04:03:11.802428 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.inference_driver_name : NoneType I0423 04:03:11.802504 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.input_dim : 0 I0423 04:03:11.802578 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.is_eval : NoneType I0423 04:03:11.802654 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.is_inference : NoneType I0423 04:03:11.802730 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.name : '' I0423 04:03:11.802803 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.method : 'xavier' I0423 04:03:11.802886 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.scale : 1.000001 I0423 04:03:11.802967 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.seed : NoneType I0423 04:03:11.803044 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.random_seed : NoneType I0423 04:03:11.803121 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.skip_lp_regularization : NoneType I0423 04:03:11.803196 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.vn.global_vn : False I0423 04:03:11.803273 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.vn.per_step_vn : False I0423 04:03:11.803349 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.vn.scale : NoneType I0423 04:03:11.803426 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.vn.seed : NoneType I0423 04:03:11.803502 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.name : '' I0423 04:03:11.803577 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.output_dim : 0 I0423 04:03:11.803653 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.params_init.method : 'xavier' I0423 04:03:11.803730 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.params_init.scale : 1.000001 I0423 04:03:11.803806 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.params_init.seed : NoneType I0423 04:03:11.803881 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.random_seed : NoneType I0423 04:03:11.803956 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.relu_dropout_prob : 0.0 I0423 04:03:11.804033 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.activation : 'RELU' I0423 04:03:11.804109 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.affine_last : False I0423 04:03:11.804184 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.allow_implicit_capture : NoneType I0423 04:03:11.804260 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.batch_norm : True I0423 04:03:11.804337 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.bias_init : 0.0 I0423 04:03:11.804413 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.bn_fold_weights : NoneType I0423 04:03:11.804488 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.cls : type/lingvo.core.layers/ProjectionLayer I0423 04:03:11.804563 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.dtype : float32 I0423 04:03:11.804639 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.fprop_dtype : NoneType I0423 04:03:11.804714 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.has_bias : False I0423 04:03:11.804802 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.inference_driver_name : NoneType I0423 04:03:11.804881 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.input_dim : 0 I0423 04:03:11.804956 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.is_eval : NoneType I0423 04:03:11.805032 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.is_inference : NoneType I0423 04:03:11.805109 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.name : '' I0423 04:03:11.805183 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.output_dim : 0 I0423 04:03:11.805259 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.method : 'xavier' I0423 04:03:11.805335 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.scale : 1.000001 I0423 04:03:11.805412 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.seed : NoneType I0423 04:03:11.805486 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.qdomain.default : NoneType I0423 04:03:11.805562 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.random_seed : NoneType I0423 04:03:11.805639 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.skip_lp_regularization : NoneType I0423 04:03:11.805715 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.global_vn : False I0423 04:03:11.805790 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.per_step_vn : False I0423 04:03:11.805866 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.scale : NoneType I0423 04:03:11.805943 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.seed : NoneType I0423 04:03:11.806019 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.weight_norm : False I0423 04:03:11.806094 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_prob : 0.0 I0423 04:03:11.806170 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:11.806246 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:11.806323 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.dropout_at_eval : False I0423 04:03:11.806399 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.dtype : float32 I0423 04:03:11.806476 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.fprop_dtype : NoneType I0423 04:03:11.806551 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.inference_driver_name : NoneType I0423 04:03:11.806627 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.is_eval : NoneType I0423 04:03:11.806703 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.is_inference : NoneType I0423 04:03:11.806780 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.keep_prob : 1.0 I0423 04:03:11.806854 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.name : '' I0423 04:03:11.806941 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.noise_shape : NoneType I0423 04:03:11.807023 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:11.807099 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.method : 'xavier' I0423 04:03:11.807173 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.scale : 1.000001 I0423 04:03:11.807249 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.seed : NoneType I0423 04:03:11.807323 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.random_seed : NoneType I0423 04:03:11.807399 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:11.807473 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.global_vn : False I0423 04:03:11.807548 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.per_step_vn : False I0423 04:03:11.807622 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.scale : NoneType I0423 04:03:11.807698 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.seed : NoneType I0423 04:03:11.807774 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.skip_lp_regularization : NoneType I0423 04:03:11.807848 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.vn.global_vn : False I0423 04:03:11.807924 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.vn.per_step_vn : False I0423 04:03:11.808000 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.vn.scale : NoneType I0423 04:03:11.808075 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.vn.seed : NoneType I0423 04:03:11.808151 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.transparent_merger_tpl : NoneType I0423 04:03:11.808228 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.vn.global_vn : False I0423 04:03:11.808304 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.vn.per_step_vn : False I0423 04:03:11.808379 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.vn.scale : NoneType I0423 04:03:11.808455 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.vn.seed : NoneType I0423 04:03:11.808547 140323924080384 base_runner.py:69] task.lm.stack.dtype : float32 I0423 04:03:11.808621 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.add_tgt_embedding_layer : False I0423 04:03:11.808696 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.allow_implicit_capture : NoneType I0423 04:03:11.808770 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.cls : type/lingvo.core.layers_with_gpipe/GPipeTransformerEmbeddingLayer I0423 04:03:11.808845 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:11.808921 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:11.808995 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.dropout_at_eval : False I0423 04:03:11.809071 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.dtype : float32 I0423 04:03:11.809145 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.fprop_dtype : NoneType I0423 04:03:11.809220 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.inference_driver_name : NoneType I0423 04:03:11.809294 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.is_eval : NoneType I0423 04:03:11.809369 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.is_inference : NoneType I0423 04:03:11.809442 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.keep_prob : 1.0 I0423 04:03:11.809524 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.name : '' I0423 04:03:11.809600 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.noise_shape : NoneType I0423 04:03:11.809674 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:11.809748 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.params_init.method : 'xavier' I0423 04:03:11.809823 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.params_init.scale : 1.000001 I0423 04:03:11.809899 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.params_init.seed : NoneType I0423 04:03:11.809973 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.random_seed : NoneType I0423 04:03:11.810048 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:11.810122 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.vn.global_vn : False I0423 04:03:11.810198 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.vn.per_step_vn : False I0423 04:03:11.810271 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.vn.scale : NoneType I0423 04:03:11.810345 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.vn.seed : NoneType I0423 04:03:11.810420 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dtype : float32 I0423 04:03:11.810493 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.fprop_dtype : NoneType I0423 04:03:11.810568 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.inference_driver_name : NoneType I0423 04:03:11.810642 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.input_dropout_prob : 0.0 I0423 04:03:11.810717 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.is_eval : NoneType I0423 04:03:11.810791 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.is_inference : NoneType I0423 04:03:11.810866 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.is_transparent : False I0423 04:03:11.810950 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.max_seq_len : 300 I0423 04:03:11.811026 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.name : '' I0423 04:03:11.811100 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.packed_input : False I0423 04:03:11.811173 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.params_init.method : 'xavier' I0423 04:03:11.811248 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.params_init.scale : 1.000001 I0423 04:03:11.811322 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.params_init.seed : NoneType I0423 04:03:11.811397 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.allow_implicit_capture : NoneType I0423 04:03:11.811471 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.cls : type/lingvo.core.layers/PositionalEmbeddingLayer I0423 04:03:11.811546 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.dtype : float32 I0423 04:03:11.811619 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.embedding_dim : 0 I0423 04:03:11.811693 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.fprop_dtype : NoneType I0423 04:03:11.811768 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.inference_driver_name : NoneType I0423 04:03:11.811841 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.is_eval : NoneType I0423 04:03:11.811916 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.is_inference : NoneType I0423 04:03:11.811990 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.max_timescale : 10000 I0423 04:03:11.812063 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.min_timescale : 1 I0423 04:03:11.812139 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.name : '' I0423 04:03:11.812212 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.params_init.method : 'xavier' I0423 04:03:11.812294 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.params_init.scale : 1.000001 I0423 04:03:11.812370 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.params_init.seed : NoneType I0423 04:03:11.812443 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.random_seed : NoneType I0423 04:03:11.812519 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.skip_lp_regularization : NoneType I0423 04:03:11.812593 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.trainable_scaling : False I0423 04:03:11.812668 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.trainable_scaling_init : 1.0 I0423 04:03:11.812742 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.vn.global_vn : False I0423 04:03:11.812817 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.vn.per_step_vn : False I0423 04:03:11.812891 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.vn.scale : NoneType I0423 04:03:11.812966 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.vn.seed : NoneType I0423 04:03:11.813040 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.random_seed : NoneType I0423 04:03:11.813114 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.skip_lp_regularization : NoneType I0423 04:03:11.813189 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.allow_implicit_capture : NoneType I0423 04:03:11.813263 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.apply_pruning : False I0423 04:03:11.813338 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.cls : type/lingvo.core.layers/SimpleEmbeddingLayer I0423 04:03:11.813414 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.dtype : float32 I0423 04:03:11.813488 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.embedding_dim : 0 I0423 04:03:11.813563 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.fprop_dtype : NoneType I0423 04:03:11.813637 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.fprop_mode : NoneType I0423 04:03:11.813711 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.inference_driver_name : NoneType I0423 04:03:11.813786 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.is_eval : NoneType I0423 04:03:11.813860 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.is_inference : NoneType I0423 04:03:11.813935 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.name : '' I0423 04:03:11.814008 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.params_init.method : 'xavier' I0423 04:03:11.814083 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.params_init.scale : 1.000001 I0423 04:03:11.814157 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.params_init.seed : NoneType I0423 04:03:11.814230 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.qdomain.default : NoneType I0423 04:03:11.814305 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.random_seed : NoneType I0423 04:03:11.814379 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.skip_lp_regularization : NoneType I0423 04:03:11.814454 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.use_3d_weight_tensor : False I0423 04:03:11.814527 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.use_matmul : False I0423 04:03:11.814601 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vn.global_vn : False I0423 04:03:11.814677 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vn.per_step_vn : False I0423 04:03:11.814750 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vn.scale : NoneType I0423 04:03:11.814826 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vn.seed : NoneType I0423 04:03:11.814913 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vocab_size : 0 I0423 04:03:11.814995 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.vn.global_vn : False I0423 04:03:11.815071 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.vn.per_step_vn : False I0423 04:03:11.815145 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.vn.scale : NoneType I0423 04:03:11.815220 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.vn.seed : NoneType I0423 04:03:11.815294 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.allow_implicit_capture : NoneType I0423 04:03:11.815368 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.cls : type/lingvo.core.layers_with_gpipe/GPipeTransformerLayer I0423 04:03:11.815443 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.dtype : float32 I0423 04:03:11.815517 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.fprop_dtype : NoneType I0423 04:03:11.815592 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.has_aux_atten : False I0423 04:03:11.815666 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.inference_driver_name : NoneType I0423 04:03:11.815742 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.is_decoder : False I0423 04:03:11.815815 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.is_eval : NoneType I0423 04:03:11.815891 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.is_inference : NoneType I0423 04:03:11.815965 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.is_transparent : False I0423 04:03:11.816040 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.mask_self_atten : True I0423 04:03:11.816113 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.name : '' I0423 04:03:11.816188 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.num_transparent_outputs : 0 I0423 04:03:11.816262 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.output_dim : 0 I0423 04:03:11.816335 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.packed_input : False I0423 04:03:11.816410 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.params_init.method : 'xavier' I0423 04:03:11.816484 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.params_init.scale : 1.000001 I0423 04:03:11.816559 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.params_init.seed : NoneType I0423 04:03:11.816632 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.random_seed : NoneType I0423 04:03:11.816706 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.skip_lp_regularization : NoneType I0423 04:03:11.816781 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.source_dim : 0 I0423 04:03:11.816875 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.add_unnormalized_input : False I0423 04:03:11.816953 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.allow_implicit_capture : NoneType I0423 04:03:11.817028 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_dropout_prob : 0.0 I0423 04:03:11.817104 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_hidden_dim : 0 I0423 04:03:11.817178 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.allow_implicit_capture : NoneType I0423 04:03:11.817253 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.atten_dropout_deterministic : False I0423 04:03:11.817327 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.atten_dropout_prob : 0.0 I0423 04:03:11.817401 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.cls : type/lingvo.core.attention/MultiHeadedAttention I0423 04:03:11.817476 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.context_dim : 0 I0423 04:03:11.817550 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.ctx_post_proj_dim : 0 I0423 04:03:11.817625 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.dtype : float32 I0423 04:03:11.817706 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.enable_ctx_post_proj : True I0423 04:03:11.817781 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.enable_ctx_pre_proj : True I0423 04:03:11.817857 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.enable_query_proj : True I0423 04:03:11.817930 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.enable_source_proj : True I0423 04:03:11.818006 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.fprop_dtype : NoneType I0423 04:03:11.818079 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.hidden_dim : 0 I0423 04:03:11.818155 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inference_driver_name : NoneType I0423 04:03:11.818228 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.allow_implicit_capture : NoneType I0423 04:03:11.818303 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.atten_dropout_deterministic : False I0423 04:03:11.818377 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.atten_dropout_prob : 0.0 I0423 04:03:11.818453 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.cls : type/lingvo.core.attention/DotProductAttention I0423 04:03:11.818528 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.dtype : float32 I0423 04:03:11.818620 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.fprop_dtype : NoneType I0423 04:03:11.818694 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.hidden_dim : 0 I0423 04:03:11.818768 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.inference_driver_name : NoneType I0423 04:03:11.818840 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.is_eval : NoneType I0423 04:03:11.818923 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.is_inference : NoneType I0423 04:03:11.818999 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.name : '' I0423 04:03:11.819072 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.packed_input : False I0423 04:03:11.819144 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.method : 'xavier' I0423 04:03:11.819219 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.scale : 1.000001 I0423 04:03:11.819293 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.seed : NoneType I0423 04:03:11.819366 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.default : NoneType I0423 04:03:11.819438 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.fullyconnected : NoneType I0423 04:03:11.819511 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.softmax : NoneType I0423 04:03:11.819586 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.query_dim : 0 I0423 04:03:11.819658 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.random_seed : NoneType I0423 04:03:11.819732 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.skip_lp_regularization : NoneType I0423 04:03:11.819813 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.source_dim : 0 I0423 04:03:11.819886 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.global_vn : False I0423 04:03:11.819961 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.per_step_vn : False I0423 04:03:11.820034 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.scale : NoneType I0423 04:03:11.820107 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.seed : NoneType I0423 04:03:11.820182 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.is_eval : NoneType I0423 04:03:11.820255 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.is_inference : NoneType I0423 04:03:11.820328 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.name : '' I0423 04:03:11.820403 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.num_attention_heads : 2 I0423 04:03:11.820477 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.packed_input : False I0423 04:03:11.820549 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.params_init.method : 'xavier' I0423 04:03:11.820624 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.params_init.scale : 1.0 I0423 04:03:11.820697 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.params_init.seed : NoneType I0423 04:03:11.820770 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.qdomain.atten_context : NoneType I0423 04:03:11.820844 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.qdomain.default : NoneType I0423 04:03:11.820919 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.qdomain.fullyconnected : NoneType I0423 04:03:11.820991 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.qdomain.softmax : NoneType I0423 04:03:11.821064 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.query_dim : 0 I0423 04:03:11.821139 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.random_seed : NoneType I0423 04:03:11.821212 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.skip_lp_regularization : NoneType I0423 04:03:11.821285 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.source_dim : 0 I0423 04:03:11.821360 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.use_source_vec_as_attention_value : False I0423 04:03:11.821434 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.vn.global_vn : False I0423 04:03:11.821507 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.vn.per_step_vn : False I0423 04:03:11.821580 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.vn.scale : NoneType I0423 04:03:11.821655 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.vn.seed : NoneType I0423 04:03:11.821729 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.cls : type/lingvo.core.layers_with_attention/TransformerAttentionLayer I0423 04:03:11.821804 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.dtype : float32 I0423 04:03:11.821877 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.fprop_dtype : NoneType I0423 04:03:11.821950 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.inference_driver_name : NoneType I0423 04:03:11.822025 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.is_eval : NoneType I0423 04:03:11.822105 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.is_inference : NoneType I0423 04:03:11.822180 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.is_masked : True I0423 04:03:11.822254 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.allow_implicit_capture : NoneType I0423 04:03:11.822329 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.cls : type/lingvo.core.layers/LayerNorm I0423 04:03:11.822402 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.dtype : float32 I0423 04:03:11.822474 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.epsilon : 1e-06 I0423 04:03:11.822547 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.fprop_dtype : NoneType I0423 04:03:11.822621 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.inference_driver_name : NoneType I0423 04:03:11.822694 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.input_dim : 0 I0423 04:03:11.822767 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.is_eval : NoneType I0423 04:03:11.822839 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.is_inference : NoneType I0423 04:03:11.822923 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.name : '' I0423 04:03:11.822999 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.params_init.method : 'xavier' I0423 04:03:11.823072 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.params_init.scale : 1.000001 I0423 04:03:11.823147 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.params_init.seed : NoneType I0423 04:03:11.823220 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.random_seed : NoneType I0423 04:03:11.823293 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.skip_lp_regularization : NoneType I0423 04:03:11.823367 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.vn.global_vn : False I0423 04:03:11.823440 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.vn.per_step_vn : False I0423 04:03:11.823513 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.vn.scale : NoneType I0423 04:03:11.823587 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.vn.seed : NoneType I0423 04:03:11.823661 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.name : '' I0423 04:03:11.823734 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.num_attention_heads : 16 I0423 04:03:11.823807 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.packed_input : False I0423 04:03:11.823880 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.params_init.method : 'xavier' I0423 04:03:11.823955 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.params_init.scale : 1.000001 I0423 04:03:11.824028 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.params_init.seed : NoneType I0423 04:03:11.824103 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.random_seed : NoneType I0423 04:03:11.824176 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_prob : 0.0 I0423 04:03:11.824249 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:11.824322 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:11.824395 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.dropout_at_eval : False I0423 04:03:11.824476 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.dtype : float32 I0423 04:03:11.824549 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.fprop_dtype : NoneType I0423 04:03:11.824623 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.inference_driver_name : NoneType I0423 04:03:11.824697 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.is_eval : NoneType I0423 04:03:11.824769 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.is_inference : NoneType I0423 04:03:11.824841 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.keep_prob : 1.0 I0423 04:03:11.824914 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.name : '' I0423 04:03:11.824987 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.noise_shape : NoneType I0423 04:03:11.825061 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:11.825134 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.method : 'xavier' I0423 04:03:11.825208 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.scale : 1.000001 I0423 04:03:11.825282 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.seed : NoneType I0423 04:03:11.825355 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.random_seed : NoneType I0423 04:03:11.825428 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:11.825500 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.global_vn : False I0423 04:03:11.825576 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.per_step_vn : False I0423 04:03:11.825649 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.scale : NoneType I0423 04:03:11.825722 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.seed : NoneType I0423 04:03:11.825797 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.skip_lp_regularization : NoneType I0423 04:03:11.825870 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.source_dim : 0 I0423 04:03:11.825943 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.vn.global_vn : False I0423 04:03:11.826016 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.vn.per_step_vn : False I0423 04:03:11.826091 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.vn.scale : NoneType I0423 04:03:11.826174 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.vn.seed : NoneType I0423 04:03:11.826250 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_aux_atten_tpl : NoneType I0423 04:03:11.826323 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.activation : 'RELU' I0423 04:03:11.826396 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.allow_implicit_capture : NoneType I0423 04:03:11.826468 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.cls : type/lingvo.core.layers_with_attention/TransformerFeedForwardLayer I0423 04:03:11.826545 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.dtype : float32 I0423 04:03:11.826618 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.activation : ['RELU', 'NONE'] I0423 04:03:11.826692 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.allow_implicit_capture : NoneType I0423 04:03:11.826771 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.batch_norm : False I0423 04:03:11.826847 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.bn_fold_weights : NoneType I0423 04:03:11.826931 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.cls : type/lingvo.core.layers/FeedForwardNet I0423 04:03:11.827007 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.allow_implicit_capture : NoneType I0423 04:03:11.827080 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:11.827156 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.dropout_at_eval : False I0423 04:03:11.827229 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.dtype : float32 I0423 04:03:11.827303 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.fprop_dtype : NoneType I0423 04:03:11.827377 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.inference_driver_name : NoneType I0423 04:03:11.827450 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.is_eval : NoneType I0423 04:03:11.827524 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.is_inference : NoneType I0423 04:03:11.827599 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.keep_prob : 1.0 I0423 04:03:11.827672 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.name : '' I0423 04:03:11.827744 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.noise_shape : NoneType I0423 04:03:11.827817 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.noise_shape_broadcast_dims : NoneType I0423 04:03:11.827892 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.method : 'xavier' I0423 04:03:11.827964 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.scale : 1.000001 I0423 04:03:11.828037 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.seed : NoneType I0423 04:03:11.828111 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.random_seed : NoneType I0423 04:03:11.828186 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.skip_lp_regularization : NoneType I0423 04:03:11.828258 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.global_vn : False I0423 04:03:11.828332 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.per_step_vn : False I0423 04:03:11.828406 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.scale : NoneType I0423 04:03:11.828479 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.seed : NoneType I0423 04:03:11.828552 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dtype : float32 I0423 04:03:11.828627 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.fprop_dtype : NoneType I0423 04:03:11.828700 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.inference_driver_name : NoneType I0423 04:03:11.828773 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.input_dim : 0 I0423 04:03:11.828846 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.is_eval : NoneType I0423 04:03:11.828946 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.is_inference : NoneType I0423 04:03:11.829020 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.name : '' I0423 04:03:11.829092 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.method : 'xavier' I0423 04:03:11.829164 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.scale : 1.000001 I0423 04:03:11.829236 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.seed : NoneType I0423 04:03:11.829308 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.qdomain.default : NoneType I0423 04:03:11.829381 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.random_seed : NoneType I0423 04:03:11.829453 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.skip_connections : NoneType I0423 04:03:11.829525 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.skip_lp_regularization : NoneType I0423 04:03:11.829598 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.global_vn : False I0423 04:03:11.829672 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.per_step_vn : False I0423 04:03:11.829745 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.scale : NoneType I0423 04:03:11.829818 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.seed : NoneType I0423 04:03:11.829890 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fprop_dtype : NoneType I0423 04:03:11.829965 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.hidden_dim : 8192 I0423 04:03:11.830037 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.inference_driver_name : NoneType I0423 04:03:11.830110 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.input_dim : 0 I0423 04:03:11.830182 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.is_eval : NoneType I0423 04:03:11.830254 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.is_inference : NoneType I0423 04:03:11.830327 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.allow_implicit_capture : NoneType I0423 04:03:11.830399 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.cls : type/lingvo.core.layers/LayerNorm I0423 04:03:11.830471 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.dtype : float32 I0423 04:03:11.830544 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.epsilon : 1e-06 I0423 04:03:11.830619 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.fprop_dtype : NoneType I0423 04:03:11.830692 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.inference_driver_name : NoneType I0423 04:03:11.830765 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.input_dim : 0 I0423 04:03:11.830837 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.is_eval : NoneType I0423 04:03:11.830919 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.is_inference : NoneType I0423 04:03:11.830993 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.name : '' I0423 04:03:11.831067 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.method : 'xavier' I0423 04:03:11.831140 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.scale : 1.000001 I0423 04:03:11.831221 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.seed : NoneType I0423 04:03:11.831295 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.random_seed : NoneType I0423 04:03:11.831368 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.skip_lp_regularization : NoneType I0423 04:03:11.831440 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.vn.global_vn : False I0423 04:03:11.831515 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.vn.per_step_vn : False I0423 04:03:11.831588 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.vn.scale : NoneType I0423 04:03:11.831661 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.vn.seed : NoneType I0423 04:03:11.831734 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.name : '' I0423 04:03:11.831808 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.output_dim : 0 I0423 04:03:11.831881 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.params_init.method : 'xavier' I0423 04:03:11.831954 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.params_init.scale : 1.000001 I0423 04:03:11.832027 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.params_init.seed : NoneType I0423 04:03:11.832102 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.random_seed : NoneType I0423 04:03:11.832175 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.relu_dropout_prob : 0.0 I0423 04:03:11.832248 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.activation : 'RELU' I0423 04:03:11.832323 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.affine_last : False I0423 04:03:11.832396 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.allow_implicit_capture : NoneType I0423 04:03:11.832468 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.batch_norm : True I0423 04:03:11.832541 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.bias_init : 0.0 I0423 04:03:11.832614 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.bn_fold_weights : NoneType I0423 04:03:11.832688 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.cls : type/lingvo.core.layers/ProjectionLayer I0423 04:03:11.832762 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.dtype : float32 I0423 04:03:11.832834 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.fprop_dtype : NoneType I0423 04:03:11.832907 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.has_bias : False I0423 04:03:11.832981 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.inference_driver_name : NoneType I0423 04:03:11.833053 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.input_dim : 0 I0423 04:03:11.833127 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.is_eval : NoneType I0423 04:03:11.833199 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.is_inference : NoneType I0423 04:03:11.833272 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.name : '' I0423 04:03:11.833347 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.output_dim : 0 I0423 04:03:11.833420 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.method : 'xavier' I0423 04:03:11.833492 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.scale : 1.000001 I0423 04:03:11.833575 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.seed : NoneType I0423 04:03:11.833650 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.qdomain.default : NoneType I0423 04:03:11.833722 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.random_seed : NoneType I0423 04:03:11.833795 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.skip_lp_regularization : NoneType I0423 04:03:11.833867 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.global_vn : False I0423 04:03:11.833940 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.per_step_vn : False I0423 04:03:11.834011 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.scale : NoneType I0423 04:03:11.834084 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.seed : NoneType I0423 04:03:11.834157 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.weight_norm : False I0423 04:03:11.834230 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_prob : 0.0 I0423 04:03:11.834302 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:11.834376 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:11.834448 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.dropout_at_eval : False I0423 04:03:11.834521 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.dtype : float32 I0423 04:03:11.834593 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.fprop_dtype : NoneType I0423 04:03:11.834665 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.inference_driver_name : NoneType I0423 04:03:11.834737 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.is_eval : NoneType I0423 04:03:11.834809 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.is_inference : NoneType I0423 04:03:11.834891 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.keep_prob : 1.0 I0423 04:03:11.834966 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.name : '' I0423 04:03:11.835041 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.noise_shape : NoneType I0423 04:03:11.835114 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:11.835186 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.method : 'xavier' I0423 04:03:11.835258 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.scale : 1.000001 I0423 04:03:11.835331 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.seed : NoneType I0423 04:03:11.835405 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.random_seed : NoneType I0423 04:03:11.835478 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:11.835551 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.global_vn : False I0423 04:03:11.835623 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.per_step_vn : False I0423 04:03:11.835705 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.scale : NoneType I0423 04:03:11.835778 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.seed : NoneType I0423 04:03:11.835851 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.skip_lp_regularization : NoneType I0423 04:03:11.835926 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.vn.global_vn : False I0423 04:03:11.835999 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.vn.per_step_vn : False I0423 04:03:11.836071 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.vn.scale : NoneType I0423 04:03:11.836144 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.vn.seed : NoneType I0423 04:03:11.836218 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.transparent_merger_tpl : NoneType I0423 04:03:11.836291 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.vn.global_vn : False I0423 04:03:11.836364 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.vn.per_step_vn : False I0423 04:03:11.836436 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.vn.scale : NoneType I0423 04:03:11.836508 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.vn.seed : NoneType I0423 04:03:11.836580 140323924080384 base_runner.py:69] task.lm.stack.fprop_dtype : NoneType I0423 04:03:11.836653 140323924080384 base_runner.py:69] task.lm.stack.inference_driver_name : NoneType I0423 04:03:11.836726 140323924080384 base_runner.py:69] task.lm.stack.is_eval : NoneType I0423 04:03:11.836800 140323924080384 base_runner.py:69] task.lm.stack.is_inference : NoneType I0423 04:03:11.836872 140323924080384 base_runner.py:69] task.lm.stack.is_transparent : False I0423 04:03:11.836945 140323924080384 base_runner.py:69] task.lm.stack.model_dim : 1024 I0423 04:03:11.837017 140323924080384 base_runner.py:69] task.lm.stack.name : '' I0423 04:03:11.837089 140323924080384 base_runner.py:69] task.lm.stack.num_decoder_layers : 0 I0423 04:03:11.837162 140323924080384 base_runner.py:69] task.lm.stack.num_encoder_layers : 6 I0423 04:03:11.837234 140323924080384 base_runner.py:69] task.lm.stack.num_micro_batches : 1 I0423 04:03:11.837306 140323924080384 base_runner.py:69] task.lm.stack.num_splits : 1 I0423 04:03:11.837378 140323924080384 base_runner.py:69] task.lm.stack.num_transparent_outputs : 0 I0423 04:03:11.837450 140323924080384 base_runner.py:69] task.lm.stack.packed_input : False I0423 04:03:11.837522 140323924080384 base_runner.py:69] task.lm.stack.params_init.method : 'xavier' I0423 04:03:11.837594 140323924080384 base_runner.py:69] task.lm.stack.params_init.scale : 1.000001 I0423 04:03:11.837667 140323924080384 base_runner.py:69] task.lm.stack.params_init.seed : NoneType I0423 04:03:11.837739 140323924080384 base_runner.py:69] task.lm.stack.random_seed : NoneType I0423 04:03:11.837811 140323924080384 base_runner.py:69] task.lm.stack.skip_lp_regularization : NoneType I0423 04:03:11.837884 140323924080384 base_runner.py:69] task.lm.stack.splits : 1 I0423 04:03:11.837958 140323924080384 base_runner.py:69] task.lm.stack.state_dtype : NoneType I0423 04:03:11.838030 140323924080384 base_runner.py:69] task.lm.stack.transparent_merger_dropout_prob : 0.1 I0423 04:03:11.838104 140323924080384 base_runner.py:69] task.lm.stack.use_pipelined_embeddings : False I0423 04:03:11.838176 140323924080384 base_runner.py:69] task.lm.stack.vn.global_vn : False I0423 04:03:11.838248 140323924080384 base_runner.py:69] task.lm.stack.vn.per_step_vn : False I0423 04:03:11.838320 140323924080384 base_runner.py:69] task.lm.stack.vn.scale : NoneType I0423 04:03:11.838392 140323924080384 base_runner.py:69] task.lm.stack.vn.seed : NoneType I0423 04:03:11.838465 140323924080384 base_runner.py:69] task.lm.vn.global_vn : False I0423 04:03:11.838538 140323924080384 base_runner.py:69] task.lm.vn.per_step_vn : False I0423 04:03:11.838615 140323924080384 base_runner.py:69] task.lm.vn.scale : NoneType I0423 04:03:11.838690 140323924080384 base_runner.py:69] task.lm.vn.seed : NoneType I0423 04:03:11.838762 140323924080384 base_runner.py:69] task.lm.vocab_size : 32000 I0423 04:03:11.838835 140323924080384 base_runner.py:69] task.name : '1bwds_wpm_level_lm' I0423 04:03:11.838921 140323924080384 base_runner.py:69] task.online_encoder : NoneType I0423 04:03:11.838995 140323924080384 base_runner.py:69] task.params_init.method : 'xavier' I0423 04:03:11.839068 140323924080384 base_runner.py:69] task.params_init.scale : 1.000001 I0423 04:03:11.839142 140323924080384 base_runner.py:69] task.params_init.seed : NoneType I0423 04:03:11.839215 140323924080384 base_runner.py:69] task.random_seed : NoneType I0423 04:03:11.839287 140323924080384 base_runner.py:69] task.skip_lp_regularization : NoneType I0423 04:03:11.839359 140323924080384 base_runner.py:69] task.train.bprop_variable_filter : NoneType I0423 04:03:11.839432 140323924080384 base_runner.py:69] task.train.clip_gradient_norm_to_value : 0.0 I0423 04:03:11.839504 140323924080384 base_runner.py:69] task.train.clip_gradient_single_norm_to_value : 0.0 I0423 04:03:11.839577 140323924080384 base_runner.py:69] task.train.colocate_gradients_with_ops : True I0423 04:03:11.839667 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.jobname : 'eval_dev' I0423 04:03:11.839739 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.local_filesystem : False I0423 04:03:11.839811 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.logdir : '' I0423 04:03:11.839881 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.metric : 'log_pplx' I0423 04:03:11.839953 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.minimize : True I0423 04:03:11.840025 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.name : 'MetricHistory' I0423 04:03:11.840096 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.tfevent_file : False I0423 04:03:11.840168 140323924080384 base_runner.py:69] task.train.early_stop.name : 'EarlyStop' I0423 04:03:11.840240 140323924080384 base_runner.py:69] task.train.early_stop.tolerance : 0.0 I0423 04:03:11.840312 140323924080384 base_runner.py:69] task.train.early_stop.verbose : True I0423 04:03:11.840384 140323924080384 base_runner.py:69] task.train.early_stop.window : 0 I0423 04:03:11.840455 140323924080384 base_runner.py:69] task.train.ema_decay : 0.0 I0423 04:03:11.840527 140323924080384 base_runner.py:69] task.train.gate_gradients : False I0423 04:03:11.840598 140323924080384 base_runner.py:69] task.train.grad_aggregation_method : 1 I0423 04:03:11.840668 140323924080384 base_runner.py:69] task.train.grad_norm_to_clip_to_zero : 0.0 I0423 04:03:11.840740 140323924080384 base_runner.py:69] task.train.grad_norm_tracker : NoneType I0423 04:03:11.840811 140323924080384 base_runner.py:69] task.train.init_from_checkpoint_rules : {} I0423 04:03:11.840883 140323924080384 base_runner.py:69] task.train.l1_regularizer_weight : NoneType I0423 04:03:11.840954 140323924080384 base_runner.py:69] task.train.l2_regularizer_weight : 1e-06 I0423 04:03:11.841025 140323924080384 base_runner.py:69] task.train.learning_rate : 0.5 I0423 04:03:11.841095 140323924080384 base_runner.py:69] task.train.lr_schedule.allow_implicit_capture : NoneType I0423 04:03:11.841166 140323924080384 base_runner.py:69] task.train.lr_schedule.cls : type/lingvo.core.lr_schedule/TransformerLearningRateSchedule I0423 04:03:11.841238 140323924080384 base_runner.py:69] task.train.lr_schedule.decay_end : NoneType I0423 04:03:11.841309 140323924080384 base_runner.py:69] task.train.lr_schedule.dtype : float32 I0423 04:03:11.841381 140323924080384 base_runner.py:69] task.train.lr_schedule.fprop_dtype : NoneType I0423 04:03:11.841453 140323924080384 base_runner.py:69] task.train.lr_schedule.inference_driver_name : NoneType I0423 04:03:11.841526 140323924080384 base_runner.py:69] task.train.lr_schedule.is_eval : NoneType I0423 04:03:11.841604 140323924080384 base_runner.py:69] task.train.lr_schedule.is_inference : NoneType I0423 04:03:11.841677 140323924080384 base_runner.py:69] task.train.lr_schedule.model_dim : 2048 I0423 04:03:11.841749 140323924080384 base_runner.py:69] task.train.lr_schedule.name : 'LRSched' I0423 04:03:11.841821 140323924080384 base_runner.py:69] task.train.lr_schedule.params_init.method : 'xavier' I0423 04:03:11.841895 140323924080384 base_runner.py:69] task.train.lr_schedule.params_init.scale : 1.000001 I0423 04:03:11.841967 140323924080384 base_runner.py:69] task.train.lr_schedule.params_init.seed : NoneType I0423 04:03:11.842039 140323924080384 base_runner.py:69] task.train.lr_schedule.random_seed : NoneType I0423 04:03:11.842111 140323924080384 base_runner.py:69] task.train.lr_schedule.skip_lp_regularization : NoneType I0423 04:03:11.842183 140323924080384 base_runner.py:69] task.train.lr_schedule.vn.global_vn : False I0423 04:03:11.842255 140323924080384 base_runner.py:69] task.train.lr_schedule.vn.per_step_vn : False I0423 04:03:11.842327 140323924080384 base_runner.py:69] task.train.lr_schedule.vn.scale : NoneType I0423 04:03:11.842398 140323924080384 base_runner.py:69] task.train.lr_schedule.vn.seed : NoneType I0423 04:03:11.842470 140323924080384 base_runner.py:69] task.train.lr_schedule.warmup_steps : 40000 I0423 04:03:11.842542 140323924080384 base_runner.py:69] task.train.lr_schedule.worker_replicas : 1 I0423 04:03:11.842613 140323924080384 base_runner.py:69] task.train.max_lstm_gradient_norm : 0.0 I0423 04:03:11.842686 140323924080384 base_runner.py:69] task.train.max_steps : 4000000 I0423 04:03:11.842758 140323924080384 base_runner.py:69] task.train.optimizer.allow_implicit_capture : NoneType I0423 04:03:11.842832 140323924080384 base_runner.py:69] task.train.optimizer.beta1 : 0.9 I0423 04:03:11.842911 140323924080384 base_runner.py:69] task.train.optimizer.beta2 : 0.997 I0423 04:03:11.842986 140323924080384 base_runner.py:69] task.train.optimizer.cls : type/lingvo.core.optimizer/Adam I0423 04:03:11.843059 140323924080384 base_runner.py:69] task.train.optimizer.dtype : float32 I0423 04:03:11.843132 140323924080384 base_runner.py:69] task.train.optimizer.epsilon : 1e-09 I0423 04:03:11.843204 140323924080384 base_runner.py:69] task.train.optimizer.fprop_dtype : NoneType I0423 04:03:11.843276 140323924080384 base_runner.py:69] task.train.optimizer.inference_driver_name : NoneType I0423 04:03:11.843348 140323924080384 base_runner.py:69] task.train.optimizer.is_eval : NoneType I0423 04:03:11.843420 140323924080384 base_runner.py:69] task.train.optimizer.is_inference : NoneType I0423 04:03:11.843492 140323924080384 base_runner.py:69] task.train.optimizer.name : 'Adam' I0423 04:03:11.843564 140323924080384 base_runner.py:69] task.train.optimizer.params_init.method : 'xavier' I0423 04:03:11.843636 140323924080384 base_runner.py:69] task.train.optimizer.params_init.scale : 1.000001 I0423 04:03:11.843708 140323924080384 base_runner.py:69] task.train.optimizer.params_init.seed : NoneType I0423 04:03:11.843780 140323924080384 base_runner.py:69] task.train.optimizer.random_seed : NoneType I0423 04:03:11.843852 140323924080384 base_runner.py:69] task.train.optimizer.skip_lp_regularization : NoneType I0423 04:03:11.843924 140323924080384 base_runner.py:69] task.train.optimizer.vn.global_vn : False I0423 04:03:11.843997 140323924080384 base_runner.py:69] task.train.optimizer.vn.per_step_vn : False I0423 04:03:11.844069 140323924080384 base_runner.py:69] task.train.optimizer.vn.scale : NoneType I0423 04:03:11.844141 140323924080384 base_runner.py:69] task.train.optimizer.vn.seed : NoneType I0423 04:03:11.844212 140323924080384 base_runner.py:69] task.train.pruning_hparams_dict : NoneType I0423 04:03:11.844283 140323924080384 base_runner.py:69] task.train.save_interval_seconds : 600 I0423 04:03:11.844355 140323924080384 base_runner.py:69] task.train.start_up_delay_steps : 200 I0423 04:03:11.844427 140323924080384 base_runner.py:69] task.train.sum_loss_across_tokens_in_batch : False I0423 04:03:11.844506 140323924080384 base_runner.py:69] task.train.summary_interval_steps : 100 I0423 04:03:11.844578 140323924080384 base_runner.py:69] task.train.tpu_steps_per_loop : 100 I0423 04:03:11.844650 140323924080384 base_runner.py:69] task.train.vn_start_step : 20000 I0423 04:03:11.844721 140323924080384 base_runner.py:69] task.train.vn_std : 0.0 I0423 04:03:11.844793 140323924080384 base_runner.py:69] task.vn.global_vn : False I0423 04:03:11.844866 140323924080384 base_runner.py:69] task.vn.per_step_vn : False I0423 04:03:11.844938 140323924080384 base_runner.py:69] task.vn.scale : NoneType I0423 04:03:11.845009 140323924080384 base_runner.py:69] task.vn.seed : NoneType I0423 04:03:11.845079 140323924080384 base_runner.py:69] train.early_stop.metric_history.jobname : 'eval_dev' I0423 04:03:11.845150 140323924080384 base_runner.py:69] train.early_stop.metric_history.local_filesystem : False I0423 04:03:11.845222 140323924080384 base_runner.py:69] train.early_stop.metric_history.logdir : '' I0423 04:03:11.845293 140323924080384 base_runner.py:69] train.early_stop.metric_history.metric : 'log_pplx' I0423 04:03:11.845366 140323924080384 base_runner.py:69] train.early_stop.metric_history.minimize : True I0423 04:03:11.845437 140323924080384 base_runner.py:69] train.early_stop.metric_history.name : 'MetricHistory' I0423 04:03:11.845509 140323924080384 base_runner.py:69] train.early_stop.metric_history.tfevent_file : False I0423 04:03:11.845581 140323924080384 base_runner.py:69] train.early_stop.name : 'EarlyStop' I0423 04:03:11.845653 140323924080384 base_runner.py:69] train.early_stop.tolerance : 0.0 I0423 04:03:11.845725 140323924080384 base_runner.py:69] train.early_stop.verbose : True I0423 04:03:11.845797 140323924080384 base_runner.py:69] train.early_stop.window : 0 I0423 04:03:11.845869 140323924080384 base_runner.py:69] train.ema_decay : 0.0 I0423 04:03:11.845941 140323924080384 base_runner.py:69] train.init_from_checkpoint_rules : {} I0423 04:03:11.846014 140323924080384 base_runner.py:69] train.max_steps : 4000000 I0423 04:03:11.846086 140323924080384 base_runner.py:69] train.save_interval_seconds : 600 I0423 04:03:11.846158 140323924080384 base_runner.py:69] train.start_up_delay_steps : 200 I0423 04:03:11.846229 140323924080384 base_runner.py:69] train.summary_interval_steps : 100 I0423 04:03:11.846301 140323924080384 base_runner.py:69] train.tpu_steps_per_loop : 100 I0423 04:03:11.846371 140323924080384 base_runner.py:69] vn.global_vn : False I0423 04:03:11.846443 140323924080384 base_runner.py:69] vn.per_step_vn : False I0423 04:03:11.846514 140323924080384 base_runner.py:69] vn.scale : NoneType I0423 04:03:11.846586 140323924080384 base_runner.py:69] vn.seed : NoneType I0423 04:03:11.846657 140323924080384 base_runner.py:69] I0423 04:03:11.846745 140323924080384 base_runner.py:70] ============================================================ I0423 04:03:11.849155 140323924080384 base_runner.py:115] Starting ... W0423 04:03:11.849384 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py:186: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead. W0423 04:03:11.849627 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/base_runner.py:324: The name tf.summary.FileWriter is deprecated. Please use tf.compat.v1.summary.FileWriter instead. W0423 04:03:11.850753 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py:192: The name tf.container is deprecated. Please use tf.compat.v1.container instead. I0423 04:03:11.851308 140323924080384 cluster.py:429] _LeastLoadedPlacer : ['/job:local/replica:0/task:0/device:CPU:0'] W0423 04:03:11.868781 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/py_utils.py:1258: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead. W0423 04:03:11.869398 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/py_utils.py:1260: The name tf.train.get_or_create_global_step is deprecated. Please use tf.compat.v1.train.get_or_create_global_step instead. I0423 04:03:11.874330 140323924080384 cluster.py:447] Place variable global_step on /job:local/replica:0/task:0/device:CPU:0 8 W0423 04:03:11.903553 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/py_utils.py:1250: The name tf.train.get_global_step is deprecated. Please use tf.compat.v1.train.get_global_step instead. I0423 04:03:11.903850 140323924080384 base_model.py:1116] Training parameters for : { early_stop: { metric_history: { "eval_dev" local_filesystem: False "/tmp/mnist/log" "log_pplx" minimize: True "MetricHistory" tfevent_file: False } "EarlyStop" tolerance: 0.0 verbose: True window: 0 } ema_decay: 0.0 init_from_checkpoint_rules: {} max_steps: 4000000 save_interval_seconds: 600 start_up_delay_steps: 200 summary_interval_steps: 100 tpu_steps_per_loop: 100 } I0423 04:03:11.938503 140323924080384 base_input_generator.py:510] bucket_batch_limit [32] W0423 04:03:11.969511 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/tasks/lm/input_generator.py:49: The name tf.summary.histogram is deprecated. Please use tf.compat.v1.summary.histogram instead. W0423 04:03:11.976054 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/base_model.py:257: The name tf.get_collection is deprecated. Please use tf.compat.v1.get_collection instead. W0423 04:03:12.225809 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/quant_utils.py:364: The name tf.random_uniform is deprecated. Please use tf.random.uniform instead. I0423 04:03:12.234674 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 16777224 I0423 04:03:12.237783 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.241147 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 16785416 I0423 04:03:12.243158 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.251791 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 33562632 I0423 04:03:12.254143 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.257399 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 33570824 I0423 04:03:12.259402 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.268038 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 50348040 I0423 04:03:12.270389 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.273664 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 50356232 I0423 04:03:12.275811 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.284426 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 67133448 I0423 04:03:12.286787 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.290229 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 67141640 I0423 04:03:12.292243 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.296936 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 67142152 I0423 04:03:12.298983 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.303801 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 67150344 I0423 04:03:12.305788 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.309209 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 67158536 I0423 04:03:12.311242 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:12.323225 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/py_utils.py:1062: The name tf.logging.warning is deprecated. Please use tf.compat.v1.logging.warning instead. W0423 04:03:12.323343 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:12.331094 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 134267400 I0423 04:03:12.333461 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.336726 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 134300168 I0423 04:03:12.338731 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:12.341249 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:12.348912 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 201409032 I0423 04:03:12.351268 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.354667 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 201417224 I0423 04:03:12.356676 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.362593 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 201425416 I0423 04:03:12.364852 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.368102 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 201433608 I0423 04:03:12.370096 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.395756 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 218210824 I0423 04:03:12.398130 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.401540 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 218219016 I0423 04:03:12.403578 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.412190 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 234996232 I0423 04:03:12.414561 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.417974 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 235004424 I0423 04:03:12.420015 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.428685 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 251781640 I0423 04:03:12.431149 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.434433 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 251789832 I0423 04:03:12.436479 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.445189 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 268567048 I0423 04:03:12.447613 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.450944 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 268575240 I0423 04:03:12.452975 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.457648 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 268575752 I0423 04:03:12.460437 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.465277 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 268583944 I0423 04:03:12.467340 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.470757 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 268592136 I0423 04:03:12.472794 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:12.484074 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:12.491914 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 335701000 I0423 04:03:12.494285 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.497576 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 335733768 I0423 04:03:12.499627 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:12.502139 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:12.509962 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 402842632 I0423 04:03:12.512340 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.515793 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 402850824 I0423 04:03:12.517817 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.523766 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 402859016 I0423 04:03:12.526021 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.529304 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 402867208 I0423 04:03:12.531347 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.557038 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 419644424 I0423 04:03:12.559441 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.562851 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 419652616 I0423 04:03:12.564879 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.573517 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 436429832 I0423 04:03:12.575903 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.579334 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 436438024 I0423 04:03:12.581362 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.589989 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 453215240 I0423 04:03:12.593095 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.596395 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 453223432 I0423 04:03:12.598423 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.607247 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 470000648 I0423 04:03:12.609643 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.612997 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 470008840 I0423 04:03:12.615034 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.619712 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 470009352 I0423 04:03:12.621885 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.626760 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 470017544 I0423 04:03:12.628779 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.632251 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 470025736 I0423 04:03:12.634280 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:12.645562 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:12.653516 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 537134600 I0423 04:03:12.655924 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.659229 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 537167368 I0423 04:03:12.661266 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:12.663800 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:12.672269 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 604276232 I0423 04:03:12.674640 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.678086 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 604284424 I0423 04:03:12.680177 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.686132 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 604292616 I0423 04:03:12.688406 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.691701 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 604300808 I0423 04:03:12.693747 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.712723 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 621078024 I0423 04:03:12.714530 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.717520 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 621086216 I0423 04:03:12.719043 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.821024 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 637863432 I0423 04:03:12.823067 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.825594 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 637871624 I0423 04:03:12.827089 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.833592 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 654648840 I0423 04:03:12.835355 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.837747 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 654657032 I0423 04:03:12.839236 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.845578 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 671434248 I0423 04:03:12.847330 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.849750 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 671442440 I0423 04:03:12.851414 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.855087 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 671442952 I0423 04:03:12.856631 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.860223 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 671451144 I0423 04:03:12.861697 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.864238 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 671459336 I0423 04:03:12.865727 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:12.873883 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:12.880271 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 738568200 I0423 04:03:12.882009 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.884413 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 738600968 I0423 04:03:12.886003 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:12.887897 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:12.893605 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 805709832 I0423 04:03:12.895410 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.897804 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 805718024 I0423 04:03:12.899353 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.903990 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 805726216 I0423 04:03:12.905467 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.907852 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 805734408 I0423 04:03:12.909333 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.928092 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 822511624 I0423 04:03:12.929842 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.932323 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 822519816 I0423 04:03:12.933811 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.940114 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 839297032 I0423 04:03:12.941912 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.944329 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 839305224 I0423 04:03:12.945827 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.952418 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 856082440 I0423 04:03:12.954161 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.956573 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 856090632 I0423 04:03:12.958067 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.964412 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 872867848 I0423 04:03:12.966150 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.968595 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 872876040 I0423 04:03:12.970216 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.973670 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 872876552 I0423 04:03:12.976135 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.979988 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 872884744 I0423 04:03:12.981483 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:12.984411 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 872892936 I0423 04:03:12.985903 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:12.994096 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:12.999882 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 940001800 I0423 04:03:13.001784 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.004235 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 940034568 I0423 04:03:13.005745 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.007611 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.013297 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 1007143432 I0423 04:03:13.015058 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.017564 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 1007151624 I0423 04:03:13.019088 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.023426 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 1007159816 I0423 04:03:13.025083 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.027596 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 1007168008 I0423 04:03:13.029104 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.047667 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 1023945224 I0423 04:03:13.049432 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.052098 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 1023953416 I0423 04:03:13.053590 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.059896 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 1040730632 I0423 04:03:13.061692 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.064117 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 1040738824 I0423 04:03:13.065608 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.071968 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 1057516040 I0423 04:03:13.073723 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.076263 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 1057524232 I0423 04:03:13.077756 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.084511 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 1074301448 I0423 04:03:13.086272 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.088804 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 1074309640 I0423 04:03:13.090416 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.093885 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 1074310152 I0423 04:03:13.095396 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.098989 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 1074318344 I0423 04:03:13.100650 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.103193 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 1074326536 I0423 04:03:13.104696 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.112809 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.118534 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 1141435400 I0423 04:03:13.120296 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.122704 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 1141468168 I0423 04:03:13.124207 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.126183 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.131848 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 1208577032 I0423 04:03:13.133601 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.136607 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 1208585224 I0423 04:03:13.138118 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.142469 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 1208593416 I0423 04:03:13.144156 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.146552 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 1208601608 I0423 04:03:13.148055 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.167058 140323924080384 py_utils.py:1064] WARNING!!! var weight_0 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.172530 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_0/var on /job:local/replica:0/task:0/device:CPU:0 1224985608 I0423 04:03:13.174217 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_0/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.175062 140323924080384 py_utils.py:1064] WARNING!!! var weight_1 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.180442 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_1/var on /job:local/replica:0/task:0/device:CPU:0 1241369608 I0423 04:03:13.182131 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_1/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.182867 140323924080384 py_utils.py:1064] WARNING!!! var weight_2 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.188380 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_2/var on /job:local/replica:0/task:0/device:CPU:0 1257753608 I0423 04:03:13.190068 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_2/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.190804 140323924080384 py_utils.py:1064] WARNING!!! var weight_3 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.196227 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_3/var on /job:local/replica:0/task:0/device:CPU:0 1274137608 I0423 04:03:13.197931 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_3/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.198668 140323924080384 py_utils.py:1064] WARNING!!! var weight_4 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.204224 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_4/var on /job:local/replica:0/task:0/device:CPU:0 1290521608 I0423 04:03:13.205916 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_4/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.206654 140323924080384 py_utils.py:1064] WARNING!!! var weight_5 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.212115 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_5/var on /job:local/replica:0/task:0/device:CPU:0 1306905608 I0423 04:03:13.213820 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_5/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.214559 140323924080384 py_utils.py:1064] WARNING!!! var weight_6 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.220542 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_6/var on /job:local/replica:0/task:0/device:CPU:0 1323289608 I0423 04:03:13.222254 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_6/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.223007 140323924080384 py_utils.py:1064] WARNING!!! var weight_7 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.228549 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_7/var on /job:local/replica:0/task:0/device:CPU:0 1339673608 I0423 04:03:13.230263 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_7/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.231014 140323924080384 py_utils.py:1064] WARNING!!! var weight_8 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.236453 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_8/var on /job:local/replica:0/task:0/device:CPU:0 1356057608 I0423 04:03:13.238177 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_8/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.239043 140323924080384 py_utils.py:1064] WARNING!!! var weight_9 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.244455 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_9/var on /job:local/replica:0/task:0/device:CPU:0 1372441608 I0423 04:03:13.246164 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_9/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.246908 140323924080384 py_utils.py:1064] WARNING!!! var weight_10 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.252475 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_10/var on /job:local/replica:0/task:0/device:CPU:0 1388825608 I0423 04:03:13.254230 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_10/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.254981 140323924080384 py_utils.py:1064] WARNING!!! var weight_11 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.260411 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_11/var on /job:local/replica:0/task:0/device:CPU:0 1405209608 I0423 04:03:13.262115 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_11/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.262849 140323924080384 py_utils.py:1064] WARNING!!! var weight_12 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.268305 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_12/var on /job:local/replica:0/task:0/device:CPU:0 1421593608 I0423 04:03:13.270001 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_12/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.270735 140323924080384 py_utils.py:1064] WARNING!!! var weight_13 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.276348 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_13/var on /job:local/replica:0/task:0/device:CPU:0 1437977608 I0423 04:03:13.278059 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_13/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.278795 140323924080384 py_utils.py:1064] WARNING!!! var weight_14 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.284277 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_14/var on /job:local/replica:0/task:0/device:CPU:0 1454361608 I0423 04:03:13.286056 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_14/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:13.286798 140323924080384 py_utils.py:1064] WARNING!!! var weight_15 is using the default xavier initializer. Make sure this is intended. I0423 04:03:13.292377 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_15/var on /job:local/replica:0/task:0/device:CPU:0 1470745608 I0423 04:03:13.294080 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_15/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.296499 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_0/var on /job:local/replica:0/task:0/device:CPU:0 1470753608 I0423 04:03:13.297966 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_0/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.301013 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_1/var on /job:local/replica:0/task:0/device:CPU:0 1470761608 I0423 04:03:13.302479 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_1/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.304853 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_2/var on /job:local/replica:0/task:0/device:CPU:0 1470769608 I0423 04:03:13.306318 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_2/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.308803 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_3/var on /job:local/replica:0/task:0/device:CPU:0 1470777608 I0423 04:03:13.310271 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_3/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.312648 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_4/var on /job:local/replica:0/task:0/device:CPU:0 1470785608 I0423 04:03:13.314116 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_4/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.316517 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_5/var on /job:local/replica:0/task:0/device:CPU:0 1470793608 I0423 04:03:13.318099 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_5/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.320503 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_6/var on /job:local/replica:0/task:0/device:CPU:0 1470801608 I0423 04:03:13.321980 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_6/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.324460 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_7/var on /job:local/replica:0/task:0/device:CPU:0 1470809608 I0423 04:03:13.326056 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_7/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.328464 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_8/var on /job:local/replica:0/task:0/device:CPU:0 1470817608 I0423 04:03:13.329947 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_8/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.332356 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_9/var on /job:local/replica:0/task:0/device:CPU:0 1470825608 I0423 04:03:13.333952 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_9/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.336349 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_10/var on /job:local/replica:0/task:0/device:CPU:0 1470833608 I0423 04:03:13.337824 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_10/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.340230 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_11/var on /job:local/replica:0/task:0/device:CPU:0 1470841608 I0423 04:03:13.341856 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_11/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.344261 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_12/var on /job:local/replica:0/task:0/device:CPU:0 1470849608 I0423 04:03:13.345758 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_12/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.348231 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_13/var on /job:local/replica:0/task:0/device:CPU:0 1470857608 I0423 04:03:13.349821 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_13/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.352216 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_14/var on /job:local/replica:0/task:0/device:CPU:0 1470865608 I0423 04:03:13.353701 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_14/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.356095 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_15/var on /job:local/replica:0/task:0/device:CPU:0 1470873608 I0423 04:03:13.357678 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_15/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.371655 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/emb/wm/var on /job:local/replica:0/task:0/device:CPU:0 1733017608 I0423 04:03:13.373347 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/emb/wm/var:0 shape=(32000, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:13.647532 140323924080384 py_utils.py:1277] === worker 0 === I0423 04:03:13.650789 140323924080384 py_utils.py:1267] worker 0: global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.650878 140323924080384 py_utils.py:1267] worker 0: input._tokenizer_default.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.650964 140323924080384 py_utils.py:1267] worker 0: input.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.651046 140323924080384 py_utils.py:1267] worker 0: lm.emb.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.651129 140323924080384 py_utils.py:1267] worker 0: lm.emb.wm /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.651185 140323924080384 py_utils.py:1267] worker 0: lm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.651266 140323924080384 py_utils.py:1267] worker 0: lm.input_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.651314 140323924080384 py_utils.py:1267] worker 0: lm.position_emb.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.651364 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_0 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.651412 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_1 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.651460 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_10 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.651519 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_11 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.651567 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_12 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.651617 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_13 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.651665 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_14 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.651714 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_15 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.651762 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_2 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.651810 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_3 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.651859 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_4 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.651907 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_5 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.651956 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_6 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.652004 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_7 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.652051 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_8 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.652101 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_9 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.652148 140323924080384 py_utils.py:1267] worker 0: lm.softmax.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.652198 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_0 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.652245 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_1 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.652295 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_10 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.652343 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_11 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.652395 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_12 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.652443 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_13 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.652493 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_14 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.652542 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_15 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.652590 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_2 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.652638 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_3 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.652687 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_4 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.652734 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_5 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.652782 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_6 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.652832 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_7 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.652879 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_8 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.652928 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_9 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.652976 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.653023 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.653072 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.653120 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.653168 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.653217 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.653265 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.653316 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.653367 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.653415 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.653465 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.653512 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.653561 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.653609 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.653657 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.653706 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.653754 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.653803 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.653851 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.653898 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.653948 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.653995 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.654043 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.654092 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.654140 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.654191 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.654241 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.654289 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.654337 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.654386 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.654433 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.654481 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.654530 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.654578 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.654625 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.654674 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.654721 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.654769 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.654819 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.654866 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.654931 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.654979 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.655028 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.655076 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.655128 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.655178 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.655225 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.655275 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.655323 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.655371 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.655420 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.655468 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.655517 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.655565 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.655613 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.655662 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.655710 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.655759 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.655807 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.655855 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.655905 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.655953 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.656002 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.656056 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.656106 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.656156 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.656204 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.656253 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.656301 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.656349 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.656398 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.656446 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.656495 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.656543 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.656590 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.656639 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.656687 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.656735 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.656784 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.656831 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.656878 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.656932 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.656980 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.657028 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.657077 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.657124 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.657172 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.657219 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.657268 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.657315 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.657363 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.657412 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.657459 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.657507 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.657556 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.657603 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.657651 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.657700 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.657747 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.657797 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.657849 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.657896 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.657946 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.657994 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.658041 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.658090 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.658138 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.658186 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.658235 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.658282 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.658330 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.658379 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.658427 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.658474 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.658523 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.658571 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.658618 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.658667 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.658715 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.658768 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.658818 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.658865 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.658924 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.658972 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.659020 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.659070 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.659117 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.659164 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.659213 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.659260 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.659307 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.659356 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.659404 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.659451 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.659498 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.659547 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.659595 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.659648 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.659698 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.659745 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.659794 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.659842 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.659890 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.659939 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.659986 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.660034 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.660083 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.660130 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.660178 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.660227 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.660274 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.660322 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.660370 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.660418 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.660465 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.660514 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.660564 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.660614 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.660662 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.660711 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.660758 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.660806 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.660855 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.660902 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.660950 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.661000 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.661046 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.661094 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.661143 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.661190 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.661238 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.661286 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.661334 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.661381 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.661433 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.661482 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.661530 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.661577 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.661626 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.661674 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.661721 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.661770 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.661818 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.661866 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.661915 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.661962 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.662009 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:13.662058 140323924080384 py_utils.py:1267] worker 0: lm.stack.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:13.662106 140323924080384 py_utils.py:1267] worker 0: lr_schedule.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:13.662153 140323924080384 py_utils.py:1267] worker 0: optimizer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:13.662211 140323924080384 py_utils.py:1283] ========== I0423 04:03:13.682004 140323924080384 layers.py:1272] input shape = (1024, 8, 2048) I0423 04:03:13.713006 140323924080384 layers.py:1283] input_embs shape = (1024, 8, 2048) I0423 04:03:13.725119 140323924080384 gpipe.py:378] cell 0 input [, , None, None, None, None] I0423 04:03:15.368747 140323924080384 gpipe.py:469] pipeline output = [, , None, None, None, None] I0423 04:03:15.368977 140323924080384 layers_with_gpipe.py:643] Tensor("fprop/1bwds_wpm_level_lm/tower_0_0/Reshape_6:0", shape=(1024, 8, 2048), dtype=float32, device=/job:local/replica:0/task:0/device:GPU:0) I0423 04:03:15.369086 140323924080384 layers.py:1286] layer_out shape = (1024, 8, 2048) I0423 04:03:15.571460 140323924080384 layers.py:1272] input shape = (1024, 8, 2048) I0423 04:03:15.602722 140323924080384 layers.py:1283] input_embs shape = (1024, 8, 2048) I0423 04:03:15.614315 140323924080384 gpipe.py:378] cell 0 input [, , None, None, None, None] I0423 04:03:17.075695 140323924080384 gpipe.py:469] pipeline output = [, , None, None, None, None] I0423 04:03:17.075887 140323924080384 layers_with_gpipe.py:643] Tensor("fprop/1bwds_wpm_level_lm/tower_0_1/Reshape_6:0", shape=(1024, 8, 2048), dtype=float32, device=/job:local/replica:0/task:0/device:GPU:1) I0423 04:03:17.075989 140323924080384 layers.py:1286] layer_out shape = (1024, 8, 2048) I0423 04:03:17.277540 140323924080384 layers.py:1272] input shape = (1024, 8, 2048) I0423 04:03:17.308243 140323924080384 layers.py:1283] input_embs shape = (1024, 8, 2048) I0423 04:03:17.320513 140323924080384 gpipe.py:378] cell 0 input [, , None, None, None, None] I0423 04:03:18.793193 140323924080384 gpipe.py:469] pipeline output = [, , None, None, None, None] I0423 04:03:18.793375 140323924080384 layers_with_gpipe.py:643] Tensor("fprop/1bwds_wpm_level_lm/tower_0_2/Reshape_6:0", shape=(1024, 8, 2048), dtype=float32, device=/job:local/replica:0/task:0/device:GPU:2) I0423 04:03:18.793478 140323924080384 layers.py:1286] layer_out shape = (1024, 8, 2048) I0423 04:03:18.996376 140323924080384 layers.py:1272] input shape = (1024, 8, 2048) I0423 04:03:19.027189 140323924080384 layers.py:1283] input_embs shape = (1024, 8, 2048) I0423 04:03:19.039427 140323924080384 gpipe.py:378] cell 0 input [, , None, None, None, None] I0423 04:03:20.539503 140323924080384 gpipe.py:469] pipeline output = [, , None, None, None, None] I0423 04:03:20.539684 140323924080384 layers_with_gpipe.py:643] Tensor("fprop/1bwds_wpm_level_lm/tower_0_3/Reshape_6:0", shape=(1024, 8, 2048), dtype=float32, device=/job:local/replica:0/task:0/device:GPU:3) I0423 04:03:20.539784 140323924080384 layers.py:1286] layer_out shape = (1024, 8, 2048) W0423 04:03:20.786952 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/summary_utils.py:36: The name tf.summary.scalar is deprecated. Please use tf.compat.v1.summary.scalar instead. I0423 04:03:25.494581 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.emb.wm: I0423 04:03:25.494847 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_0: I0423 04:03:25.494952 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_1: I0423 04:03:25.495040 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_10: I0423 04:03:25.495124 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_11: I0423 04:03:25.495206 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_12: I0423 04:03:25.495285 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_13: I0423 04:03:25.495362 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_14: I0423 04:03:25.495440 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_15: I0423 04:03:25.495517 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_2: I0423 04:03:25.495596 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_3: I0423 04:03:25.495675 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_4: I0423 04:03:25.495752 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_5: I0423 04:03:25.495829 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_6: I0423 04:03:25.495906 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_7: I0423 04:03:25.495982 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_8: I0423 04:03:25.496059 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_9: I0423 04:03:25.496136 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_0: I0423 04:03:25.496222 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_1: I0423 04:03:25.496306 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_10: I0423 04:03:25.496390 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_11: I0423 04:03:25.496476 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_12: I0423 04:03:25.496560 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_13: I0423 04:03:25.496642 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_14: I0423 04:03:25.496723 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_15: I0423 04:03:25.496804 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_2: I0423 04:03:25.496886 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_3: I0423 04:03:25.496970 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_4: I0423 04:03:25.497051 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_5: I0423 04:03:25.497133 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_6: I0423 04:03:25.497215 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_7: I0423 04:03:25.497297 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_8: I0423 04:03:25.497378 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_9: I0423 04:03:25.497459 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc_0.b: I0423 04:03:25.497539 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc_0.w: I0423 04:03:25.497625 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc_1.b: I0423 04:03:25.497704 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc_1.w: I0423 04:03:25.497788 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.layer_norm.bias: I0423 04:03:25.497868 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.layer_norm.scale: I0423 04:03:25.497955 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.atten.per_dim_scale: I0423 04:03:25.498035 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj: I0423 04:03:25.498121 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj_b: I0423 04:03:25.498202 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj: I0423 04:03:25.498285 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj_b: I0423 04:03:25.498363 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.query_proj: I0423 04:03:25.498446 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.query_proj_b: I0423 04:03:25.498524 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.source_proj: I0423 04:03:25.498606 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.source_proj_b: I0423 04:03:25.498684 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.layer_norm.bias: I0423 04:03:25.498763 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.layer_norm.scale: I0423 04:03:25.498840 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc_0.b: I0423 04:03:25.498924 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc_0.w: I0423 04:03:25.499011 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc_1.b: I0423 04:03:25.499089 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc_1.w: I0423 04:03:25.499176 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.layer_norm.bias: I0423 04:03:25.499254 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.layer_norm.scale: I0423 04:03:25.499331 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.atten.per_dim_scale: I0423 04:03:25.499411 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj: I0423 04:03:25.499495 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj_b: I0423 04:03:25.499573 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj: I0423 04:03:25.499658 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj_b: I0423 04:03:25.499737 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.query_proj: I0423 04:03:25.499819 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.query_proj_b: I0423 04:03:25.499897 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.source_proj: I0423 04:03:25.499982 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.source_proj_b: I0423 04:03:25.500058 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.layer_norm.bias: I0423 04:03:25.500137 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.layer_norm.scale: I0423 04:03:25.500214 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc_0.b: I0423 04:03:25.500298 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc_0.w: I0423 04:03:25.500380 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc_1.b: I0423 04:03:25.500458 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc_1.w: I0423 04:03:25.500540 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.layer_norm.bias: I0423 04:03:25.500618 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.layer_norm.scale: I0423 04:03:25.500695 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.atten.per_dim_scale: I0423 04:03:25.500773 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj: I0423 04:03:25.500858 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj_b: I0423 04:03:25.500936 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj: I0423 04:03:25.501019 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj_b: I0423 04:03:25.501097 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.query_proj: I0423 04:03:25.501180 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.query_proj_b: I0423 04:03:25.501259 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.source_proj: I0423 04:03:25.501341 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.source_proj_b: I0423 04:03:25.501419 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.layer_norm.bias: I0423 04:03:25.501502 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.layer_norm.scale: I0423 04:03:25.501580 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc_0.b: I0423 04:03:25.501657 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc_0.w: I0423 04:03:25.501741 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc_1.b: I0423 04:03:25.501818 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc_1.w: I0423 04:03:25.501902 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.layer_norm.bias: I0423 04:03:25.501979 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.layer_norm.scale: I0423 04:03:25.502055 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.atten.per_dim_scale: I0423 04:03:25.502134 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj: I0423 04:03:25.502219 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj_b: I0423 04:03:25.502298 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj: I0423 04:03:25.502381 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj_b: I0423 04:03:25.502459 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.query_proj: I0423 04:03:25.502542 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.query_proj_b: I0423 04:03:25.502619 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.source_proj: I0423 04:03:25.502706 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.source_proj_b: I0423 04:03:25.502785 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.layer_norm.bias: I0423 04:03:25.502863 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.layer_norm.scale: I0423 04:03:25.502949 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc_0.b: I0423 04:03:25.503026 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc_0.w: I0423 04:03:25.503109 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc_1.b: I0423 04:03:25.503187 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc_1.w: I0423 04:03:25.503271 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.layer_norm.bias: I0423 04:03:25.503349 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.layer_norm.scale: I0423 04:03:25.503426 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.atten.per_dim_scale: I0423 04:03:25.503504 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj: I0423 04:03:25.503587 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj_b: I0423 04:03:25.503664 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj: I0423 04:03:25.503747 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj_b: I0423 04:03:25.503825 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.query_proj: I0423 04:03:25.503916 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.query_proj_b: I0423 04:03:25.503994 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.source_proj: I0423 04:03:25.504076 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.source_proj_b: I0423 04:03:25.504156 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.layer_norm.bias: I0423 04:03:25.504232 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.layer_norm.scale: I0423 04:03:25.504311 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc_0.b: I0423 04:03:25.504388 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc_0.w: I0423 04:03:25.504471 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc_1.b: I0423 04:03:25.504547 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc_1.w: I0423 04:03:25.504630 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.layer_norm.bias: I0423 04:03:25.504708 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.layer_norm.scale: I0423 04:03:25.504784 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.atten.per_dim_scale: I0423 04:03:25.504862 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj: I0423 04:03:25.504945 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj_b: I0423 04:03:25.505028 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj: I0423 04:03:25.505111 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj_b: I0423 04:03:25.505189 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.query_proj: I0423 04:03:25.505273 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.query_proj_b: I0423 04:03:25.505351 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.source_proj: I0423 04:03:25.505434 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.source_proj_b: I0423 04:03:25.505511 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.layer_norm.bias: I0423 04:03:25.505589 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.layer_norm.scale: W0423 04:03:28.879385 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/optimizer.py:179: The name tf.train.AdamOptimizer is deprecated. Please use tf.compat.v1.train.AdamOptimizer instead. I0423 04:03:28.881958 140323924080384 cluster.py:447] Place variable beta1_power on /job:local/replica:0/task:0/device:CPU:0 1733017612 I0423 04:03:28.884445 140323924080384 cluster.py:447] Place variable beta2_power on /job:local/replica:0/task:0/device:CPU:0 1733017616 I0423 04:03:30.293446 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/total_samples/var on /job:local/replica:0/task:0/device:CPU:0 1733017624 I0423 04:03:30.295248 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/total_samples/var:0 shape=() on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:30.301662 140323924080384 cluster.py:447] Place variable total_nan_gradients/var on /job:local/replica:0/task:0/device:CPU:0 1733017632 I0423 04:03:30.304086 140323924080384 py_utils.py:1220] Creating var total_nan_gradients/var:0 shape=() on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:30.338160 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/base_runner.py:156: The name tf.train.Saver is deprecated. Please use tf.compat.v1.train.Saver instead. W0423 04:03:30.620929 140323924080384 deprecation_wrapper.py:119] From /tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py:198: The name tf.summary.merge_all is deprecated. Please use tf.compat.v1.summary.merge_all instead. I0423 04:03:30.862535 140323924080384 py_utils.py:1267] MODEL ANALYSIS: I0423 04:03:30.862643 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.emb.wm (32000, 2048) 65536000 1bwds_wpm_level_lm/transformerlm/emb/wm/var I0423 04:03:30.862715 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_0 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_0/var I0423 04:03:30.862775 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_1 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_1/var I0423 04:03:30.862828 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_10 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_10/var I0423 04:03:30.862885 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_11 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_11/var I0423 04:03:30.862938 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_12 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_12/var I0423 04:03:30.862988 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_13 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_13/var I0423 04:03:30.863038 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_14 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_14/var I0423 04:03:30.863086 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_15 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_15/var I0423 04:03:30.863136 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_2 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_2/var I0423 04:03:30.863183 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_3 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_3/var I0423 04:03:30.863233 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_4 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_4/var I0423 04:03:30.863281 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_5 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_5/var I0423 04:03:30.863329 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_6 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_6/var I0423 04:03:30.863378 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_7 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_7/var I0423 04:03:30.863426 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_8 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_8/var I0423 04:03:30.863475 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.bias_9 (2000,) 2000 1bwds_wpm_level_lm/transformerlm/softmax/bias_9/var I0423 04:03:30.863523 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_0 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_0/var I0423 04:03:30.863573 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_1 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_1/var I0423 04:03:30.863626 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_10 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_10/var I0423 04:03:30.863677 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_11 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_11/var I0423 04:03:30.863727 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_12 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_12/var I0423 04:03:30.863775 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_13 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_13/var I0423 04:03:30.863822 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_14 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_14/var I0423 04:03:30.863872 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_15 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_15/var I0423 04:03:30.863920 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_2 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_2/var I0423 04:03:30.863970 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_3 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_3/var I0423 04:03:30.864017 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_4 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_4/var I0423 04:03:30.864067 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_5 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_5/var I0423 04:03:30.864114 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_6 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_6/var I0423 04:03:30.864164 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_7 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_7/var I0423 04:03:30.864212 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_8 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_8/var I0423 04:03:30.864259 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.softmax.weight_9 (2048, 2000) 4096000 1bwds_wpm_level_lm/transformerlm/softmax/weight_9/var I0423 04:03:30.864309 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[0].b (8192,) 8192 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/b/var I0423 04:03:30.864357 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[0].w (2048, 8192) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/w/var I0423 04:03:30.864407 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[1].b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/b/var I0423 04:03:30.864459 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[1].w (8192, 2048) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/w/var I0423 04:03:30.864510 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.fflayer.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/bias/var I0423 04:03:30.864558 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.fflayer.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/scale/var I0423 04:03:30.864608 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.atten.atten.per_dim_scale (128,) 128 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var I0423 04:03:30.864656 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj/var I0423 04:03:30.864706 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj_b/var I0423 04:03:30.864753 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj/var I0423 04:03:30.864805 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj_b/var I0423 04:03:30.864856 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.atten.query_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj/var I0423 04:03:30.864903 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.atten.query_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj_b/var I0423 04:03:30.864953 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.atten.source_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj/var I0423 04:03:30.865000 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.atten.source_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj_b/var I0423 04:03:30.865048 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/bias/var I0423 04:03:30.865097 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_0.self_atten.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/scale/var I0423 04:03:30.865147 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[0].b (8192,) 8192 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/b/var I0423 04:03:30.865195 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[0].w (2048, 8192) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/w/var I0423 04:03:30.865247 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[1].b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/b/var I0423 04:03:30.865297 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[1].w (8192, 2048) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/w/var I0423 04:03:30.865345 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.fflayer.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/bias/var I0423 04:03:30.865392 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.fflayer.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/scale/var I0423 04:03:30.865442 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.atten.atten.per_dim_scale (128,) 128 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var I0423 04:03:30.865489 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj/var I0423 04:03:30.865537 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj_b/var I0423 04:03:30.865586 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj/var I0423 04:03:30.865634 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj_b/var I0423 04:03:30.865683 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.atten.query_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj/var I0423 04:03:30.865731 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.atten.query_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj_b/var I0423 04:03:30.865778 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.atten.source_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj/var I0423 04:03:30.865828 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.atten.source_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj_b/var I0423 04:03:30.865875 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/bias/var I0423 04:03:30.865923 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_1.self_atten.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/scale/var I0423 04:03:30.865978 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[0].b (8192,) 8192 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/b/var I0423 04:03:30.866027 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[0].w (2048, 8192) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/w/var I0423 04:03:30.866075 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[1].b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/b/var I0423 04:03:30.866123 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[1].w (8192, 2048) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/w/var I0423 04:03:30.866172 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.fflayer.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/bias/var I0423 04:03:30.866219 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.fflayer.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/scale/var I0423 04:03:30.866267 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.atten.atten.per_dim_scale (128,) 128 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var I0423 04:03:30.866316 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj/var I0423 04:03:30.866364 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj_b/var I0423 04:03:30.866411 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj/var I0423 04:03:30.866460 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj_b/var I0423 04:03:30.866508 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.atten.query_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj/var I0423 04:03:30.866556 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.atten.query_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj_b/var I0423 04:03:30.866605 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.atten.source_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj/var I0423 04:03:30.866652 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.atten.source_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj_b/var I0423 04:03:30.866702 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/bias/var I0423 04:03:30.866754 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_2.self_atten.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/scale/var I0423 04:03:30.866802 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[0].b (8192,) 8192 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/b/var I0423 04:03:30.866851 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[0].w (2048, 8192) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/w/var I0423 04:03:30.866913 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[1].b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/b/var I0423 04:03:30.866962 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[1].w (8192, 2048) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/w/var I0423 04:03:30.867011 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.fflayer.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/bias/var I0423 04:03:30.867058 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.fflayer.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/scale/var I0423 04:03:30.867108 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.atten.atten.per_dim_scale (128,) 128 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var I0423 04:03:30.867156 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj/var I0423 04:03:30.867203 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj_b/var I0423 04:03:30.867253 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj/var I0423 04:03:30.867300 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj_b/var I0423 04:03:30.867348 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.atten.query_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj/var I0423 04:03:30.867398 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.atten.query_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj_b/var I0423 04:03:30.867445 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.atten.source_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj/var I0423 04:03:30.867499 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.atten.source_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj_b/var I0423 04:03:30.867547 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/bias/var I0423 04:03:30.867594 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_3.self_atten.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/scale/var I0423 04:03:30.867643 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[0].b (8192,) 8192 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/b/var I0423 04:03:30.867691 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[0].w (2048, 8192) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/w/var I0423 04:03:30.867738 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[1].b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/b/var I0423 04:03:30.867788 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[1].w (8192, 2048) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/w/var I0423 04:03:30.867835 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.fflayer.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/bias/var I0423 04:03:30.867885 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.fflayer.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/scale/var I0423 04:03:30.867933 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.atten.atten.per_dim_scale (128,) 128 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var I0423 04:03:30.867980 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj/var I0423 04:03:30.868029 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj_b/var I0423 04:03:30.868077 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj/var I0423 04:03:30.868124 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj_b/var I0423 04:03:30.868174 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.atten.query_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj/var I0423 04:03:30.868221 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.atten.query_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj_b/var I0423 04:03:30.868275 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.atten.source_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj/var I0423 04:03:30.868324 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.atten.source_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj_b/var I0423 04:03:30.868374 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/bias/var I0423 04:03:30.868422 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_4.self_atten.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/scale/var I0423 04:03:30.868470 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[0].b (8192,) 8192 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/b/var I0423 04:03:30.868520 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[0].w (2048, 8192) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/w/var I0423 04:03:30.868567 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[1].b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/b/var I0423 04:03:30.868616 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[1].w (8192, 2048) 16777216 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/w/var I0423 04:03:30.868664 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.fflayer.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/bias/var I0423 04:03:30.868711 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.fflayer.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/scale/var I0423 04:03:30.868761 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.atten.atten.per_dim_scale (128,) 128 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var I0423 04:03:30.868808 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj/var I0423 04:03:30.868858 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj_b/var I0423 04:03:30.868906 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj/var I0423 04:03:30.868953 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj_b/var I0423 04:03:30.869008 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.atten.query_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj/var I0423 04:03:30.869056 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.atten.query_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj_b/var I0423 04:03:30.869105 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.atten.source_proj (2048, 2048) 4194304 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj/var I0423 04:03:30.869153 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.atten.source_proj_b (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj_b/var I0423 04:03:30.869201 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.layer_norm.bias (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/bias/var I0423 04:03:30.869251 140323924080384 py_utils.py:1267] MODEL ANALYSIS: _task.lm.stack.cell_0.encoder_5.self_atten.layer_norm.scale (2048,) 2048 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/scale/var I0423 04:03:30.869297 140323924080384 py_utils.py:1267] MODEL ANALYSIS: ==================================================================================================== I0423 04:03:30.869345 140323924080384 py_utils.py:1267] MODEL ANALYSIS: total #params: 433254400 I0423 04:03:30.869394 140323924080384 py_utils.py:1267] MODEL ANALYSIS: I0423 04:03:36.841078 140323924080384 trainer.py:1261] Job trainer_client start I0423 04:03:36.855381 140323924080384 base_runner.py:67] ============================================================ I0423 04:03:36.862206 140323924080384 base_runner.py:69] allow_implicit_capture : NoneType I0423 04:03:36.862296 140323924080384 base_runner.py:69] cls : type/lingvo.core.base_model/SingleTaskModel I0423 04:03:36.862360 140323924080384 base_runner.py:69] cluster.add_summary : NoneType I0423 04:03:36.862418 140323924080384 base_runner.py:69] cluster.cls : type/lingvo.core.cluster/_Cluster I0423 04:03:36.862474 140323924080384 base_runner.py:69] cluster.controller.cpus_per_replica : 1 I0423 04:03:36.862528 140323924080384 base_runner.py:69] cluster.controller.devices_per_split : 1 I0423 04:03:36.862581 140323924080384 base_runner.py:69] cluster.controller.gpus_per_replica : 4 I0423 04:03:36.862633 140323924080384 base_runner.py:69] cluster.controller.name : '/job:local' I0423 04:03:36.862685 140323924080384 base_runner.py:69] cluster.controller.num_tpu_hosts : 0 I0423 04:03:36.862739 140323924080384 base_runner.py:69] cluster.controller.replicas : 1 I0423 04:03:36.862791 140323924080384 base_runner.py:69] cluster.controller.tpus_per_replica : 0 I0423 04:03:36.862843 140323924080384 base_runner.py:69] cluster.decoder.cpus_per_replica : 1 I0423 04:03:36.862906 140323924080384 base_runner.py:69] cluster.decoder.devices_per_split : 1 I0423 04:03:36.862961 140323924080384 base_runner.py:69] cluster.decoder.gpus_per_replica : 1 I0423 04:03:36.863013 140323924080384 base_runner.py:69] cluster.decoder.name : '/job:local' I0423 04:03:36.863065 140323924080384 base_runner.py:69] cluster.decoder.num_tpu_hosts : 0 I0423 04:03:36.863117 140323924080384 base_runner.py:69] cluster.decoder.replicas : 1 I0423 04:03:36.863169 140323924080384 base_runner.py:69] cluster.decoder.tpus_per_replica : 0 I0423 04:03:36.863221 140323924080384 base_runner.py:69] cluster.evaler.cpus_per_replica : 1 I0423 04:03:36.863274 140323924080384 base_runner.py:69] cluster.evaler.devices_per_split : 1 I0423 04:03:36.863337 140323924080384 base_runner.py:69] cluster.evaler.gpus_per_replica : 1 I0423 04:03:36.863392 140323924080384 base_runner.py:69] cluster.evaler.name : '/job:local' I0423 04:03:36.863444 140323924080384 base_runner.py:69] cluster.evaler.num_tpu_hosts : 0 I0423 04:03:36.863496 140323924080384 base_runner.py:69] cluster.evaler.replicas : 1 I0423 04:03:36.863548 140323924080384 base_runner.py:69] cluster.evaler.tpus_per_replica : 0 I0423 04:03:36.863600 140323924080384 base_runner.py:69] cluster.input.cpus_per_replica : 1 I0423 04:03:36.863651 140323924080384 base_runner.py:69] cluster.input.devices_per_split : 1 I0423 04:03:36.863703 140323924080384 base_runner.py:69] cluster.input.gpus_per_replica : 0 I0423 04:03:36.863754 140323924080384 base_runner.py:69] cluster.input.name : '/job:local' I0423 04:03:36.863806 140323924080384 base_runner.py:69] cluster.input.num_tpu_hosts : 0 I0423 04:03:36.863859 140323924080384 base_runner.py:69] cluster.input.replicas : 0 I0423 04:03:36.863912 140323924080384 base_runner.py:69] cluster.input.tpus_per_replica : 0 I0423 04:03:36.863962 140323924080384 base_runner.py:69] cluster.job : 'trainer_client' I0423 04:03:36.864015 140323924080384 base_runner.py:69] cluster.mode : 'sync' I0423 04:03:36.864067 140323924080384 base_runner.py:69] cluster.ps.cpus_per_replica : 1 I0423 04:03:36.864119 140323924080384 base_runner.py:69] cluster.ps.devices_per_split : 1 I0423 04:03:36.864171 140323924080384 base_runner.py:69] cluster.ps.gpus_per_replica : 0 I0423 04:03:36.864223 140323924080384 base_runner.py:69] cluster.ps.name : '/job:local' I0423 04:03:36.864274 140323924080384 base_runner.py:69] cluster.ps.num_tpu_hosts : 0 I0423 04:03:36.864326 140323924080384 base_runner.py:69] cluster.ps.replicas : 1 I0423 04:03:36.864378 140323924080384 base_runner.py:69] cluster.ps.tpus_per_replica : 0 I0423 04:03:36.864429 140323924080384 base_runner.py:69] cluster.task : 0 I0423 04:03:36.864481 140323924080384 base_runner.py:69] cluster.worker.cpus_per_replica : 1 I0423 04:03:36.864533 140323924080384 base_runner.py:69] cluster.worker.devices_per_split : 4 I0423 04:03:36.864584 140323924080384 base_runner.py:69] cluster.worker.gpus_per_replica : 4 I0423 04:03:36.864636 140323924080384 base_runner.py:69] cluster.worker.name : '/job:local' I0423 04:03:36.864689 140323924080384 base_runner.py:69] cluster.worker.num_tpu_hosts : 0 I0423 04:03:36.864739 140323924080384 base_runner.py:69] cluster.worker.replicas : 1 I0423 04:03:36.864790 140323924080384 base_runner.py:69] cluster.worker.tpus_per_replica : 0 I0423 04:03:36.864842 140323924080384 base_runner.py:69] dtype : float32 I0423 04:03:36.864895 140323924080384 base_runner.py:69] fprop_dtype : NoneType I0423 04:03:36.864947 140323924080384 base_runner.py:69] inference_driver_name : NoneType I0423 04:03:36.864999 140323924080384 base_runner.py:69] input.allow_implicit_capture : NoneType I0423 04:03:36.865050 140323924080384 base_runner.py:69] input.bucket_adjust_every_n : 0 I0423 04:03:36.865102 140323924080384 base_runner.py:69] input.bucket_batch_limit : [8] I0423 04:03:36.865153 140323924080384 base_runner.py:69] input.bucket_upper_bound : [100] I0423 04:03:36.865204 140323924080384 base_runner.py:69] input.cls : type/lingvo.tasks.lm.input_generator/LmInput I0423 04:03:36.865256 140323924080384 base_runner.py:69] input.dtype : float32 I0423 04:03:36.865308 140323924080384 base_runner.py:69] input.file_buffer_size : 10000000 I0423 04:03:36.865359 140323924080384 base_runner.py:69] input.file_parallelism : 10 I0423 04:03:36.865411 140323924080384 base_runner.py:69] input.file_pattern : 'text:/tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled/news.en*' I0423 04:03:36.865463 140323924080384 base_runner.py:69] input.file_random_seed : 301 I0423 04:03:36.865515 140323924080384 base_runner.py:69] input.fixed_input_shape : True I0423 04:03:36.865566 140323924080384 base_runner.py:69] input.flush_every_n : 0 I0423 04:03:36.865617 140323924080384 base_runner.py:69] input.fprop_dtype : NoneType I0423 04:03:36.865675 140323924080384 base_runner.py:69] input.inference_driver_name : NoneType I0423 04:03:36.865729 140323924080384 base_runner.py:69] input.is_eval : NoneType I0423 04:03:36.865782 140323924080384 base_runner.py:69] input.is_inference : NoneType I0423 04:03:36.865833 140323924080384 base_runner.py:69] input.name : '1bwds_train_set' I0423 04:03:36.865885 140323924080384 base_runner.py:69] input.num_batcher_threads : 16 I0423 04:03:36.865937 140323924080384 base_runner.py:69] input.num_samples : 0 I0423 04:03:36.865988 140323924080384 base_runner.py:69] input.pad_to_max_seq_length : False I0423 04:03:36.866040 140323924080384 base_runner.py:69] input.params_init.method : 'xavier' I0423 04:03:36.866092 140323924080384 base_runner.py:69] input.params_init.scale : 1.000001 I0423 04:03:36.866143 140323924080384 base_runner.py:69] input.params_init.seed : NoneType I0423 04:03:36.866195 140323924080384 base_runner.py:69] input.random_seed : NoneType I0423 04:03:36.866247 140323924080384 base_runner.py:69] input.require_sequential_order : False I0423 04:03:36.866300 140323924080384 base_runner.py:69] input.skip_lp_regularization : NoneType I0423 04:03:36.866352 140323924080384 base_runner.py:69] input.source_max_length : NoneType I0423 04:03:36.866404 140323924080384 base_runner.py:69] input.target_max_length : 1024 I0423 04:03:36.866456 140323924080384 base_runner.py:69] input.tokenizer.allow_implicit_capture : NoneType I0423 04:03:36.866508 140323924080384 base_runner.py:69] input.tokenizer.append_eos : True I0423 04:03:36.866560 140323924080384 base_runner.py:69] input.tokenizer.cls : type/lingvo.core.tokenizers/VocabFileTokenizer I0423 04:03:36.866612 140323924080384 base_runner.py:69] input.tokenizer.dtype : float32 I0423 04:03:36.866664 140323924080384 base_runner.py:69] input.tokenizer.fprop_dtype : NoneType I0423 04:03:36.866717 140323924080384 base_runner.py:69] input.tokenizer.inference_driver_name : NoneType I0423 04:03:36.866769 140323924080384 base_runner.py:69] input.tokenizer.is_eval : NoneType I0423 04:03:36.866821 140323924080384 base_runner.py:69] input.tokenizer.is_inference : NoneType I0423 04:03:36.866878 140323924080384 base_runner.py:69] input.tokenizer.load_token_ids_from_vocab : True I0423 04:03:36.866934 140323924080384 base_runner.py:69] input.tokenizer.name : 'tokenizer' I0423 04:03:36.866986 140323924080384 base_runner.py:69] input.tokenizer.ngram_separator : '' I0423 04:03:36.867038 140323924080384 base_runner.py:69] input.tokenizer.ngram_vocab_filepath : NoneType I0423 04:03:36.867090 140323924080384 base_runner.py:69] input.tokenizer.pad_to_max_length : True I0423 04:03:36.867141 140323924080384 base_runner.py:69] input.tokenizer.params_init.method : 'xavier' I0423 04:03:36.867192 140323924080384 base_runner.py:69] input.tokenizer.params_init.scale : 1.000001 I0423 04:03:36.867244 140323924080384 base_runner.py:69] input.tokenizer.params_init.seed : NoneType I0423 04:03:36.867296 140323924080384 base_runner.py:69] input.tokenizer.random_seed : NoneType I0423 04:03:36.867347 140323924080384 base_runner.py:69] input.tokenizer.skip_lp_regularization : NoneType I0423 04:03:36.867399 140323924080384 base_runner.py:69] input.tokenizer.target_eos_id : 2 I0423 04:03:36.867450 140323924080384 base_runner.py:69] input.tokenizer.target_sos_id : 1 I0423 04:03:36.867501 140323924080384 base_runner.py:69] input.tokenizer.target_unk_id : 3 I0423 04:03:36.867552 140323924080384 base_runner.py:69] input.tokenizer.token_vocab_filepath : '/tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/vocab.txt' I0423 04:03:36.867605 140323924080384 base_runner.py:69] input.tokenizer.tokens_delimiter : ' ' I0423 04:03:36.867657 140323924080384 base_runner.py:69] input.tokenizer.vn.global_vn : False I0423 04:03:36.867708 140323924080384 base_runner.py:69] input.tokenizer.vn.per_step_vn : False I0423 04:03:36.867760 140323924080384 base_runner.py:69] input.tokenizer.vn.scale : NoneType I0423 04:03:36.867813 140323924080384 base_runner.py:69] input.tokenizer.vn.seed : NoneType I0423 04:03:36.867865 140323924080384 base_runner.py:69] input.tokenizer.vocab_size : 32000 I0423 04:03:36.867921 140323924080384 base_runner.py:69] input.tokenizer_dict : {} I0423 04:03:36.867973 140323924080384 base_runner.py:69] input.tpu_infeed_parallism : 1 I0423 04:03:36.868025 140323924080384 base_runner.py:69] input.use_per_host_infeed : False I0423 04:03:36.868077 140323924080384 base_runner.py:69] input.use_within_batch_mixing : False I0423 04:03:36.868128 140323924080384 base_runner.py:69] input.vn.global_vn : False I0423 04:03:36.868180 140323924080384 base_runner.py:69] input.vn.per_step_vn : False I0423 04:03:36.868231 140323924080384 base_runner.py:69] input.vn.scale : NoneType I0423 04:03:36.868282 140323924080384 base_runner.py:69] input.vn.seed : NoneType I0423 04:03:36.868333 140323924080384 base_runner.py:69] is_eval : NoneType I0423 04:03:36.868382 140323924080384 base_runner.py:69] is_inference : NoneType I0423 04:03:36.868434 140323924080384 base_runner.py:69] model : 'lm.one_billion_wds.OneBWdsGPipeTransformer@/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/tasks/lm/params/one_billion_wds.py:186' I0423 04:03:36.868490 140323924080384 base_runner.py:69] name : '' I0423 04:03:36.868541 140323924080384 base_runner.py:69] params_init.method : 'xavier' I0423 04:03:36.868593 140323924080384 base_runner.py:69] params_init.scale : 1.000001 I0423 04:03:36.868645 140323924080384 base_runner.py:69] params_init.seed : NoneType I0423 04:03:36.868696 140323924080384 base_runner.py:69] random_seed : NoneType I0423 04:03:36.868747 140323924080384 base_runner.py:69] skip_lp_regularization : NoneType I0423 04:03:36.868799 140323924080384 base_runner.py:69] task.allow_implicit_capture : NoneType I0423 04:03:36.868851 140323924080384 base_runner.py:69] task.cls : type/lingvo.tasks.lm.model/FixedShapeInputLanguageModel I0423 04:03:36.868904 140323924080384 base_runner.py:69] task.decoder : NoneType I0423 04:03:36.868956 140323924080384 base_runner.py:69] task.dtype : float32 I0423 04:03:36.869007 140323924080384 base_runner.py:69] task.encoder : NoneType I0423 04:03:36.869059 140323924080384 base_runner.py:69] task.eval.decoder_samples_per_summary : 0 I0423 04:03:36.869110 140323924080384 base_runner.py:69] task.eval.samples_per_summary : 0 I0423 04:03:36.869160 140323924080384 base_runner.py:69] task.fprop_dtype : NoneType I0423 04:03:36.869213 140323924080384 base_runner.py:69] task.inference_driver_name : NoneType I0423 04:03:36.869263 140323924080384 base_runner.py:69] task.input : NoneType I0423 04:03:36.869314 140323924080384 base_runner.py:69] task.is_eval : NoneType I0423 04:03:36.869365 140323924080384 base_runner.py:69] task.is_inference : NoneType I0423 04:03:36.869416 140323924080384 base_runner.py:69] task.lm.allow_implicit_capture : NoneType I0423 04:03:36.869468 140323924080384 base_runner.py:69] task.lm.atten_dropout_prob : 0.1 I0423 04:03:36.869519 140323924080384 base_runner.py:69] task.lm.cls : type/lingvo.tasks.lm.layers/GPipeTransformerLm I0423 04:03:36.869570 140323924080384 base_runner.py:69] task.lm.dtype : float32 I0423 04:03:36.869621 140323924080384 base_runner.py:69] task.lm.emb.allow_implicit_capture : NoneType I0423 04:03:36.869673 140323924080384 base_runner.py:69] task.lm.emb.apply_pruning : False I0423 04:03:36.869724 140323924080384 base_runner.py:69] task.lm.emb.cls : type/lingvo.core.layers/SimpleEmbeddingLayer I0423 04:03:36.869775 140323924080384 base_runner.py:69] task.lm.emb.dtype : float32 I0423 04:03:36.869826 140323924080384 base_runner.py:69] task.lm.emb.embedding_dim : 2048 I0423 04:03:36.869877 140323924080384 base_runner.py:69] task.lm.emb.fprop_dtype : NoneType I0423 04:03:36.869927 140323924080384 base_runner.py:69] task.lm.emb.fprop_mode : NoneType I0423 04:03:36.869978 140323924080384 base_runner.py:69] task.lm.emb.inference_driver_name : NoneType I0423 04:03:36.870029 140323924080384 base_runner.py:69] task.lm.emb.is_eval : NoneType I0423 04:03:36.870079 140323924080384 base_runner.py:69] task.lm.emb.is_inference : NoneType I0423 04:03:36.870131 140323924080384 base_runner.py:69] task.lm.emb.name : '' I0423 04:03:36.870187 140323924080384 base_runner.py:69] task.lm.emb.params_init.method : 'gaussian' I0423 04:03:36.870239 140323924080384 base_runner.py:69] task.lm.emb.params_init.scale : 0.0220970869121 I0423 04:03:36.870291 140323924080384 base_runner.py:69] task.lm.emb.params_init.seed : NoneType I0423 04:03:36.870342 140323924080384 base_runner.py:69] task.lm.emb.qdomain.default : NoneType I0423 04:03:36.870394 140323924080384 base_runner.py:69] task.lm.emb.random_seed : NoneType I0423 04:03:36.870445 140323924080384 base_runner.py:69] task.lm.emb.skip_lp_regularization : NoneType I0423 04:03:36.870496 140323924080384 base_runner.py:69] task.lm.emb.use_3d_weight_tensor : False I0423 04:03:36.870548 140323924080384 base_runner.py:69] task.lm.emb.use_matmul : False I0423 04:03:36.870599 140323924080384 base_runner.py:69] task.lm.emb.vn.global_vn : False I0423 04:03:36.870650 140323924080384 base_runner.py:69] task.lm.emb.vn.per_step_vn : False I0423 04:03:36.870701 140323924080384 base_runner.py:69] task.lm.emb.vn.scale : NoneType I0423 04:03:36.870752 140323924080384 base_runner.py:69] task.lm.emb.vn.seed : NoneType I0423 04:03:36.870803 140323924080384 base_runner.py:69] task.lm.emb.vocab_size : 32000 I0423 04:03:36.870855 140323924080384 base_runner.py:69] task.lm.fprop_dtype : NoneType I0423 04:03:36.870920 140323924080384 base_runner.py:69] task.lm.inference_driver_name : NoneType I0423 04:03:36.870974 140323924080384 base_runner.py:69] task.lm.input_dropout_prob : 0.0 I0423 04:03:36.871025 140323924080384 base_runner.py:69] task.lm.is_eval : NoneType I0423 04:03:36.871076 140323924080384 base_runner.py:69] task.lm.is_inference : NoneType I0423 04:03:36.871126 140323924080384 base_runner.py:69] task.lm.label_smoother : NoneType I0423 04:03:36.871177 140323924080384 base_runner.py:69] task.lm.model_dim : 2048 I0423 04:03:36.871229 140323924080384 base_runner.py:69] task.lm.name : 'transformerlm' I0423 04:03:36.871279 140323924080384 base_runner.py:69] task.lm.params_init.method : 'xavier' I0423 04:03:36.871330 140323924080384 base_runner.py:69] task.lm.params_init.scale : 1.000001 I0423 04:03:36.871381 140323924080384 base_runner.py:69] task.lm.params_init.seed : NoneType I0423 04:03:36.871433 140323924080384 base_runner.py:69] task.lm.position_emb.allow_implicit_capture : NoneType I0423 04:03:36.871484 140323924080384 base_runner.py:69] task.lm.position_emb.cls : type/lingvo.core.layers/PositionalEmbeddingLayer I0423 04:03:36.871537 140323924080384 base_runner.py:69] task.lm.position_emb.dtype : float32 I0423 04:03:36.871588 140323924080384 base_runner.py:69] task.lm.position_emb.embedding_dim : 2048 I0423 04:03:36.871640 140323924080384 base_runner.py:69] task.lm.position_emb.fprop_dtype : NoneType I0423 04:03:36.871691 140323924080384 base_runner.py:69] task.lm.position_emb.inference_driver_name : NoneType I0423 04:03:36.871743 140323924080384 base_runner.py:69] task.lm.position_emb.is_eval : NoneType I0423 04:03:36.871795 140323924080384 base_runner.py:69] task.lm.position_emb.is_inference : NoneType I0423 04:03:36.871848 140323924080384 base_runner.py:69] task.lm.position_emb.max_timescale : 10000 I0423 04:03:36.871900 140323924080384 base_runner.py:69] task.lm.position_emb.min_timescale : 1 I0423 04:03:36.871952 140323924080384 base_runner.py:69] task.lm.position_emb.name : '' I0423 04:03:36.872003 140323924080384 base_runner.py:69] task.lm.position_emb.params_init.method : 'xavier' I0423 04:03:36.872054 140323924080384 base_runner.py:69] task.lm.position_emb.params_init.scale : 1.000001 I0423 04:03:36.872106 140323924080384 base_runner.py:69] task.lm.position_emb.params_init.seed : NoneType I0423 04:03:36.872157 140323924080384 base_runner.py:69] task.lm.position_emb.random_seed : NoneType I0423 04:03:36.872209 140323924080384 base_runner.py:69] task.lm.position_emb.skip_lp_regularization : NoneType I0423 04:03:36.872261 140323924080384 base_runner.py:69] task.lm.position_emb.trainable_scaling : False I0423 04:03:36.872313 140323924080384 base_runner.py:69] task.lm.position_emb.trainable_scaling_init : 1.0 I0423 04:03:36.872371 140323924080384 base_runner.py:69] task.lm.position_emb.vn.global_vn : False I0423 04:03:36.872425 140323924080384 base_runner.py:69] task.lm.position_emb.vn.per_step_vn : False I0423 04:03:36.872476 140323924080384 base_runner.py:69] task.lm.position_emb.vn.scale : NoneType I0423 04:03:36.872528 140323924080384 base_runner.py:69] task.lm.position_emb.vn.seed : NoneType I0423 04:03:36.872579 140323924080384 base_runner.py:69] task.lm.random_seed : NoneType I0423 04:03:36.872631 140323924080384 base_runner.py:69] task.lm.relu_dropout_prob : 0.0 I0423 04:03:36.872682 140323924080384 base_runner.py:69] task.lm.residual_dropout_prob : 0.1 I0423 04:03:36.872733 140323924080384 base_runner.py:69] task.lm.skip_lp_regularization : NoneType I0423 04:03:36.872785 140323924080384 base_runner.py:69] task.lm.softmax.allow_implicit_capture : NoneType I0423 04:03:36.872836 140323924080384 base_runner.py:69] task.lm.softmax.apply_pruning : False I0423 04:03:36.872888 140323924080384 base_runner.py:69] task.lm.softmax.chunk_size : 4194 I0423 04:03:36.872940 140323924080384 base_runner.py:69] task.lm.softmax.cls : type/lingvo.core.layers/SimpleFullSoftmax I0423 04:03:36.872991 140323924080384 base_runner.py:69] task.lm.softmax.dtype : float32 I0423 04:03:36.873043 140323924080384 base_runner.py:69] task.lm.softmax.fprop_dtype : NoneType I0423 04:03:36.873095 140323924080384 base_runner.py:69] task.lm.softmax.inference_driver_name : NoneType I0423 04:03:36.873147 140323924080384 base_runner.py:69] task.lm.softmax.input_dim : 0 I0423 04:03:36.873198 140323924080384 base_runner.py:69] task.lm.softmax.is_eval : NoneType I0423 04:03:36.873250 140323924080384 base_runner.py:69] task.lm.softmax.is_inference : NoneType I0423 04:03:36.873301 140323924080384 base_runner.py:69] task.lm.softmax.logits_abs_max : NoneType I0423 04:03:36.873353 140323924080384 base_runner.py:69] task.lm.softmax.name : '' I0423 04:03:36.873404 140323924080384 base_runner.py:69] task.lm.softmax.num_classes : 32000 I0423 04:03:36.873456 140323924080384 base_runner.py:69] task.lm.softmax.num_sampled : 0 I0423 04:03:36.873507 140323924080384 base_runner.py:69] task.lm.softmax.num_shards : 16 I0423 04:03:36.873562 140323924080384 base_runner.py:69] task.lm.softmax.params_init.method : 'xavier' I0423 04:03:36.873614 140323924080384 base_runner.py:69] task.lm.softmax.params_init.scale : 1.000001 I0423 04:03:36.873665 140323924080384 base_runner.py:69] task.lm.softmax.params_init.seed : NoneType I0423 04:03:36.873717 140323924080384 base_runner.py:69] task.lm.softmax.qdomain.default : NoneType I0423 04:03:36.873769 140323924080384 base_runner.py:69] task.lm.softmax.random_seed : NoneType I0423 04:03:36.873821 140323924080384 base_runner.py:69] task.lm.softmax.skip_lp_regularization : NoneType I0423 04:03:36.873872 140323924080384 base_runner.py:69] task.lm.softmax.vn.global_vn : False I0423 04:03:36.873924 140323924080384 base_runner.py:69] task.lm.softmax.vn.per_step_vn : False I0423 04:03:36.873975 140323924080384 base_runner.py:69] task.lm.softmax.vn.scale : NoneType I0423 04:03:36.874027 140323924080384 base_runner.py:69] task.lm.softmax.vn.seed : NoneType I0423 04:03:36.874079 140323924080384 base_runner.py:69] task.lm.stack.allow_implicit_capture : NoneType I0423 04:03:36.874130 140323924080384 base_runner.py:69] task.lm.stack.apply_dropout_every_n : 1 I0423 04:03:36.874182 140323924080384 base_runner.py:69] task.lm.stack.batch_dim : 1 I0423 04:03:36.874233 140323924080384 base_runner.py:69] task.lm.stack.cls : type/lingvo.core.layers_with_gpipe/GPipeTransformerStack I0423 04:03:36.874285 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.allow_implicit_capture : NoneType I0423 04:03:36.874337 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.cls : type/lingvo.core.layers_with_gpipe/GPipeTransformerLayer I0423 04:03:36.874389 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.dtype : float32 I0423 04:03:36.874440 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.fprop_dtype : NoneType I0423 04:03:36.874496 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.has_aux_atten : True I0423 04:03:36.874548 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.inference_driver_name : NoneType I0423 04:03:36.874600 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.is_decoder : False I0423 04:03:36.874653 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.is_eval : NoneType I0423 04:03:36.874705 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.is_inference : NoneType I0423 04:03:36.874756 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.is_transparent : False I0423 04:03:36.874808 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.mask_self_atten : True I0423 04:03:36.874860 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.name : '' I0423 04:03:36.874918 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.num_transparent_outputs : 0 I0423 04:03:36.874970 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.output_dim : 0 I0423 04:03:36.875022 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.packed_input : False I0423 04:03:36.875075 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.params_init.method : 'xavier' I0423 04:03:36.875127 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.params_init.scale : 1.000001 I0423 04:03:36.875178 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.params_init.seed : NoneType I0423 04:03:36.875230 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.random_seed : NoneType I0423 04:03:36.875281 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.skip_lp_regularization : NoneType I0423 04:03:36.875333 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.source_dim : 0 I0423 04:03:36.875385 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.add_unnormalized_input : False I0423 04:03:36.875436 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.allow_implicit_capture : NoneType I0423 04:03:36.875488 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_dropout_prob : 0.0 I0423 04:03:36.875540 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_hidden_dim : 0 I0423 04:03:36.875591 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.allow_implicit_capture : NoneType I0423 04:03:36.875643 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.atten_dropout_deterministic : False I0423 04:03:36.875694 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.atten_dropout_prob : 0.0 I0423 04:03:36.875746 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.cls : type/lingvo.core.attention/MultiHeadedAttention I0423 04:03:36.875797 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.context_dim : 0 I0423 04:03:36.875849 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.ctx_post_proj_dim : 0 I0423 04:03:36.875900 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.dtype : float32 I0423 04:03:36.875952 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.enable_ctx_post_proj : True I0423 04:03:36.876003 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.enable_ctx_pre_proj : False I0423 04:03:36.876055 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.enable_query_proj : True I0423 04:03:36.876106 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.enable_source_proj : True I0423 04:03:36.876157 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.fprop_dtype : NoneType I0423 04:03:36.876209 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.hidden_dim : 0 I0423 04:03:36.876260 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inference_driver_name : NoneType I0423 04:03:36.876317 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.allow_implicit_capture : NoneType I0423 04:03:36.876369 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.atten_dropout_deterministic : False I0423 04:03:36.876421 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.atten_dropout_prob : 0.0 I0423 04:03:36.876473 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.cls : type/lingvo.core.attention/DotProductAttention I0423 04:03:36.876526 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.dtype : float32 I0423 04:03:36.876578 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.fprop_dtype : NoneType I0423 04:03:36.876630 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.hidden_dim : 0 I0423 04:03:36.876682 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.inference_driver_name : NoneType I0423 04:03:36.876733 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.is_eval : NoneType I0423 04:03:36.876785 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.is_inference : NoneType I0423 04:03:36.876837 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.name : '' I0423 04:03:36.876889 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.packed_input : False I0423 04:03:36.876941 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.method : 'xavier' I0423 04:03:36.876993 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.scale : 1.000001 I0423 04:03:36.877044 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.seed : NoneType I0423 04:03:36.877096 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.default : NoneType I0423 04:03:36.877149 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.fullyconnected : NoneType I0423 04:03:36.877201 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.softmax : NoneType I0423 04:03:36.877253 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.query_dim : 0 I0423 04:03:36.877305 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.random_seed : NoneType I0423 04:03:36.877357 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.skip_lp_regularization : NoneType I0423 04:03:36.877408 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.source_dim : 0 I0423 04:03:36.877460 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.global_vn : False I0423 04:03:36.877512 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.per_step_vn : False I0423 04:03:36.877563 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.scale : NoneType I0423 04:03:36.877615 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.seed : NoneType I0423 04:03:36.877667 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.is_eval : NoneType I0423 04:03:36.877722 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.is_inference : NoneType I0423 04:03:36.877775 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.name : '' I0423 04:03:36.877827 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.num_attention_heads : 2 I0423 04:03:36.877878 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.packed_input : False I0423 04:03:36.877931 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.params_init.method : 'xavier' I0423 04:03:36.877983 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.params_init.scale : 1.0 I0423 04:03:36.878036 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.params_init.seed : NoneType I0423 04:03:36.878087 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.qdomain.atten_context : NoneType I0423 04:03:36.878139 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.qdomain.default : NoneType I0423 04:03:36.878190 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.qdomain.fullyconnected : NoneType I0423 04:03:36.878242 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.qdomain.softmax : NoneType I0423 04:03:36.878293 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.query_dim : 0 I0423 04:03:36.878345 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.random_seed : NoneType I0423 04:03:36.878397 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.skip_lp_regularization : NoneType I0423 04:03:36.878448 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.source_dim : 0 I0423 04:03:36.878500 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.use_source_vec_as_attention_value : False I0423 04:03:36.878552 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.vn.global_vn : False I0423 04:03:36.878603 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.vn.per_step_vn : False I0423 04:03:36.878655 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.vn.scale : NoneType I0423 04:03:36.878707 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.atten_tpl.vn.seed : NoneType I0423 04:03:36.878760 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.cls : type/lingvo.core.layers_with_attention/TransformerAttentionLayer I0423 04:03:36.878813 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.dtype : float32 I0423 04:03:36.878865 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.fprop_dtype : NoneType I0423 04:03:36.878925 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.inference_driver_name : NoneType I0423 04:03:36.878978 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.is_eval : NoneType I0423 04:03:36.879029 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.is_inference : NoneType I0423 04:03:36.879081 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.is_masked : False I0423 04:03:36.879132 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.allow_implicit_capture : NoneType I0423 04:03:36.879184 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.cls : type/lingvo.core.layers/LayerNorm I0423 04:03:36.879236 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.dtype : float32 I0423 04:03:36.879288 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.epsilon : 1e-06 I0423 04:03:36.879339 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.fprop_dtype : NoneType I0423 04:03:36.879395 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.inference_driver_name : NoneType I0423 04:03:36.879448 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.input_dim : 0 I0423 04:03:36.879501 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.is_eval : NoneType I0423 04:03:36.879551 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.is_inference : NoneType I0423 04:03:36.879604 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.name : '' I0423 04:03:36.879654 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.params_init.method : 'xavier' I0423 04:03:36.879705 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.params_init.scale : 1.000001 I0423 04:03:36.879757 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.params_init.seed : NoneType I0423 04:03:36.879810 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.random_seed : NoneType I0423 04:03:36.879861 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.skip_lp_regularization : NoneType I0423 04:03:36.879913 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.vn.global_vn : False I0423 04:03:36.879965 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.vn.per_step_vn : False I0423 04:03:36.880017 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.vn.scale : NoneType I0423 04:03:36.880068 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.ln_tpl.vn.seed : NoneType I0423 04:03:36.880120 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.name : '' I0423 04:03:36.880172 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.num_attention_heads : 8 I0423 04:03:36.880223 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.packed_input : False I0423 04:03:36.880275 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.params_init.method : 'xavier' I0423 04:03:36.880327 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.params_init.scale : 1.000001 I0423 04:03:36.880379 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.params_init.seed : NoneType I0423 04:03:36.880431 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.random_seed : NoneType I0423 04:03:36.880484 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_prob : 0.0 I0423 04:03:36.880536 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:36.880588 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:36.880640 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.dropout_at_eval : False I0423 04:03:36.880692 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.dtype : float32 I0423 04:03:36.880743 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.fprop_dtype : NoneType I0423 04:03:36.880795 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.inference_driver_name : NoneType I0423 04:03:36.880846 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.is_eval : NoneType I0423 04:03:36.880898 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.is_inference : NoneType I0423 04:03:36.880949 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.keep_prob : 1.0 I0423 04:03:36.881001 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.name : '' I0423 04:03:36.881057 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.noise_shape : NoneType I0423 04:03:36.881108 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:36.881160 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.method : 'xavier' I0423 04:03:36.881212 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.scale : 1.000001 I0423 04:03:36.881263 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.seed : NoneType I0423 04:03:36.881314 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.random_seed : NoneType I0423 04:03:36.881366 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:36.881418 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.global_vn : False I0423 04:03:36.881469 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.per_step_vn : False I0423 04:03:36.881521 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.scale : NoneType I0423 04:03:36.881572 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.seed : NoneType I0423 04:03:36.881624 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.skip_lp_regularization : NoneType I0423 04:03:36.881675 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.source_dim : 0 I0423 04:03:36.881727 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.vn.global_vn : False I0423 04:03:36.881778 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.vn.per_step_vn : False I0423 04:03:36.881830 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.vn.scale : NoneType I0423 04:03:36.881881 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_atten_tpl.vn.seed : NoneType I0423 04:03:36.881933 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_aux_atten_tpl : NoneType I0423 04:03:36.881984 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.activation : 'RELU' I0423 04:03:36.882036 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.allow_implicit_capture : NoneType I0423 04:03:36.882087 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.cls : type/lingvo.core.layers_with_attention/TransformerFeedForwardLayer I0423 04:03:36.882139 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.dtype : float32 I0423 04:03:36.882191 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.activation : ['RELU', 'NONE'] I0423 04:03:36.882244 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.allow_implicit_capture : NoneType I0423 04:03:36.882294 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.batch_norm : False I0423 04:03:36.882347 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.bn_fold_weights : NoneType I0423 04:03:36.882397 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.cls : type/lingvo.core.layers/FeedForwardNet I0423 04:03:36.882448 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.allow_implicit_capture : NoneType I0423 04:03:36.882500 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:36.882551 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.dropout_at_eval : False I0423 04:03:36.882606 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.dtype : float32 I0423 04:03:36.882659 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.fprop_dtype : NoneType I0423 04:03:36.882711 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.inference_driver_name : NoneType I0423 04:03:36.882764 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.is_eval : NoneType I0423 04:03:36.882814 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.is_inference : NoneType I0423 04:03:36.882867 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.keep_prob : 1.0 I0423 04:03:36.882925 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.name : '' I0423 04:03:36.882977 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.noise_shape : NoneType I0423 04:03:36.883028 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.noise_shape_broadcast_dims : NoneType I0423 04:03:36.883081 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.method : 'xavier' I0423 04:03:36.883132 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.scale : 1.000001 I0423 04:03:36.883184 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.seed : NoneType I0423 04:03:36.883236 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.random_seed : NoneType I0423 04:03:36.883289 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.skip_lp_regularization : NoneType I0423 04:03:36.883341 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.global_vn : False I0423 04:03:36.883392 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.per_step_vn : False I0423 04:03:36.883444 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.scale : NoneType I0423 04:03:36.883496 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.seed : NoneType I0423 04:03:36.883548 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.dtype : float32 I0423 04:03:36.883599 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.fprop_dtype : NoneType I0423 04:03:36.883651 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.inference_driver_name : NoneType I0423 04:03:36.883702 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.input_dim : 0 I0423 04:03:36.883754 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.is_eval : NoneType I0423 04:03:36.883806 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.is_inference : NoneType I0423 04:03:36.883858 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.name : '' I0423 04:03:36.883909 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.method : 'xavier' I0423 04:03:36.883961 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.scale : 1.000001 I0423 04:03:36.884015 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.seed : NoneType I0423 04:03:36.884067 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.qdomain.default : NoneType I0423 04:03:36.884121 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.random_seed : NoneType I0423 04:03:36.884175 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.skip_connections : NoneType I0423 04:03:36.884227 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.skip_lp_regularization : NoneType I0423 04:03:36.884279 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.global_vn : False I0423 04:03:36.884331 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.per_step_vn : False I0423 04:03:36.884383 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.scale : NoneType I0423 04:03:36.884435 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.seed : NoneType I0423 04:03:36.884486 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.fprop_dtype : NoneType I0423 04:03:36.884538 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.hidden_dim : 2048 I0423 04:03:36.884589 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.inference_driver_name : NoneType I0423 04:03:36.884643 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.input_dim : 0 I0423 04:03:36.884694 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.is_eval : NoneType I0423 04:03:36.884744 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.is_inference : NoneType I0423 04:03:36.884797 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.allow_implicit_capture : NoneType I0423 04:03:36.884848 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.cls : type/lingvo.core.layers/LayerNorm I0423 04:03:36.884900 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.dtype : float32 I0423 04:03:36.884951 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.epsilon : 1e-06 I0423 04:03:36.885001 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.fprop_dtype : NoneType I0423 04:03:36.885054 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.inference_driver_name : NoneType I0423 04:03:36.885104 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.input_dim : 0 I0423 04:03:36.885157 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.is_eval : NoneType I0423 04:03:36.885207 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.is_inference : NoneType I0423 04:03:36.885262 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.name : '' I0423 04:03:36.885313 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.method : 'xavier' I0423 04:03:36.885365 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.scale : 1.000001 I0423 04:03:36.885416 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.seed : NoneType I0423 04:03:36.885467 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.random_seed : NoneType I0423 04:03:36.885519 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.skip_lp_regularization : NoneType I0423 04:03:36.885571 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.vn.global_vn : False I0423 04:03:36.885622 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.vn.per_step_vn : False I0423 04:03:36.885673 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.vn.scale : NoneType I0423 04:03:36.885725 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.ln_tpl.vn.seed : NoneType I0423 04:03:36.885782 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.name : '' I0423 04:03:36.885835 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.output_dim : 0 I0423 04:03:36.885886 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.params_init.method : 'xavier' I0423 04:03:36.885938 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.params_init.scale : 1.000001 I0423 04:03:36.885991 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.params_init.seed : NoneType I0423 04:03:36.886043 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.random_seed : NoneType I0423 04:03:36.886095 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.relu_dropout_prob : 0.0 I0423 04:03:36.886147 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.activation : 'RELU' I0423 04:03:36.886198 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.affine_last : False I0423 04:03:36.886250 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.allow_implicit_capture : NoneType I0423 04:03:36.886301 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.batch_norm : True I0423 04:03:36.886353 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.bias_init : 0.0 I0423 04:03:36.886404 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.bn_fold_weights : NoneType I0423 04:03:36.886482 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.cls : type/lingvo.core.layers/ProjectionLayer I0423 04:03:36.886548 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.dtype : float32 I0423 04:03:36.886605 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.fprop_dtype : NoneType I0423 04:03:36.886661 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.has_bias : False I0423 04:03:36.886715 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.inference_driver_name : NoneType I0423 04:03:36.886770 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.input_dim : 0 I0423 04:03:36.886853 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.is_eval : NoneType I0423 04:03:36.886913 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.is_inference : NoneType I0423 04:03:36.886965 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.name : '' I0423 04:03:36.887017 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.output_dim : 0 I0423 04:03:36.887068 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.method : 'xavier' I0423 04:03:36.887120 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.scale : 1.000001 I0423 04:03:36.887171 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.seed : NoneType I0423 04:03:36.887223 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.qdomain.default : NoneType I0423 04:03:36.887274 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.random_seed : NoneType I0423 04:03:36.887326 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.skip_lp_regularization : NoneType I0423 04:03:36.887377 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.global_vn : False I0423 04:03:36.887428 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.per_step_vn : False I0423 04:03:36.887484 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.scale : NoneType I0423 04:03:36.887537 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.seed : NoneType I0423 04:03:36.887588 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.res_proj_tpl.weight_norm : False I0423 04:03:36.887639 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_prob : 0.0 I0423 04:03:36.887691 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:36.887742 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:36.887794 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.dropout_at_eval : False I0423 04:03:36.887845 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.dtype : float32 I0423 04:03:36.887897 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.fprop_dtype : NoneType I0423 04:03:36.887948 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.inference_driver_name : NoneType I0423 04:03:36.888000 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.is_eval : NoneType I0423 04:03:36.888052 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.is_inference : NoneType I0423 04:03:36.888104 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.keep_prob : 1.0 I0423 04:03:36.888155 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.name : '' I0423 04:03:36.888207 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.noise_shape : NoneType I0423 04:03:36.888258 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:36.888310 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.method : 'xavier' I0423 04:03:36.888361 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.scale : 1.000001 I0423 04:03:36.888412 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.seed : NoneType I0423 04:03:36.888464 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.random_seed : NoneType I0423 04:03:36.888515 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:36.888566 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.global_vn : False I0423 04:03:36.888617 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.per_step_vn : False I0423 04:03:36.888669 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.scale : NoneType I0423 04:03:36.888720 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.seed : NoneType I0423 04:03:36.888772 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.skip_lp_regularization : NoneType I0423 04:03:36.888823 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.vn.global_vn : False I0423 04:03:36.888875 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.vn.per_step_vn : False I0423 04:03:36.888926 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.vn.scale : NoneType I0423 04:03:36.888978 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.tr_fflayer_tpl.vn.seed : NoneType I0423 04:03:36.889034 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.transparent_merger_tpl : NoneType I0423 04:03:36.889086 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.vn.global_vn : False I0423 04:03:36.889137 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.vn.per_step_vn : False I0423 04:03:36.889189 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.vn.scale : NoneType I0423 04:03:36.889240 140323924080384 base_runner.py:69] task.lm.stack.decoder_tpl.vn.seed : NoneType I0423 04:03:36.889292 140323924080384 base_runner.py:69] task.lm.stack.dtype : float32 I0423 04:03:36.889343 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.add_tgt_embedding_layer : False I0423 04:03:36.889394 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.allow_implicit_capture : NoneType I0423 04:03:36.889446 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.cls : type/lingvo.core.layers_with_gpipe/GPipeTransformerEmbeddingLayer I0423 04:03:36.889497 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:36.889549 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:36.889600 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.dropout_at_eval : False I0423 04:03:36.889652 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.dtype : float32 I0423 04:03:36.889703 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.fprop_dtype : NoneType I0423 04:03:36.889755 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.inference_driver_name : NoneType I0423 04:03:36.889807 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.is_eval : NoneType I0423 04:03:36.889858 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.is_inference : NoneType I0423 04:03:36.889909 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.keep_prob : 1.0 I0423 04:03:36.889961 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.name : '' I0423 04:03:36.890012 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.noise_shape : NoneType I0423 04:03:36.890064 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:36.890115 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.params_init.method : 'xavier' I0423 04:03:36.890166 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.params_init.scale : 1.000001 I0423 04:03:36.890218 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.params_init.seed : NoneType I0423 04:03:36.890268 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.random_seed : NoneType I0423 04:03:36.890320 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:36.890371 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.vn.global_vn : False I0423 04:03:36.890423 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.vn.per_step_vn : False I0423 04:03:36.890474 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.vn.scale : NoneType I0423 04:03:36.890525 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dropout_tpl.vn.seed : NoneType I0423 04:03:36.890575 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.dtype : float32 I0423 04:03:36.890628 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.fprop_dtype : NoneType I0423 04:03:36.890678 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.inference_driver_name : NoneType I0423 04:03:36.890729 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.input_dropout_prob : 0.0 I0423 04:03:36.890780 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.is_eval : NoneType I0423 04:03:36.890831 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.is_inference : NoneType I0423 04:03:36.890899 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.is_transparent : False I0423 04:03:36.890954 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.max_seq_len : 300 I0423 04:03:36.891005 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.name : '' I0423 04:03:36.891057 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.packed_input : False I0423 04:03:36.891108 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.params_init.method : 'xavier' I0423 04:03:36.891160 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.params_init.scale : 1.000001 I0423 04:03:36.891211 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.params_init.seed : NoneType I0423 04:03:36.891263 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.allow_implicit_capture : NoneType I0423 04:03:36.891314 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.cls : type/lingvo.core.layers/PositionalEmbeddingLayer I0423 04:03:36.891366 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.dtype : float32 I0423 04:03:36.891417 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.embedding_dim : 0 I0423 04:03:36.891469 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.fprop_dtype : NoneType I0423 04:03:36.891520 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.inference_driver_name : NoneType I0423 04:03:36.891571 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.is_eval : NoneType I0423 04:03:36.891622 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.is_inference : NoneType I0423 04:03:36.891673 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.max_timescale : 10000 I0423 04:03:36.891724 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.min_timescale : 1 I0423 04:03:36.891776 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.name : '' I0423 04:03:36.891827 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.params_init.method : 'xavier' I0423 04:03:36.891877 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.params_init.scale : 1.000001 I0423 04:03:36.891928 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.params_init.seed : NoneType I0423 04:03:36.891979 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.random_seed : NoneType I0423 04:03:36.892031 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.skip_lp_regularization : NoneType I0423 04:03:36.892082 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.trainable_scaling : False I0423 04:03:36.892133 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.trainable_scaling_init : 1.0 I0423 04:03:36.892184 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.vn.global_vn : False I0423 04:03:36.892236 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.vn.per_step_vn : False I0423 04:03:36.892287 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.vn.scale : NoneType I0423 04:03:36.892339 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.position_emb.vn.seed : NoneType I0423 04:03:36.892390 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.random_seed : NoneType I0423 04:03:36.892442 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.skip_lp_regularization : NoneType I0423 04:03:36.892493 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.allow_implicit_capture : NoneType I0423 04:03:36.892544 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.apply_pruning : False I0423 04:03:36.892595 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.cls : type/lingvo.core.layers/SimpleEmbeddingLayer I0423 04:03:36.892647 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.dtype : float32 I0423 04:03:36.892698 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.embedding_dim : 0 I0423 04:03:36.892751 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.fprop_dtype : NoneType I0423 04:03:36.892803 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.fprop_mode : NoneType I0423 04:03:36.892855 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.inference_driver_name : NoneType I0423 04:03:36.892906 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.is_eval : NoneType I0423 04:03:36.892957 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.is_inference : NoneType I0423 04:03:36.893008 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.name : '' I0423 04:03:36.893059 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.params_init.method : 'xavier' I0423 04:03:36.893111 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.params_init.scale : 1.000001 I0423 04:03:36.893162 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.params_init.seed : NoneType I0423 04:03:36.893213 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.qdomain.default : NoneType I0423 04:03:36.893265 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.random_seed : NoneType I0423 04:03:36.893316 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.skip_lp_regularization : NoneType I0423 04:03:36.893367 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.use_3d_weight_tensor : False I0423 04:03:36.893418 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.use_matmul : False I0423 04:03:36.893469 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vn.global_vn : False I0423 04:03:36.893520 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vn.per_step_vn : False I0423 04:03:36.893570 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vn.scale : NoneType I0423 04:03:36.893621 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vn.seed : NoneType I0423 04:03:36.893672 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.token_emb.vocab_size : 0 I0423 04:03:36.893724 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.vn.global_vn : False I0423 04:03:36.893775 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.vn.per_step_vn : False I0423 04:03:36.893826 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.vn.scale : NoneType I0423 04:03:36.893878 140323924080384 base_runner.py:69] task.lm.stack.emb_tpl.vn.seed : NoneType I0423 04:03:36.893929 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.allow_implicit_capture : NoneType I0423 04:03:36.893981 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.cls : type/lingvo.core.layers_with_gpipe/GPipeTransformerLayer I0423 04:03:36.894033 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.dtype : float32 I0423 04:03:36.894084 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.fprop_dtype : NoneType I0423 04:03:36.894135 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.has_aux_atten : False I0423 04:03:36.894186 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.inference_driver_name : NoneType I0423 04:03:36.894237 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.is_decoder : False I0423 04:03:36.894289 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.is_eval : NoneType I0423 04:03:36.894340 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.is_inference : NoneType I0423 04:03:36.894390 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.is_transparent : False I0423 04:03:36.894440 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.mask_self_atten : True I0423 04:03:36.894491 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.name : '' I0423 04:03:36.894541 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.num_transparent_outputs : 0 I0423 04:03:36.894593 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.output_dim : 0 I0423 04:03:36.894644 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.packed_input : False I0423 04:03:36.894702 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.params_init.method : 'xavier' I0423 04:03:36.894756 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.params_init.scale : 1.000001 I0423 04:03:36.894807 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.params_init.seed : NoneType I0423 04:03:36.894857 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.random_seed : NoneType I0423 04:03:36.894917 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.skip_lp_regularization : NoneType I0423 04:03:36.894968 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.source_dim : 0 I0423 04:03:36.895020 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.add_unnormalized_input : False I0423 04:03:36.895071 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.allow_implicit_capture : NoneType I0423 04:03:36.895122 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_dropout_prob : 0.0 I0423 04:03:36.895174 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_hidden_dim : 0 I0423 04:03:36.895226 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.allow_implicit_capture : NoneType I0423 04:03:36.895277 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.atten_dropout_deterministic : False I0423 04:03:36.895328 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.atten_dropout_prob : 0.0 I0423 04:03:36.895380 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.cls : type/lingvo.core.attention/MultiHeadedAttention I0423 04:03:36.895432 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.context_dim : 0 I0423 04:03:36.895484 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.ctx_post_proj_dim : 0 I0423 04:03:36.895535 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.dtype : float32 I0423 04:03:36.895587 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.enable_ctx_post_proj : True I0423 04:03:36.895639 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.enable_ctx_pre_proj : True I0423 04:03:36.895692 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.enable_query_proj : True I0423 04:03:36.895744 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.enable_source_proj : True I0423 04:03:36.895795 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.fprop_dtype : NoneType I0423 04:03:36.895847 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.hidden_dim : 0 I0423 04:03:36.895899 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inference_driver_name : NoneType I0423 04:03:36.895950 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.allow_implicit_capture : NoneType I0423 04:03:36.896002 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.atten_dropout_deterministic : False I0423 04:03:36.896054 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.atten_dropout_prob : 0.0 I0423 04:03:36.896105 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.cls : type/lingvo.core.attention/DotProductAttention I0423 04:03:36.896157 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.dtype : float32 I0423 04:03:36.896209 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.fprop_dtype : NoneType I0423 04:03:36.896260 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.hidden_dim : 0 I0423 04:03:36.896316 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.inference_driver_name : NoneType I0423 04:03:36.896368 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.is_eval : NoneType I0423 04:03:36.896420 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.is_inference : NoneType I0423 04:03:36.896471 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.name : '' I0423 04:03:36.896522 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.packed_input : False I0423 04:03:36.896574 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.method : 'xavier' I0423 04:03:36.896625 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.scale : 1.000001 I0423 04:03:36.896677 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.params_init.seed : NoneType I0423 04:03:36.896728 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.default : NoneType I0423 04:03:36.896780 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.fullyconnected : NoneType I0423 04:03:36.896831 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.qdomain.softmax : NoneType I0423 04:03:36.896882 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.query_dim : 0 I0423 04:03:36.896933 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.random_seed : NoneType I0423 04:03:36.896984 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.skip_lp_regularization : NoneType I0423 04:03:36.897034 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.source_dim : 0 I0423 04:03:36.897084 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.global_vn : False I0423 04:03:36.897136 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.per_step_vn : False I0423 04:03:36.897187 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.scale : NoneType I0423 04:03:36.897239 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.inner_atten_params.vn.seed : NoneType I0423 04:03:36.897289 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.is_eval : NoneType I0423 04:03:36.897345 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.is_inference : NoneType I0423 04:03:36.897396 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.name : '' I0423 04:03:36.897447 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.num_attention_heads : 2 I0423 04:03:36.897497 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.packed_input : False I0423 04:03:36.897548 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.params_init.method : 'xavier' I0423 04:03:36.897599 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.params_init.scale : 1.0 I0423 04:03:36.897650 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.params_init.seed : NoneType I0423 04:03:36.897702 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.qdomain.atten_context : NoneType I0423 04:03:36.897753 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.qdomain.default : NoneType I0423 04:03:36.897810 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.qdomain.fullyconnected : NoneType I0423 04:03:36.897862 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.qdomain.softmax : NoneType I0423 04:03:36.897914 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.query_dim : 0 I0423 04:03:36.897965 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.random_seed : NoneType I0423 04:03:36.898017 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.skip_lp_regularization : NoneType I0423 04:03:36.898068 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.source_dim : 0 I0423 04:03:36.898119 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.use_source_vec_as_attention_value : False I0423 04:03:36.898170 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.vn.global_vn : False I0423 04:03:36.898221 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.vn.per_step_vn : False I0423 04:03:36.898272 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.vn.scale : NoneType I0423 04:03:36.898324 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.atten_tpl.vn.seed : NoneType I0423 04:03:36.898375 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.cls : type/lingvo.core.layers_with_attention/TransformerAttentionLayer I0423 04:03:36.898427 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.dtype : float32 I0423 04:03:36.898478 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.fprop_dtype : NoneType I0423 04:03:36.898530 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.inference_driver_name : NoneType I0423 04:03:36.898581 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.is_eval : NoneType I0423 04:03:36.898633 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.is_inference : NoneType I0423 04:03:36.898684 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.is_masked : True I0423 04:03:36.898735 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.allow_implicit_capture : NoneType I0423 04:03:36.898786 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.cls : type/lingvo.core.layers/LayerNorm I0423 04:03:36.898837 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.dtype : float32 I0423 04:03:36.898894 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.epsilon : 1e-06 I0423 04:03:36.898947 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.fprop_dtype : NoneType I0423 04:03:36.899015 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.inference_driver_name : NoneType I0423 04:03:36.899070 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.input_dim : 0 I0423 04:03:36.899123 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.is_eval : NoneType I0423 04:03:36.899178 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.is_inference : NoneType I0423 04:03:36.899245 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.name : '' I0423 04:03:36.899296 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.params_init.method : 'xavier' I0423 04:03:36.899348 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.params_init.scale : 1.000001 I0423 04:03:36.899399 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.params_init.seed : NoneType I0423 04:03:36.899451 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.random_seed : NoneType I0423 04:03:36.899507 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.skip_lp_regularization : NoneType I0423 04:03:36.899559 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.vn.global_vn : False I0423 04:03:36.899610 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.vn.per_step_vn : False I0423 04:03:36.899662 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.vn.scale : NoneType I0423 04:03:36.899713 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.ln_tpl.vn.seed : NoneType I0423 04:03:36.899765 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.name : '' I0423 04:03:36.899816 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.num_attention_heads : 16 I0423 04:03:36.899868 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.packed_input : False I0423 04:03:36.899919 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.params_init.method : 'xavier' I0423 04:03:36.899971 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.params_init.scale : 1.000001 I0423 04:03:36.900023 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.params_init.seed : NoneType I0423 04:03:36.900075 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.random_seed : NoneType I0423 04:03:36.900127 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_prob : 0.0 I0423 04:03:36.900180 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:36.900232 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:36.900284 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.dropout_at_eval : False I0423 04:03:36.900336 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.dtype : float32 I0423 04:03:36.900388 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.fprop_dtype : NoneType I0423 04:03:36.900439 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.inference_driver_name : NoneType I0423 04:03:36.900490 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.is_eval : NoneType I0423 04:03:36.900542 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.is_inference : NoneType I0423 04:03:36.900593 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.keep_prob : 1.0 I0423 04:03:36.900645 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.name : '' I0423 04:03:36.900696 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.noise_shape : NoneType I0423 04:03:36.900749 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:36.900801 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.method : 'xavier' I0423 04:03:36.900854 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.scale : 1.000001 I0423 04:03:36.900904 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.params_init.seed : NoneType I0423 04:03:36.900957 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.random_seed : NoneType I0423 04:03:36.901009 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:36.901067 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.global_vn : False I0423 04:03:36.901118 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.per_step_vn : False I0423 04:03:36.901170 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.scale : NoneType I0423 04:03:36.901222 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.residual_dropout_tpl.vn.seed : NoneType I0423 04:03:36.901273 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.skip_lp_regularization : NoneType I0423 04:03:36.901325 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.source_dim : 0 I0423 04:03:36.901376 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.vn.global_vn : False I0423 04:03:36.901428 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.vn.per_step_vn : False I0423 04:03:36.901480 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.vn.scale : NoneType I0423 04:03:36.901534 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_atten_tpl.vn.seed : NoneType I0423 04:03:36.901586 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_aux_atten_tpl : NoneType I0423 04:03:36.901638 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.activation : 'RELU' I0423 04:03:36.901689 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.allow_implicit_capture : NoneType I0423 04:03:36.901741 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.cls : type/lingvo.core.layers_with_attention/TransformerFeedForwardLayer I0423 04:03:36.901793 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.dtype : float32 I0423 04:03:36.901844 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.activation : ['RELU', 'NONE'] I0423 04:03:36.901895 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.allow_implicit_capture : NoneType I0423 04:03:36.901947 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.batch_norm : False I0423 04:03:36.901999 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.bn_fold_weights : NoneType I0423 04:03:36.902051 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.cls : type/lingvo.core.layers/FeedForwardNet I0423 04:03:36.902102 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.allow_implicit_capture : NoneType I0423 04:03:36.902153 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:36.902205 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.dropout_at_eval : False I0423 04:03:36.902257 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.dtype : float32 I0423 04:03:36.902309 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.fprop_dtype : NoneType I0423 04:03:36.902360 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.inference_driver_name : NoneType I0423 04:03:36.902412 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.is_eval : NoneType I0423 04:03:36.902463 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.is_inference : NoneType I0423 04:03:36.902515 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.keep_prob : 1.0 I0423 04:03:36.902568 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.name : '' I0423 04:03:36.902618 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.noise_shape : NoneType I0423 04:03:36.902673 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.noise_shape_broadcast_dims : NoneType I0423 04:03:36.902725 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.method : 'xavier' I0423 04:03:36.902777 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.scale : 1.000001 I0423 04:03:36.902828 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.params_init.seed : NoneType I0423 04:03:36.902884 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.random_seed : NoneType I0423 04:03:36.902939 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.skip_lp_regularization : NoneType I0423 04:03:36.902990 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.global_vn : False I0423 04:03:36.903042 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.per_step_vn : False I0423 04:03:36.903094 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.scale : NoneType I0423 04:03:36.903145 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dropout.vn.seed : NoneType I0423 04:03:36.903197 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.dtype : float32 I0423 04:03:36.903248 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.fprop_dtype : NoneType I0423 04:03:36.903300 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.inference_driver_name : NoneType I0423 04:03:36.903352 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.input_dim : 0 I0423 04:03:36.903403 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.is_eval : NoneType I0423 04:03:36.903455 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.is_inference : NoneType I0423 04:03:36.903506 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.name : '' I0423 04:03:36.903557 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.method : 'xavier' I0423 04:03:36.903608 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.scale : 1.000001 I0423 04:03:36.903660 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.params_init.seed : NoneType I0423 04:03:36.903711 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.qdomain.default : NoneType I0423 04:03:36.903762 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.random_seed : NoneType I0423 04:03:36.903814 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.skip_connections : NoneType I0423 04:03:36.903865 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.skip_lp_regularization : NoneType I0423 04:03:36.903915 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.global_vn : False I0423 04:03:36.903968 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.per_step_vn : False I0423 04:03:36.904019 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.scale : NoneType I0423 04:03:36.904069 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fflayer_tpl.vn.seed : NoneType I0423 04:03:36.904122 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.fprop_dtype : NoneType I0423 04:03:36.904172 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.hidden_dim : 8192 I0423 04:03:36.904227 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.inference_driver_name : NoneType I0423 04:03:36.904279 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.input_dim : 0 I0423 04:03:36.904330 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.is_eval : NoneType I0423 04:03:36.904382 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.is_inference : NoneType I0423 04:03:36.904433 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.allow_implicit_capture : NoneType I0423 04:03:36.904485 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.cls : type/lingvo.core.layers/LayerNorm I0423 04:03:36.904536 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.dtype : float32 I0423 04:03:36.904587 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.epsilon : 1e-06 I0423 04:03:36.904639 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.fprop_dtype : NoneType I0423 04:03:36.904690 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.inference_driver_name : NoneType I0423 04:03:36.904742 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.input_dim : 0 I0423 04:03:36.904793 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.is_eval : NoneType I0423 04:03:36.904845 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.is_inference : NoneType I0423 04:03:36.904896 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.name : '' I0423 04:03:36.904947 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.method : 'xavier' I0423 04:03:36.904999 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.scale : 1.000001 I0423 04:03:36.905050 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.params_init.seed : NoneType I0423 04:03:36.905101 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.random_seed : NoneType I0423 04:03:36.905152 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.skip_lp_regularization : NoneType I0423 04:03:36.905203 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.vn.global_vn : False I0423 04:03:36.905253 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.vn.per_step_vn : False I0423 04:03:36.905304 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.vn.scale : NoneType I0423 04:03:36.905356 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.ln_tpl.vn.seed : NoneType I0423 04:03:36.905407 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.name : '' I0423 04:03:36.905458 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.output_dim : 0 I0423 04:03:36.905510 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.params_init.method : 'xavier' I0423 04:03:36.905561 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.params_init.scale : 1.000001 I0423 04:03:36.905612 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.params_init.seed : NoneType I0423 04:03:36.905663 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.random_seed : NoneType I0423 04:03:36.905714 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.relu_dropout_prob : 0.0 I0423 04:03:36.905766 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.activation : 'RELU' I0423 04:03:36.905817 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.affine_last : False I0423 04:03:36.905872 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.allow_implicit_capture : NoneType I0423 04:03:36.905924 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.batch_norm : True I0423 04:03:36.905975 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.bias_init : 0.0 I0423 04:03:36.906025 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.bn_fold_weights : NoneType I0423 04:03:36.906076 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.cls : type/lingvo.core.layers/ProjectionLayer I0423 04:03:36.906127 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.dtype : float32 I0423 04:03:36.906179 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.fprop_dtype : NoneType I0423 04:03:36.906230 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.has_bias : False I0423 04:03:36.906281 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.inference_driver_name : NoneType I0423 04:03:36.906333 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.input_dim : 0 I0423 04:03:36.906385 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.is_eval : NoneType I0423 04:03:36.906436 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.is_inference : NoneType I0423 04:03:36.906488 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.name : '' I0423 04:03:36.906539 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.output_dim : 0 I0423 04:03:36.906591 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.method : 'xavier' I0423 04:03:36.906642 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.scale : 1.000001 I0423 04:03:36.906693 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.params_init.seed : NoneType I0423 04:03:36.906744 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.qdomain.default : NoneType I0423 04:03:36.906795 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.random_seed : NoneType I0423 04:03:36.906847 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.skip_lp_regularization : NoneType I0423 04:03:36.906904 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.global_vn : False I0423 04:03:36.906956 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.per_step_vn : False I0423 04:03:36.907008 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.scale : NoneType I0423 04:03:36.907059 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.vn.seed : NoneType I0423 04:03:36.907111 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.res_proj_tpl.weight_norm : False I0423 04:03:36.907162 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_prob : 0.0 I0423 04:03:36.907215 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.allow_implicit_capture : NoneType I0423 04:03:36.907267 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.cls : type/lingvo.core.layers/DropoutLayer I0423 04:03:36.907319 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.dropout_at_eval : False I0423 04:03:36.907370 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.dtype : float32 I0423 04:03:36.907426 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.fprop_dtype : NoneType I0423 04:03:36.907478 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.inference_driver_name : NoneType I0423 04:03:36.907530 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.is_eval : NoneType I0423 04:03:36.907581 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.is_inference : NoneType I0423 04:03:36.907632 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.keep_prob : 1.0 I0423 04:03:36.907684 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.name : '' I0423 04:03:36.907736 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.noise_shape : NoneType I0423 04:03:36.907787 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.noise_shape_broadcast_dims : NoneType I0423 04:03:36.907838 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.method : 'xavier' I0423 04:03:36.907890 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.scale : 1.000001 I0423 04:03:36.907941 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.params_init.seed : NoneType I0423 04:03:36.907991 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.random_seed : NoneType I0423 04:03:36.908044 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.skip_lp_regularization : NoneType I0423 04:03:36.908094 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.global_vn : False I0423 04:03:36.908145 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.per_step_vn : False I0423 04:03:36.908196 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.scale : NoneType I0423 04:03:36.908248 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.residual_dropout_tpl.vn.seed : NoneType I0423 04:03:36.908301 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.skip_lp_regularization : NoneType I0423 04:03:36.908351 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.vn.global_vn : False I0423 04:03:36.908404 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.vn.per_step_vn : False I0423 04:03:36.908456 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.vn.scale : NoneType I0423 04:03:36.908508 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.tr_fflayer_tpl.vn.seed : NoneType I0423 04:03:36.908559 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.transparent_merger_tpl : NoneType I0423 04:03:36.908610 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.vn.global_vn : False I0423 04:03:36.908660 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.vn.per_step_vn : False I0423 04:03:36.908711 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.vn.scale : NoneType I0423 04:03:36.908762 140323924080384 base_runner.py:69] task.lm.stack.encoder_tpl.vn.seed : NoneType I0423 04:03:36.908814 140323924080384 base_runner.py:69] task.lm.stack.fprop_dtype : NoneType I0423 04:03:36.908865 140323924080384 base_runner.py:69] task.lm.stack.inference_driver_name : NoneType I0423 04:03:36.908917 140323924080384 base_runner.py:69] task.lm.stack.is_eval : NoneType I0423 04:03:36.908968 140323924080384 base_runner.py:69] task.lm.stack.is_inference : NoneType I0423 04:03:36.909020 140323924080384 base_runner.py:69] task.lm.stack.is_transparent : False I0423 04:03:36.909071 140323924080384 base_runner.py:69] task.lm.stack.model_dim : 1024 I0423 04:03:36.909127 140323924080384 base_runner.py:69] task.lm.stack.name : '' I0423 04:03:36.909179 140323924080384 base_runner.py:69] task.lm.stack.num_decoder_layers : 0 I0423 04:03:36.909231 140323924080384 base_runner.py:69] task.lm.stack.num_encoder_layers : 6 I0423 04:03:36.909282 140323924080384 base_runner.py:69] task.lm.stack.num_micro_batches : 1 I0423 04:03:36.909334 140323924080384 base_runner.py:69] task.lm.stack.num_splits : 1 I0423 04:03:36.909385 140323924080384 base_runner.py:69] task.lm.stack.num_transparent_outputs : 0 I0423 04:03:36.909436 140323924080384 base_runner.py:69] task.lm.stack.packed_input : False I0423 04:03:36.909488 140323924080384 base_runner.py:69] task.lm.stack.params_init.method : 'xavier' I0423 04:03:36.909540 140323924080384 base_runner.py:69] task.lm.stack.params_init.scale : 1.000001 I0423 04:03:36.909593 140323924080384 base_runner.py:69] task.lm.stack.params_init.seed : NoneType I0423 04:03:36.909643 140323924080384 base_runner.py:69] task.lm.stack.random_seed : NoneType I0423 04:03:36.909696 140323924080384 base_runner.py:69] task.lm.stack.skip_lp_regularization : NoneType I0423 04:03:36.909746 140323924080384 base_runner.py:69] task.lm.stack.splits : 1 I0423 04:03:36.909797 140323924080384 base_runner.py:69] task.lm.stack.state_dtype : NoneType I0423 04:03:36.909849 140323924080384 base_runner.py:69] task.lm.stack.transparent_merger_dropout_prob : 0.1 I0423 04:03:36.909900 140323924080384 base_runner.py:69] task.lm.stack.use_pipelined_embeddings : False I0423 04:03:36.909951 140323924080384 base_runner.py:69] task.lm.stack.vn.global_vn : False I0423 04:03:36.910002 140323924080384 base_runner.py:69] task.lm.stack.vn.per_step_vn : False I0423 04:03:36.910053 140323924080384 base_runner.py:69] task.lm.stack.vn.scale : NoneType I0423 04:03:36.910105 140323924080384 base_runner.py:69] task.lm.stack.vn.seed : NoneType I0423 04:03:36.910156 140323924080384 base_runner.py:69] task.lm.vn.global_vn : False I0423 04:03:36.910207 140323924080384 base_runner.py:69] task.lm.vn.per_step_vn : False I0423 04:03:36.910259 140323924080384 base_runner.py:69] task.lm.vn.scale : NoneType I0423 04:03:36.910310 140323924080384 base_runner.py:69] task.lm.vn.seed : NoneType I0423 04:03:36.910362 140323924080384 base_runner.py:69] task.lm.vocab_size : 32000 I0423 04:03:36.910413 140323924080384 base_runner.py:69] task.name : '1bwds_wpm_level_lm' I0423 04:03:36.910463 140323924080384 base_runner.py:69] task.online_encoder : NoneType I0423 04:03:36.910515 140323924080384 base_runner.py:69] task.params_init.method : 'xavier' I0423 04:03:36.910564 140323924080384 base_runner.py:69] task.params_init.scale : 1.000001 I0423 04:03:36.910618 140323924080384 base_runner.py:69] task.params_init.seed : NoneType I0423 04:03:36.910669 140323924080384 base_runner.py:69] task.random_seed : NoneType I0423 04:03:36.910720 140323924080384 base_runner.py:69] task.skip_lp_regularization : NoneType I0423 04:03:36.910770 140323924080384 base_runner.py:69] task.train.bprop_variable_filter : NoneType I0423 04:03:36.910823 140323924080384 base_runner.py:69] task.train.clip_gradient_norm_to_value : 0.0 I0423 04:03:36.910877 140323924080384 base_runner.py:69] task.train.clip_gradient_single_norm_to_value : 0.0 I0423 04:03:36.910933 140323924080384 base_runner.py:69] task.train.colocate_gradients_with_ops : True I0423 04:03:36.910984 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.jobname : 'eval_dev' I0423 04:03:36.911036 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.local_filesystem : False I0423 04:03:36.911087 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.logdir : '' I0423 04:03:36.911140 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.metric : 'log_pplx' I0423 04:03:36.911221 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.minimize : True I0423 04:03:36.911282 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.name : 'MetricHistory' I0423 04:03:36.911340 140323924080384 base_runner.py:69] task.train.early_stop.metric_history.tfevent_file : False I0423 04:03:36.911396 140323924080384 base_runner.py:69] task.train.early_stop.name : 'EarlyStop' I0423 04:03:36.911453 140323924080384 base_runner.py:69] task.train.early_stop.tolerance : 0.0 I0423 04:03:36.911535 140323924080384 base_runner.py:69] task.train.early_stop.verbose : True I0423 04:03:36.911586 140323924080384 base_runner.py:69] task.train.early_stop.window : 0 I0423 04:03:36.911638 140323924080384 base_runner.py:69] task.train.ema_decay : 0.0 I0423 04:03:36.911689 140323924080384 base_runner.py:69] task.train.gate_gradients : False I0423 04:03:36.911740 140323924080384 base_runner.py:69] task.train.grad_aggregation_method : 1 I0423 04:03:36.911792 140323924080384 base_runner.py:69] task.train.grad_norm_to_clip_to_zero : 0.0 I0423 04:03:36.911843 140323924080384 base_runner.py:69] task.train.grad_norm_tracker : NoneType I0423 04:03:36.911894 140323924080384 base_runner.py:69] task.train.init_from_checkpoint_rules : {} I0423 04:03:36.911946 140323924080384 base_runner.py:69] task.train.l1_regularizer_weight : NoneType I0423 04:03:36.911997 140323924080384 base_runner.py:69] task.train.l2_regularizer_weight : 1e-06 I0423 04:03:36.912048 140323924080384 base_runner.py:69] task.train.learning_rate : 0.5 I0423 04:03:36.912098 140323924080384 base_runner.py:69] task.train.lr_schedule.allow_implicit_capture : NoneType I0423 04:03:36.912149 140323924080384 base_runner.py:69] task.train.lr_schedule.cls : type/lingvo.core.lr_schedule/TransformerLearningRateSchedule I0423 04:03:36.912200 140323924080384 base_runner.py:69] task.train.lr_schedule.decay_end : NoneType I0423 04:03:36.912251 140323924080384 base_runner.py:69] task.train.lr_schedule.dtype : float32 I0423 04:03:36.912302 140323924080384 base_runner.py:69] task.train.lr_schedule.fprop_dtype : NoneType I0423 04:03:36.912353 140323924080384 base_runner.py:69] task.train.lr_schedule.inference_driver_name : NoneType I0423 04:03:36.912405 140323924080384 base_runner.py:69] task.train.lr_schedule.is_eval : NoneType I0423 04:03:36.912456 140323924080384 base_runner.py:69] task.train.lr_schedule.is_inference : NoneType I0423 04:03:36.912507 140323924080384 base_runner.py:69] task.train.lr_schedule.model_dim : 2048 I0423 04:03:36.912558 140323924080384 base_runner.py:69] task.train.lr_schedule.name : 'LRSched' I0423 04:03:36.912609 140323924080384 base_runner.py:69] task.train.lr_schedule.params_init.method : 'xavier' I0423 04:03:36.912661 140323924080384 base_runner.py:69] task.train.lr_schedule.params_init.scale : 1.000001 I0423 04:03:36.912712 140323924080384 base_runner.py:69] task.train.lr_schedule.params_init.seed : NoneType I0423 04:03:36.912764 140323924080384 base_runner.py:69] task.train.lr_schedule.random_seed : NoneType I0423 04:03:36.912815 140323924080384 base_runner.py:69] task.train.lr_schedule.skip_lp_regularization : NoneType I0423 04:03:36.912867 140323924080384 base_runner.py:69] task.train.lr_schedule.vn.global_vn : False I0423 04:03:36.912918 140323924080384 base_runner.py:69] task.train.lr_schedule.vn.per_step_vn : False I0423 04:03:36.912970 140323924080384 base_runner.py:69] task.train.lr_schedule.vn.scale : NoneType I0423 04:03:36.913021 140323924080384 base_runner.py:69] task.train.lr_schedule.vn.seed : NoneType I0423 04:03:36.913072 140323924080384 base_runner.py:69] task.train.lr_schedule.warmup_steps : 40000 I0423 04:03:36.913122 140323924080384 base_runner.py:69] task.train.lr_schedule.worker_replicas : 1 I0423 04:03:36.913175 140323924080384 base_runner.py:69] task.train.max_lstm_gradient_norm : 0.0 I0423 04:03:36.913225 140323924080384 base_runner.py:69] task.train.max_steps : 4000000 I0423 04:03:36.913276 140323924080384 base_runner.py:69] task.train.optimizer.allow_implicit_capture : NoneType I0423 04:03:36.913327 140323924080384 base_runner.py:69] task.train.optimizer.beta1 : 0.9 I0423 04:03:36.913378 140323924080384 base_runner.py:69] task.train.optimizer.beta2 : 0.997 I0423 04:03:36.913429 140323924080384 base_runner.py:69] task.train.optimizer.cls : type/lingvo.core.optimizer/Adam I0423 04:03:36.913486 140323924080384 base_runner.py:69] task.train.optimizer.dtype : float32 I0423 04:03:36.913538 140323924080384 base_runner.py:69] task.train.optimizer.epsilon : 1e-09 I0423 04:03:36.913590 140323924080384 base_runner.py:69] task.train.optimizer.fprop_dtype : NoneType I0423 04:03:36.913641 140323924080384 base_runner.py:69] task.train.optimizer.inference_driver_name : NoneType I0423 04:03:36.913692 140323924080384 base_runner.py:69] task.train.optimizer.is_eval : NoneType I0423 04:03:36.913743 140323924080384 base_runner.py:69] task.train.optimizer.is_inference : NoneType I0423 04:03:36.913794 140323924080384 base_runner.py:69] task.train.optimizer.name : 'Adam' I0423 04:03:36.913846 140323924080384 base_runner.py:69] task.train.optimizer.params_init.method : 'xavier' I0423 04:03:36.913897 140323924080384 base_runner.py:69] task.train.optimizer.params_init.scale : 1.000001 I0423 04:03:36.913948 140323924080384 base_runner.py:69] task.train.optimizer.params_init.seed : NoneType I0423 04:03:36.913999 140323924080384 base_runner.py:69] task.train.optimizer.random_seed : NoneType I0423 04:03:36.914050 140323924080384 base_runner.py:69] task.train.optimizer.skip_lp_regularization : NoneType I0423 04:03:36.914102 140323924080384 base_runner.py:69] task.train.optimizer.vn.global_vn : False I0423 04:03:36.914153 140323924080384 base_runner.py:69] task.train.optimizer.vn.per_step_vn : False I0423 04:03:36.914203 140323924080384 base_runner.py:69] task.train.optimizer.vn.scale : NoneType I0423 04:03:36.914254 140323924080384 base_runner.py:69] task.train.optimizer.vn.seed : NoneType I0423 04:03:36.914305 140323924080384 base_runner.py:69] task.train.pruning_hparams_dict : NoneType I0423 04:03:36.914356 140323924080384 base_runner.py:69] task.train.save_interval_seconds : 600 I0423 04:03:36.914407 140323924080384 base_runner.py:69] task.train.start_up_delay_steps : 200 I0423 04:03:36.914458 140323924080384 base_runner.py:69] task.train.sum_loss_across_tokens_in_batch : False I0423 04:03:36.914510 140323924080384 base_runner.py:69] task.train.summary_interval_steps : 100 I0423 04:03:36.914561 140323924080384 base_runner.py:69] task.train.tpu_steps_per_loop : 100 I0423 04:03:36.914613 140323924080384 base_runner.py:69] task.train.vn_start_step : 20000 I0423 04:03:36.914664 140323924080384 base_runner.py:69] task.train.vn_std : 0.0 I0423 04:03:36.914715 140323924080384 base_runner.py:69] task.vn.global_vn : False I0423 04:03:36.914766 140323924080384 base_runner.py:69] task.vn.per_step_vn : False I0423 04:03:36.914817 140323924080384 base_runner.py:69] task.vn.scale : NoneType I0423 04:03:36.914876 140323924080384 base_runner.py:69] task.vn.seed : NoneType I0423 04:03:36.914932 140323924080384 base_runner.py:69] train.early_stop.metric_history.jobname : 'eval_dev' I0423 04:03:36.914983 140323924080384 base_runner.py:69] train.early_stop.metric_history.local_filesystem : False I0423 04:03:36.915035 140323924080384 base_runner.py:69] train.early_stop.metric_history.logdir : '' I0423 04:03:36.915086 140323924080384 base_runner.py:69] train.early_stop.metric_history.metric : 'log_pplx' I0423 04:03:36.915138 140323924080384 base_runner.py:69] train.early_stop.metric_history.minimize : True I0423 04:03:36.915189 140323924080384 base_runner.py:69] train.early_stop.metric_history.name : 'MetricHistory' I0423 04:03:36.915240 140323924080384 base_runner.py:69] train.early_stop.metric_history.tfevent_file : False I0423 04:03:36.915291 140323924080384 base_runner.py:69] train.early_stop.name : 'EarlyStop' I0423 04:03:36.915343 140323924080384 base_runner.py:69] train.early_stop.tolerance : 0.0 I0423 04:03:36.915394 140323924080384 base_runner.py:69] train.early_stop.verbose : True I0423 04:03:36.915445 140323924080384 base_runner.py:69] train.early_stop.window : 0 I0423 04:03:36.915497 140323924080384 base_runner.py:69] train.ema_decay : 0.0 I0423 04:03:36.915548 140323924080384 base_runner.py:69] train.init_from_checkpoint_rules : {} I0423 04:03:36.915599 140323924080384 base_runner.py:69] train.max_steps : 4000000 I0423 04:03:36.915656 140323924080384 base_runner.py:69] train.save_interval_seconds : 600 I0423 04:03:36.915708 140323924080384 base_runner.py:69] train.start_up_delay_steps : 200 I0423 04:03:36.915760 140323924080384 base_runner.py:69] train.summary_interval_steps : 100 I0423 04:03:36.915812 140323924080384 base_runner.py:69] train.tpu_steps_per_loop : 100 I0423 04:03:36.915863 140323924080384 base_runner.py:69] vn.global_vn : False I0423 04:03:36.915914 140323924080384 base_runner.py:69] vn.per_step_vn : False I0423 04:03:36.915965 140323924080384 base_runner.py:69] vn.scale : NoneType I0423 04:03:36.916016 140323924080384 base_runner.py:69] vn.seed : NoneType I0423 04:03:36.916066 140323924080384 base_runner.py:69] I0423 04:03:36.916130 140323924080384 base_runner.py:70] ============================================================ I0423 04:03:36.917784 140323924080384 base_runner.py:115] Starting ... I0423 04:03:36.917999 140323924080384 cluster.py:429] _LeastLoadedPlacer : ['/job:local/replica:0/task:0/device:CPU:0'] I0423 04:03:36.926768 140323924080384 cluster.py:447] Place variable global_step on /job:local/replica:0/task:0/device:CPU:0 8 I0423 04:03:36.938944 140323924080384 base_model.py:1116] Training parameters for : { early_stop: { metric_history: { "eval_dev" local_filesystem: False "/tmp/mnist/log" "log_pplx" minimize: True "MetricHistory" tfevent_file: False } "EarlyStop" tolerance: 0.0 verbose: True window: 0 } ema_decay: 0.0 init_from_checkpoint_rules: {} max_steps: 4000000 save_interval_seconds: 600 start_up_delay_steps: 200 summary_interval_steps: 100 tpu_steps_per_loop: 100 } I0423 04:03:36.956279 140323924080384 base_input_generator.py:510] bucket_batch_limit [8] I0423 04:03:37.069195 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 16777224 I0423 04:03:37.071014 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.073404 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 16785416 I0423 04:03:37.074861 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.081132 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 33562632 I0423 04:03:37.082844 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.085328 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 33570824 I0423 04:03:37.086793 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.093470 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 50348040 I0423 04:03:37.095185 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.097543 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 50356232 I0423 04:03:37.099113 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.105364 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 67133448 I0423 04:03:37.107085 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.109689 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 67141640 I0423 04:03:37.111207 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.114597 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 67142152 I0423 04:03:37.116087 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.119546 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 67150344 I0423 04:03:37.120997 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.123496 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 67158536 I0423 04:03:37.124948 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:37.132996 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:37.138824 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 134267400 I0423 04:03:37.140625 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.142986 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 134300168 I0423 04:03:37.144443 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:37.146722 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:37.152327 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 201409032 I0423 04:03:37.154042 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.156522 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 201417224 I0423 04:03:37.158000 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.162344 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 201425416 I0423 04:03:37.163969 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.166313 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 201433608 I0423 04:03:37.167777 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.186197 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 218210824 I0423 04:03:37.187943 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.190402 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 218219016 I0423 04:03:37.191905 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.198163 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 234996232 I0423 04:03:37.199907 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.202368 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 235004424 I0423 04:03:37.203841 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.210200 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 251781640 I0423 04:03:37.211992 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.214379 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 251789832 I0423 04:03:37.215847 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.222172 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 268567048 I0423 04:03:37.223910 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.226385 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 268575240 I0423 04:03:37.227864 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.231286 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 268575752 I0423 04:03:37.232904 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.236423 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 268583944 I0423 04:03:37.237888 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.240391 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 268592136 I0423 04:03:37.241863 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:37.638359 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:37.644776 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 335701000 I0423 04:03:37.646586 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.649009 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 335733768 I0423 04:03:37.650494 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:37.652381 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:37.658164 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 402842632 I0423 04:03:37.659900 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.662368 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 402850824 I0423 04:03:37.663863 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.668390 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 402859016 I0423 04:03:37.669857 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.672230 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 402867208 I0423 04:03:37.673707 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.692704 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 419644424 I0423 04:03:37.694540 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.696928 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 419652616 I0423 04:03:37.698405 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.704853 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 436429832 I0423 04:03:37.706579 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.708969 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 436438024 I0423 04:03:37.710444 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.716748 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 453215240 I0423 04:03:37.718475 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.720856 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 453223432 I0423 04:03:37.722436 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.728919 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 470000648 I0423 04:03:37.730777 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.733311 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 470008840 I0423 04:03:37.734786 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.738687 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 470009352 I0423 04:03:37.740201 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.743741 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 470017544 I0423 04:03:37.745196 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.747719 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 470025736 I0423 04:03:37.749212 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:37.757386 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:37.763108 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 537134600 I0423 04:03:37.764837 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.767227 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 537167368 I0423 04:03:37.768706 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:37.770535 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:37.776159 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 604276232 I0423 04:03:37.778033 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.780520 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 604284424 I0423 04:03:37.782056 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.786349 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 604292616 I0423 04:03:37.787997 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.790366 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 604300808 I0423 04:03:37.791853 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.810508 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 621078024 I0423 04:03:37.812263 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.814734 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 621086216 I0423 04:03:37.816232 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.822487 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 637863432 I0423 04:03:37.824299 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.826940 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 637871624 I0423 04:03:37.828615 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.835510 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 654648840 I0423 04:03:37.837245 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.839638 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 654657032 I0423 04:03:37.841119 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.847456 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 671434248 I0423 04:03:37.849189 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.851664 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 671442440 I0423 04:03:37.853399 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.856837 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 671442952 I0423 04:03:37.858335 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.861866 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 671451144 I0423 04:03:37.863341 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.865900 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 671459336 I0423 04:03:37.867394 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:37.875520 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:37.881359 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 738568200 I0423 04:03:37.883111 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.885493 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 738600968 I0423 04:03:37.887001 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:37.888849 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:37.895001 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 805709832 I0423 04:03:37.896745 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.899323 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 805718024 I0423 04:03:37.900811 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.905263 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 805726216 I0423 04:03:37.906919 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.909296 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 805734408 I0423 04:03:37.910779 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.929033 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 822511624 I0423 04:03:37.930804 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.933749 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 822519816 I0423 04:03:37.935233 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.941505 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 839297032 I0423 04:03:37.943269 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.945743 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 839305224 I0423 04:03:37.947242 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.953603 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 856082440 I0423 04:03:37.955425 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.957812 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 856090632 I0423 04:03:37.959315 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.965681 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 872867848 I0423 04:03:37.967441 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.969877 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 872876040 I0423 04:03:37.971380 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.974786 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 872876552 I0423 04:03:37.976480 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.980045 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 872884744 I0423 04:03:37.981529 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:37.984050 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 872892936 I0423 04:03:37.985543 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:37.994177 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:37.999876 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 940001800 I0423 04:03:38.001720 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.004138 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 940034568 I0423 04:03:38.005646 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.007514 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.013138 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 1007143432 I0423 04:03:38.014895 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.017386 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 1007151624 I0423 04:03:38.018888 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.023222 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 1007159816 I0423 04:03:38.024882 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.027357 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 1007168008 I0423 04:03:38.028865 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.047527 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj/var on /job:local/replica:0/task:0/device:CPU:0 1023945224 I0423 04:03:38.049282 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.051897 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 1023953416 I0423 04:03:38.053395 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.059680 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj/var on /job:local/replica:0/task:0/device:CPU:0 1040730632 I0423 04:03:38.061443 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.063941 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 1040738824 I0423 04:03:38.065440 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.071724 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj/var on /job:local/replica:0/task:0/device:CPU:0 1057516040 I0423 04:03:38.073530 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.076137 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 1057524232 I0423 04:03:38.077640 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.084018 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj/var on /job:local/replica:0/task:0/device:CPU:0 1074301448 I0423 04:03:38.085777 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj/var:0 shape=(2048, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.088226 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj_b/var on /job:local/replica:0/task:0/device:CPU:0 1074309640 I0423 04:03:38.089729 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj_b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.093166 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var on /job:local/replica:0/task:0/device:CPU:0 1074310152 I0423 04:03:38.095225 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var:0 shape=(128,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.098802 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 1074318344 I0423 04:03:38.100410 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.102952 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 1074326536 I0423 04:03:38.104453 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.112665 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.118371 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/w/var on /job:local/replica:0/task:0/device:CPU:0 1141435400 I0423 04:03:38.120136 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/w/var:0 shape=(2048, 8192) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.122548 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/b/var on /job:local/replica:0/task:0/device:CPU:0 1141468168 I0423 04:03:38.124166 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/b/var:0 shape=(8192,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.126112 140323924080384 py_utils.py:1064] WARNING!!! var w is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.131829 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/w/var on /job:local/replica:0/task:0/device:CPU:0 1208577032 I0423 04:03:38.133589 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/w/var:0 shape=(8192, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.136091 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/b/var on /job:local/replica:0/task:0/device:CPU:0 1208585224 I0423 04:03:38.137609 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/b/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.141977 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/bias/var on /job:local/replica:0/task:0/device:CPU:0 1208593416 I0423 04:03:38.143651 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/bias/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.146035 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/scale/var on /job:local/replica:0/task:0/device:CPU:0 1208601608 I0423 04:03:38.147541 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/scale/var:0 shape=(2048,) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.167104 140323924080384 py_utils.py:1064] WARNING!!! var weight_0 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.172615 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_0/var on /job:local/replica:0/task:0/device:CPU:0 1224985608 I0423 04:03:38.174482 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_0/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.175230 140323924080384 py_utils.py:1064] WARNING!!! var weight_1 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.180619 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_1/var on /job:local/replica:0/task:0/device:CPU:0 1241369608 I0423 04:03:38.182322 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_1/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.183079 140323924080384 py_utils.py:1064] WARNING!!! var weight_2 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.188453 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_2/var on /job:local/replica:0/task:0/device:CPU:0 1257753608 I0423 04:03:38.190211 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_2/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.190962 140323924080384 py_utils.py:1064] WARNING!!! var weight_3 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.196360 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_3/var on /job:local/replica:0/task:0/device:CPU:0 1274137608 I0423 04:03:38.198062 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_3/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.198928 140323924080384 py_utils.py:1064] WARNING!!! var weight_4 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.204363 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_4/var on /job:local/replica:0/task:0/device:CPU:0 1290521608 I0423 04:03:38.206063 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_4/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.206803 140323924080384 py_utils.py:1064] WARNING!!! var weight_5 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.212223 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_5/var on /job:local/replica:0/task:0/device:CPU:0 1306905608 I0423 04:03:38.213928 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_5/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.214667 140323924080384 py_utils.py:1064] WARNING!!! var weight_6 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.220079 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_6/var on /job:local/replica:0/task:0/device:CPU:0 1323289608 I0423 04:03:38.221848 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_6/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.222593 140323924080384 py_utils.py:1064] WARNING!!! var weight_7 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.228092 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_7/var on /job:local/replica:0/task:0/device:CPU:0 1339673608 I0423 04:03:38.229793 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_7/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.230530 140323924080384 py_utils.py:1064] WARNING!!! var weight_8 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.236011 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_8/var on /job:local/replica:0/task:0/device:CPU:0 1356057608 I0423 04:03:38.237714 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_8/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.238502 140323924080384 py_utils.py:1064] WARNING!!! var weight_9 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.244393 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_9/var on /job:local/replica:0/task:0/device:CPU:0 1372441608 I0423 04:03:38.246105 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_9/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.246841 140323924080384 py_utils.py:1064] WARNING!!! var weight_10 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.252393 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_10/var on /job:local/replica:0/task:0/device:CPU:0 1388825608 I0423 04:03:38.254159 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_10/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.254910 140323924080384 py_utils.py:1064] WARNING!!! var weight_11 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.260322 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_11/var on /job:local/replica:0/task:0/device:CPU:0 1405209608 I0423 04:03:38.262032 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_11/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.262769 140323924080384 py_utils.py:1064] WARNING!!! var weight_12 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.268208 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_12/var on /job:local/replica:0/task:0/device:CPU:0 1421593608 I0423 04:03:38.269908 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_12/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.270647 140323924080384 py_utils.py:1064] WARNING!!! var weight_13 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.276149 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_13/var on /job:local/replica:0/task:0/device:CPU:0 1437977608 I0423 04:03:38.277852 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_13/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.278589 140323924080384 py_utils.py:1064] WARNING!!! var weight_14 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.283993 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_14/var on /job:local/replica:0/task:0/device:CPU:0 1454361608 I0423 04:03:38.285749 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_14/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 W0423 04:03:38.286490 140323924080384 py_utils.py:1064] WARNING!!! var weight_15 is using the default xavier initializer. Make sure this is intended. I0423 04:03:38.291893 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/weight_15/var on /job:local/replica:0/task:0/device:CPU:0 1470745608 I0423 04:03:38.293596 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/weight_15/var:0 shape=(2048, 2000) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.295989 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_0/var on /job:local/replica:0/task:0/device:CPU:0 1470753608 I0423 04:03:38.297564 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_0/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.300065 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_1/var on /job:local/replica:0/task:0/device:CPU:0 1470761608 I0423 04:03:38.301518 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_1/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.303922 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_2/var on /job:local/replica:0/task:0/device:CPU:0 1470769608 I0423 04:03:38.305382 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_2/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.307862 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_3/var on /job:local/replica:0/task:0/device:CPU:0 1470777608 I0423 04:03:38.309343 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_3/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.311722 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_4/var on /job:local/replica:0/task:0/device:CPU:0 1470785608 I0423 04:03:38.313196 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_4/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.315578 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_5/var on /job:local/replica:0/task:0/device:CPU:0 1470793608 I0423 04:03:38.317168 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_5/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.319544 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_6/var on /job:local/replica:0/task:0/device:CPU:0 1470801608 I0423 04:03:38.321028 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_6/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.323528 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_7/var on /job:local/replica:0/task:0/device:CPU:0 1470809608 I0423 04:03:38.325561 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_7/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.327944 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_8/var on /job:local/replica:0/task:0/device:CPU:0 1470817608 I0423 04:03:38.329432 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_8/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.331881 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_9/var on /job:local/replica:0/task:0/device:CPU:0 1470825608 I0423 04:03:38.333473 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_9/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.335859 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_10/var on /job:local/replica:0/task:0/device:CPU:0 1470833608 I0423 04:03:38.337348 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_10/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.339796 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_11/var on /job:local/replica:0/task:0/device:CPU:0 1470841608 I0423 04:03:38.341382 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_11/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.343779 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_12/var on /job:local/replica:0/task:0/device:CPU:0 1470849608 I0423 04:03:38.345249 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_12/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.347788 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_13/var on /job:local/replica:0/task:0/device:CPU:0 1470857608 I0423 04:03:38.349381 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_13/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.351774 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_14/var on /job:local/replica:0/task:0/device:CPU:0 1470865608 I0423 04:03:38.353255 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_14/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.355637 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/softmax/bias_15/var on /job:local/replica:0/task:0/device:CPU:0 1470873608 I0423 04:03:38.357229 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/softmax/bias_15/var:0 shape=(2000,) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.370757 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/transformerlm/emb/wm/var on /job:local/replica:0/task:0/device:CPU:0 1733017608 I0423 04:03:38.372513 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/transformerlm/emb/wm/var:0 shape=(32000, 2048) on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:38.490622 140323924080384 py_utils.py:1277] === worker 0 === I0423 04:03:38.493455 140323924080384 py_utils.py:1267] worker 0: global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.493535 140323924080384 py_utils.py:1267] worker 0: input._tokenizer_default.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.493596 140323924080384 py_utils.py:1267] worker 0: input.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.493649 140323924080384 py_utils.py:1267] worker 0: lm.emb.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.493700 140323924080384 py_utils.py:1267] worker 0: lm.emb.wm /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.493751 140323924080384 py_utils.py:1267] worker 0: lm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.493801 140323924080384 py_utils.py:1267] worker 0: lm.input_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.493849 140323924080384 py_utils.py:1267] worker 0: lm.position_emb.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.493899 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_0 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.493947 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_1 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.493995 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_10 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.494045 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_11 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.494098 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_12 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.494148 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_13 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.494198 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_14 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.494246 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_15 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.494293 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_2 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.494343 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_3 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.494390 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_4 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.494438 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_5 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.494488 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_6 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.494535 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_7 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.494584 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_8 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.494632 140323924080384 py_utils.py:1267] worker 0: lm.softmax.bias_9 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.494680 140323924080384 py_utils.py:1267] worker 0: lm.softmax.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.494729 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_0 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.494777 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_1 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.494826 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_10 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.494880 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_11 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.494932 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_12 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.494982 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_13 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.495034 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_14 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.495084 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_15 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.495132 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_2 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.495217 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_3 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.495270 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_4 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.495323 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_5 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.495377 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_6 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.495430 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_7 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.495484 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_8 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.495563 140323924080384 py_utils.py:1267] worker 0: lm.softmax.weight_9 /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.495611 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.495660 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.495707 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.495755 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.495804 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.495851 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.495899 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.495948 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.495995 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.496048 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.496098 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.496145 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.496193 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.496242 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.496289 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.496339 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.496387 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.496436 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.496484 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.496531 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.496581 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.496628 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.496678 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.496726 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.496773 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.496822 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.496870 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.496921 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.496970 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.497019 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.497066 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_0.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.497114 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.497163 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.497210 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.497258 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.497307 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.497354 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.497402 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.497452 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.497499 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.497550 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.497598 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.497647 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.497694 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.497742 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.497791 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.497843 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.497891 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.497940 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.497987 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.498035 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.498084 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.498131 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.498179 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.498228 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.498276 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.498325 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.498373 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.498420 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.498470 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.498517 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.498564 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_1.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.498613 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.498660 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.498708 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.498764 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.498814 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.498861 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.498924 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.498972 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.499020 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.499068 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.499116 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.499165 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.499212 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.499260 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.499310 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.499357 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.499406 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.499453 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.499501 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.499548 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.499597 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.499650 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.499700 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.499747 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.499795 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.499845 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.499892 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.499941 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.499989 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.500036 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.500085 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_2.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.500133 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.500181 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.500230 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.500277 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.500325 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.500374 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.500422 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.500472 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.500519 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.500571 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.500621 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.500669 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.500716 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.500765 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.500813 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.500860 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.500910 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.500957 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.501005 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.501054 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.501101 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.501149 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.501197 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.501245 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.501293 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.501342 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.501390 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.501446 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.501496 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.501543 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.501591 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_3.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.501640 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.501688 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.501735 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.501784 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.501832 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.501879 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.501928 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.501976 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.502024 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.502074 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.502121 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.502170 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.502218 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.502265 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.502314 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.502367 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.502418 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.502465 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.502515 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.502562 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.502610 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.502659 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.502707 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.502754 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.502804 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.502852 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.502914 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.502964 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.503014 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.503062 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.503109 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_4.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.503158 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.dropout[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.503206 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.dropout[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.503253 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[0].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.503305 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[0].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.503355 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[0].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.503403 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[1].b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.503453 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[1].global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.503500 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc[1].w /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.503549 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.503597 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.503645 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.503694 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.503741 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.503789 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.fflayer.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.503838 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.503885 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.503933 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.atten.per_dim_scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.503982 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.504029 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.504077 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.504126 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.504178 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.504226 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.query_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.504275 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.query_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.504323 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.source_proj /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.504371 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.atten.source_proj_b /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.504420 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.504467 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.layer_norm.bias /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.504517 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.layer_norm.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.504565 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.layer_norm.scale /job:local/replica:0/task:0/device:CPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.504612 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.encoder_5.self_atten.residual_dropout.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.504661 140323924080384 py_utils.py:1267] worker 0: lm.stack.cell_0.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:3 I0423 04:03:38.504709 140323924080384 py_utils.py:1267] worker 0: lm.stack.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:0 I0423 04:03:38.504757 140323924080384 py_utils.py:1267] worker 0: lr_schedule.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:1 I0423 04:03:38.504806 140323924080384 py_utils.py:1267] worker 0: optimizer.global_step /job:local/replica:0/task:0/device:GPU:0 -> /job:local/replica:0/task:0/device:GPU:2 I0423 04:03:38.504858 140323924080384 py_utils.py:1283] ========== I0423 04:03:38.522818 140323924080384 layers.py:1272] input shape = (1024, 8, 2048) I0423 04:03:38.553986 140323924080384 layers.py:1283] input_embs shape = (1024, 8, 2048) I0423 04:03:38.565551 140323924080384 gpipe.py:378] cell 0 input [, , None, None, None, None] I0423 04:03:40.075978 140323924080384 gpipe.py:469] pipeline output = [, , None, None, None, None] I0423 04:03:40.076193 140323924080384 layers_with_gpipe.py:643] Tensor("fprop/1bwds_wpm_level_lm/tower_0_0/Reshape_6:0", shape=(1024, 8, 2048), dtype=float32, device=/job:local/replica:0/task:0/device:GPU:0) I0423 04:03:40.076307 140323924080384 layers.py:1286] layer_out shape = (1024, 8, 2048) I0423 04:03:41.395910 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.emb.wm: I0423 04:03:41.396150 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_0: I0423 04:03:41.396249 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_1: I0423 04:03:41.396334 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_10: I0423 04:03:41.396419 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_11: I0423 04:03:41.396500 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_12: I0423 04:03:41.396579 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_13: I0423 04:03:41.396657 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_14: I0423 04:03:41.396735 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_15: I0423 04:03:41.396814 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_2: I0423 04:03:41.396891 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_3: I0423 04:03:41.396967 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_4: I0423 04:03:41.397044 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_5: I0423 04:03:41.397123 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_6: I0423 04:03:41.397201 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_7: I0423 04:03:41.397278 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_8: I0423 04:03:41.397355 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.bias_9: I0423 04:03:41.397430 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_0: I0423 04:03:41.397516 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_1: I0423 04:03:41.397598 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_10: I0423 04:03:41.397692 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_11: I0423 04:03:41.397777 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_12: I0423 04:03:41.397860 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_13: I0423 04:03:41.397942 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_14: I0423 04:03:41.398024 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_15: I0423 04:03:41.398104 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_2: I0423 04:03:41.398186 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_3: I0423 04:03:41.398267 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_4: I0423 04:03:41.398349 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_5: I0423 04:03:41.398430 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_6: I0423 04:03:41.398510 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_7: I0423 04:03:41.398591 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_8: I0423 04:03:41.398674 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.softmax.weight_9: I0423 04:03:41.398753 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc_0.b: I0423 04:03:41.398833 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc_0.w: I0423 04:03:41.398922 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc_1.b: I0423 04:03:41.399002 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.fflayer.fc_1.w: I0423 04:03:41.399084 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.layer_norm.bias: I0423 04:03:41.399167 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.fflayer.layer_norm.scale: I0423 04:03:41.399245 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.atten.per_dim_scale: I0423 04:03:41.399324 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj: I0423 04:03:41.399409 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_post_proj_b: I0423 04:03:41.399487 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj: I0423 04:03:41.399573 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.ctx_proj_b: I0423 04:03:41.399651 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.query_proj: I0423 04:03:41.399734 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.query_proj_b: I0423 04:03:41.399811 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.source_proj: I0423 04:03:41.399893 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.atten.source_proj_b: I0423 04:03:41.399971 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.layer_norm.bias: I0423 04:03:41.400048 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_0.self_atten.layer_norm.scale: I0423 04:03:41.400125 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc_0.b: I0423 04:03:41.400203 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc_0.w: I0423 04:03:41.400286 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc_1.b: I0423 04:03:41.400368 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.fflayer.fc_1.w: I0423 04:03:41.400453 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.layer_norm.bias: I0423 04:03:41.400530 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.fflayer.layer_norm.scale: I0423 04:03:41.400607 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.atten.per_dim_scale: I0423 04:03:41.400685 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj: I0423 04:03:41.400768 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_post_proj_b: I0423 04:03:41.400846 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj: I0423 04:03:41.400928 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.ctx_proj_b: I0423 04:03:41.401007 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.query_proj: I0423 04:03:41.401091 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.query_proj_b: I0423 04:03:41.401169 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.source_proj: I0423 04:03:41.401251 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.atten.source_proj_b: I0423 04:03:41.401329 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.layer_norm.bias: I0423 04:03:41.401407 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_1.self_atten.layer_norm.scale: I0423 04:03:41.401488 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc_0.b: I0423 04:03:41.401566 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc_0.w: I0423 04:03:41.401648 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc_1.b: I0423 04:03:41.401727 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.fflayer.fc_1.w: I0423 04:03:41.401808 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.layer_norm.bias: I0423 04:03:41.401886 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.fflayer.layer_norm.scale: I0423 04:03:41.401962 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.atten.per_dim_scale: I0423 04:03:41.402040 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj: I0423 04:03:41.402123 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_post_proj_b: I0423 04:03:41.402201 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj: I0423 04:03:41.402285 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.ctx_proj_b: I0423 04:03:41.402363 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.query_proj: I0423 04:03:41.402445 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.query_proj_b: I0423 04:03:41.402522 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.source_proj: I0423 04:03:41.402604 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.atten.source_proj_b: I0423 04:03:41.402686 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.layer_norm.bias: I0423 04:03:41.402764 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_2.self_atten.layer_norm.scale: I0423 04:03:41.402842 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc_0.b: I0423 04:03:41.402926 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc_0.w: I0423 04:03:41.403011 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc_1.b: I0423 04:03:41.403089 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.fflayer.fc_1.w: I0423 04:03:41.403172 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.layer_norm.bias: I0423 04:03:41.403249 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.fflayer.layer_norm.scale: I0423 04:03:41.403326 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.atten.per_dim_scale: I0423 04:03:41.403403 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj: I0423 04:03:41.403487 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_post_proj_b: I0423 04:03:41.403567 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj: I0423 04:03:41.403649 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.ctx_proj_b: I0423 04:03:41.403728 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.query_proj: I0423 04:03:41.403810 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.query_proj_b: I0423 04:03:41.403893 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.source_proj: I0423 04:03:41.403978 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.atten.source_proj_b: I0423 04:03:41.404057 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.layer_norm.bias: I0423 04:03:41.404134 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_3.self_atten.layer_norm.scale: I0423 04:03:41.404212 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc_0.b: I0423 04:03:41.404289 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc_0.w: I0423 04:03:41.404372 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc_1.b: I0423 04:03:41.404449 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.fflayer.fc_1.w: I0423 04:03:41.404531 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.layer_norm.bias: I0423 04:03:41.404609 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.fflayer.layer_norm.scale: I0423 04:03:41.404686 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.atten.per_dim_scale: I0423 04:03:41.404763 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj: I0423 04:03:41.404846 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_post_proj_b: I0423 04:03:41.404926 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj: I0423 04:03:41.405009 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.ctx_proj_b: I0423 04:03:41.405091 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.query_proj: I0423 04:03:41.405174 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.query_proj_b: I0423 04:03:41.405252 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.source_proj: I0423 04:03:41.405335 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.atten.source_proj_b: I0423 04:03:41.405414 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.layer_norm.bias: I0423 04:03:41.405492 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_4.self_atten.layer_norm.scale: I0423 04:03:41.405570 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc_0.b: I0423 04:03:41.405647 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc_0.w: I0423 04:03:41.405729 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc_1.b: I0423 04:03:41.405807 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.fflayer.fc_1.w: I0423 04:03:41.405889 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.layer_norm.bias: I0423 04:03:41.405966 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.fflayer.layer_norm.scale: I0423 04:03:41.406042 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.atten.per_dim_scale: I0423 04:03:41.406119 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj: I0423 04:03:41.406207 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_post_proj_b: I0423 04:03:41.406286 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj: I0423 04:03:41.406368 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.ctx_proj_b: I0423 04:03:41.406446 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.query_proj: I0423 04:03:41.406529 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.query_proj_b: I0423 04:03:41.406608 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.source_proj: I0423 04:03:41.406689 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.atten.source_proj_b: I0423 04:03:41.406768 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.layer_norm.bias: I0423 04:03:41.406845 140323924080384 py_utils.py:1730] AdjustGradientsWithLpLoss: lm.stack.cell_0.encoder_5.self_atten.layer_norm.scale: I0423 04:03:44.422043 140323924080384 cluster.py:447] Place variable beta1_power on /job:local/replica:0/task:0/device:CPU:0 1733017612 I0423 04:03:44.424710 140323924080384 cluster.py:447] Place variable beta2_power on /job:local/replica:0/task:0/device:CPU:0 1733017616 I0423 04:03:45.790803 140323924080384 cluster.py:447] Place variable 1bwds_wpm_level_lm/total_samples/var on /job:local/replica:0/task:0/device:CPU:0 1733017624 I0423 04:03:45.792495 140323924080384 py_utils.py:1220] Creating var 1bwds_wpm_level_lm/total_samples/var:0 shape=() on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:45.798011 140323924080384 cluster.py:447] Place variable total_nan_gradients/var on /job:local/replica:0/task:0/device:CPU:0 1733017632 I0423 04:03:45.799557 140323924080384 py_utils.py:1220] Creating var total_nan_gradients/var:0 shape=() on device /job:local/replica:0/task:0/device:CPU:0 I0423 04:03:45.833189 140323924080384 trainer.py:392] Trainer number of enqueue ops: 0 I0423 04:03:45.833796 140323924080384 trainer.py:401] AttributeError. Expected for single task models. I0423 04:03:48.933069 140323924080384 trainer.py:1327] Starting runners I0423 04:03:48.933978 140305292846848 base_runner.py:195] controller started. I0423 04:03:48.934310 140323924080384 trainer.py:1334] Total num runner.enqueue_ops: 0 I0423 04:03:48.935009 140323924080384 trainer.py:1334] Total num runner.enqueue_ops: 0 I0423 04:03:48.935272 140305281836800 base_runner.py:195] trainer started. I0423 04:03:48.935457 140323924080384 trainer.py:1344] Waiting for runners to finish... I0423 04:03:51.083758 140305281836800 trainer.py:455] Probably the expected race on global_step: Attempting to use uninitialized value global_step [[{{node _send_global_step_0}}]] I0423 04:03:52.087980 140305281836800 retry.py:68] Retry: caught exception: _WaitTillInit while running FailedPreconditionError: Attempting to use uninitialized value global_step [[{{node _send_global_step_0}}]] . Call failed at (most recent call last): File "/usr/lib/python2.7/threading.py", line 774, in __bootstrap self.__bootstrap_inner() File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner self.run() File "/usr/lib/python2.7/threading.py", line 754, in run self.__target(*self.__args, **self.__kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py", line 420, in Start self._RunLoop('trainer', self._Loop) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/retry.py", line 50, in wrapper return func(*args, **kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/base_runner.py", line 196, in _RunLoop loop_func(*loop_args) Traceback for above exception (most recent call last): File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/retry.py", line 50, in wrapper return func(*args, **kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py", line 453, in _WaitTillInit global_step = sess.run(py_utils.GetGlobalStep()) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 933, in run run_metadata_ptr) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1156, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1333, in _do_run run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1353, in _do_call raise type(e)(node_def, op, message) Waiting for 1.52 seconds before retrying. I0423 04:03:52.089750 140305281836800 trainer.py:455] Probably the expected race on global_step: Attempting to use uninitialized value global_step [[{{node _send_global_step_0}}]] I0423 04:03:53.616008 140305281836800 retry.py:68] Retry: caught exception: _WaitTillInit while running FailedPreconditionError: Attempting to use uninitialized value global_step [[{{node _send_global_step_0}}]] . Call failed at (most recent call last): File "/usr/lib/python2.7/threading.py", line 774, in __bootstrap self.__bootstrap_inner() File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner self.run() File "/usr/lib/python2.7/threading.py", line 754, in run self.__target(*self.__args, **self.__kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py", line 420, in Start self._RunLoop('trainer', self._Loop) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/retry.py", line 50, in wrapper return func(*args, **kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/base_runner.py", line 196, in _RunLoop loop_func(*loop_args) Traceback for above exception (most recent call last): File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/retry.py", line 50, in wrapper return func(*args, **kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py", line 453, in _WaitTillInit global_step = sess.run(py_utils.GetGlobalStep()) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 933, in run run_metadata_ptr) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1156, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1333, in _do_run run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1353, in _do_call raise type(e)(node_def, op, message) Waiting for 2.34 seconds before retrying. I0423 04:03:53.617985 140305281836800 trainer.py:455] Probably the expected race on global_step: Attempting to use uninitialized value global_step [[{{node _send_global_step_0}}]] 2019-04-23 04:03:54.985080: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1643] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set. If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU. To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile. I0423 04:03:55.028808 140305292846848 trainer.py:302] Uninitialized var list: ['global_step', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj_b/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/w/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/b/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/bias/var', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/scale/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_0/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_1/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_2/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_3/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_4/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_5/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_6/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_7/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_8/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_9/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_10/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_11/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_12/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_13/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_14/var', '1bwds_wpm_level_lm/transformerlm/softmax/weight_15/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_0/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_1/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_2/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_3/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_4/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_5/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_6/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_7/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_8/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_9/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_10/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_11/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_12/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_13/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_14/var', '1bwds_wpm_level_lm/transformerlm/softmax/bias_15/var', '1bwds_wpm_level_lm/transformerlm/emb/wm/var', 'beta1_power', 'beta2_power', '1bwds_wpm_level_lm/transformerlm/emb/wm/var/Adam', '1bwds_wpm_level_lm/transformerlm/emb/wm/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_0/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_0/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_1/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_1/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_10/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_10/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_11/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_11/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_12/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_12/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_13/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_13/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_14/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_14/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_15/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_15/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_2/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_2/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_3/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_3/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_4/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_4/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_5/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_5/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_6/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_6/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_7/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_7/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_8/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_8/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/bias_9/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/bias_9/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_0/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_0/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_1/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_1/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_10/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_10/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_11/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_11/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_12/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_12/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_13/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_13/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_14/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_14/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_15/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_15/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_2/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_2/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_3/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_3/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_4/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_4/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_5/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_5/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_6/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_6/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_7/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_7/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_8/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_8/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/softmax/weight_9/var/Adam', '1bwds_wpm_level_lm/transformerlm/softmax/weight_9/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_0/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer/fflayer_1/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/tr_fflayer/fflayer_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/query_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/multihead_atten/source_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_0/multihead_self_atten/atten_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_0/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer/fflayer_1/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/tr_fflayer/fflayer_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/query_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/multihead_atten/source_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_1/multihead_self_atten/atten_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_0/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer/fflayer_1/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/tr_fflayer/fflayer_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/query_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/multihead_atten/source_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_2/multihead_self_atten/atten_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_0/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer/fflayer_1/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/tr_fflayer/fflayer_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/query_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/multihead_atten/source_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_3/multihead_self_atten/atten_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_0/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer/fflayer_1/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/tr_fflayer/fflayer_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/query_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/multihead_atten/source_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_4/multihead_self_atten/atten_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_0/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/w/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer/fflayer_1/w/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/tr_fflayer/fflayer_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/inner_att/per_dim_scale/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_post_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/ctx_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/query_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj_b/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/multihead_atten/source_proj_b/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/bias/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/bias/var/Adam_1', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/scale/var/Adam', '1bwds_wpm_level_lm/transformerlm/encoder_5/multihead_self_atten/atten_ln/scale/var/Adam_1', '1bwds_wpm_level_lm/total_samples/var', 'total_nan_gradients/var'] I0423 04:03:55.031744 140305292846848 trainer.py:305] Load from checkpoint /tmp/mnist/log/train/ckpt-00000000. I0423 04:03:55.033823 140305292846848 saver.py:1276] Restoring parameters from /tmp/mnist/log/train/ckpt-00000000 I0423 04:03:55.956302 140305281836800 retry.py:68] Retry: caught exception: _WaitTillInit while running FailedPreconditionError: Attempting to use uninitialized value global_step [[{{node _send_global_step_0}}]] . Call failed at (most recent call last): File "/usr/lib/python2.7/threading.py", line 774, in __bootstrap self.__bootstrap_inner() File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner self.run() File "/usr/lib/python2.7/threading.py", line 754, in run self.__target(*self.__args, **self.__kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py", line 420, in Start self._RunLoop('trainer', self._Loop) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/retry.py", line 50, in wrapper return func(*args, **kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/base_runner.py", line 196, in _RunLoop loop_func(*loop_args) Traceback for above exception (most recent call last): File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/retry.py", line 50, in wrapper return func(*args, **kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py", line 453, in _WaitTillInit global_step = sess.run(py_utils.GetGlobalStep()) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 933, in run run_metadata_ptr) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1156, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1333, in _do_run run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1353, in _do_call raise type(e)(node_def, op, message) Waiting for 3.53 seconds before retrying. I0423 04:03:55.959667 140305281836800 trainer.py:455] Probably the expected race on global_step: Attempting to use uninitialized value global_step [[{{node _send_global_step_0}}]] I0423 04:03:58.838638 140305292846848 trainer.py:307] Load checkpoint done. I0423 04:03:59.497639 140305281836800 retry.py:68] Retry: caught exception: _WaitTillInit while running FailedPreconditionError: Attempting to use uninitialized value global_step [[{{node _send_global_step_0}}]] . Call failed at (most recent call last): File "/usr/lib/python2.7/threading.py", line 774, in __bootstrap self.__bootstrap_inner() File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner self.run() File "/usr/lib/python2.7/threading.py", line 754, in run self.__target(*self.__args, **self.__kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py", line 420, in Start self._RunLoop('trainer', self._Loop) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/retry.py", line 50, in wrapper return func(*args, **kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/base_runner.py", line 196, in _RunLoop loop_func(*loop_args) Traceback for above exception (most recent call last): File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/core/retry.py", line 50, in wrapper return func(*args, **kwargs) File "/tmp/lingvo/bazel-bin/lingvo/trainer.runfiles/__main__/lingvo/trainer.py", line 453, in _WaitTillInit global_step = sess.run(py_utils.GetGlobalStep()) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 933, in run run_metadata_ptr) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1156, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1333, in _do_run run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1353, in _do_call raise type(e)(node_def, op, message) Waiting for 5.41 seconds before retrying. I0423 04:03:59.499412 140305281836800 base_runner.py:115] step: 0 I0423 04:03:59.996027 140305292846848 trainer.py:371] Steps/second: 0.000000, Examples/second: 0.000000 I0423 04:03:59.996772 140305292846848 trainer.py:268] Save checkpoint W0423 04:04:19.819458 140305292846848 meta_graph.py:447] Issue encountered when serializing __batch_norm_update_dict. Type is unsupported, or the types of the items don't match field type in CollectionDef. Note this is a warning and probably safe to ignore. 'dict' object has no attribute 'name' W0423 04:04:19.836529 140305292846848 meta_graph.py:447] Issue encountered when serializing __model_split_id_stack. Type is unsupported, or the types of the items don't match field type in CollectionDef. Note this is a warning and probably safe to ignore. 'list' object has no attribute 'name' I0423 04:04:20.699928 140305292846848 trainer.py:270] Save checkpoint done: /tmp/mnist/log/train/ckpt-00000000 I0423 04:04:20.711085 140305292846848 trainer.py:371] Steps/second: 0.000000, Examples/second: 0.000000 2019-04-23 04:04:30.336537: I ./lingvo/core/ops/input_common.h:68] Create RecordProcessor 2019-04-23 04:04:30.338333: I lingvo/core/ops/input_common.cc:30] Input source weights are empty, fall back to legacy behavior. 2019-04-23 04:04:30.339482: I lingvo/core/ops/record_yielder.cc:288] 0x7f95ebf6e750 Record yielder start 2019-04-23 04:04:30.339547: I ./lingvo/core/ops/input_common.h:73] Create batcher 2019-04-23 04:04:30.339579: I lingvo/core/ops/record_yielder.cc:341] Epoch 1 /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled/news.en* 2019-04-23 04:04:30.341628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341691: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341880: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341687: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341784: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341792: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341704: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342237: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342254: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342269: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341883: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341714: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341929: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342397: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342416: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341989: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342022: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342526: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341840: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342645: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342765: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342803: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342825: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342454: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342924: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.341993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342616: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343155: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343184: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343218: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343237: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343258: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342346: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342841: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343426: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342421: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342930: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343559: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343578: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343592: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343009: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343184: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342693: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342694: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343358: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343478: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344090: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343479: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342526: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.342955: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343601: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344331: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344358: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343717: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343784: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344478: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344035: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344144: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344691: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344707: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344262: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344383: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344883: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344536: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345068: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344194: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.343657: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345270: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344884: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345397: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344965: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345503: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345540: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345033: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344607: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345624: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345124: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345213: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345946: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345450: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346099: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346116: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345000: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346201: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345124: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346361: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346406: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.344794: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346616: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346136: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346723: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346746: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346762: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346900: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346297: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346422: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347092: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346482: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345558: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346779: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347310: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345763: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347379: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346924: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346950: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347017: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347152: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346678: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347175: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.345452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347243: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347933: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347957: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347471: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347032: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347672: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347757: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347814: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348600: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348621: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347885: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347991: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348711: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348728: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348736: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348807: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348330: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348894: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.347749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348943: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349010: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349072: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348751: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349109: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349126: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349143: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348762: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348260: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348900: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348916: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349272: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348437: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348644: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349406: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.346840: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348053: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348192: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349541: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349179: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349268: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349293: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349312: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349738: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349384: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349424: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349546: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350019: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349560: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349566: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350066: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349671: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349734: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.348980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350238: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349795: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350283: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349484: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349876: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350352: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350371: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349894: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350043: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350044: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350108: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350186: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350618: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349762: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350714: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350739: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349410: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350376: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350822: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350850: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350858: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350488: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350509: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350947: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350526: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350576: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351066: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350259: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351176: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350816: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351271: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350088: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351345: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349963: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350929: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350999: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.349234: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351071: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350651: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351653: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351679: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351714: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351158: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351860: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351873: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351293: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351320: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351986: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351448: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351510: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351581: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351682: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351088: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350752: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352308: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352323: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352336: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352379: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351895: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.350394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352424: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352449: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352474: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351454: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352081: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352170: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352590: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352605: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352617: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352636: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351772: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351880: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352400: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.351961: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352894: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352455: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352946: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352967: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353010: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353027: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352107: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352109: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353107: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352648: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352659: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353202: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353338: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353353: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353138: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353426: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353439: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353451: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353252: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353503: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352826: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352497: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353044: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353381: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353664: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353688: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353694: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353145: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353232: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353465: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353536: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353867: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353887: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353393: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352343: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353992: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352239: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353769: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353775: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353518: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353473: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354241: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354269: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353843: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354337: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353588: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353934: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353954: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354566: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354037: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354094: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354114: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354687: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354271: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353278: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354822: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354428: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354645: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354662: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355029: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355042: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354159: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.353759: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354736: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355094: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354822: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355271: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355311: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355335: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355049: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355064: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354726: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355423: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355441: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355145: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355192: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355206: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355578: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355615: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354589: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355319: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.352584: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355356: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355005: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355461: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355177: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355566: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356126: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355314: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356398: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356443: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355924: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356520: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356639: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356156: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355212: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356215: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356845: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356271: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355783: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357105: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.355403: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357257: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.354790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356682: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357349: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356786: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357498: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356942: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356989: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357708: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357723: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357737: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357194: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357263: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357830: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357858: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356783: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357387: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357432: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358041: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357581: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357125: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358254: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357279: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356657: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358387: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358397: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357879: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358492: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358502: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358511: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358521: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358533: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358552: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358017: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358079: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357743: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358680: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358697: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358283: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358307: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358780: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358417: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357959: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357994: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358906: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358929: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358567: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357503: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359010: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.356219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358663: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359120: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359134: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359145: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358785: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358801: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358886: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358939: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358948: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359312: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359343: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359352: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359416: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359438: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358261: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.357761: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359531: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359562: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359204: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359637: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359249: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359312: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359368: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359782: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359799: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359462: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359551: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359939: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359986: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360023: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359607: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360129: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359666: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359706: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359753: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360196: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359374: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359578: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359946: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359583: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359224: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360538: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360185: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360596: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360217: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360221: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359870: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360726: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360342: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360317: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360473: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.359686: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360948: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360963: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360972: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360559: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360622: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360683: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361053: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361066: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361091: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360720: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360757: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361191: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361213: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360862: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361292: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360516: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361360: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360988: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360994: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361404: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361023: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361443: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361465: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360344: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361196: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361531: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360881: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361250: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361616: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361692: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.358576: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361713: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360261: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361736: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361427: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361472: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361784: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361488: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361807: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361823: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361176: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361937: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361739: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362002: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362025: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362032: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361801: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362058: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361829: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361316: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.360779: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361377: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361954: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361753: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362254: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361117: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361759: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362307: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362320: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362343: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362124: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362410: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361943: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362488: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362495: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362048: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362584: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362290: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362672: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362740: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362427: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362784: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362232: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362511: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362892: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362913: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362607: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363004: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362666: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362692: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363114: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362366: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362222: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363160: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363184: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362853: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363228: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363260: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363271: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363284: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363294: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363306: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363337: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363353: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363381: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362757: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363484: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363502: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363528: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362918: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362937: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363614: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363008: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363403: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363090: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363191: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363771: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.362274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363796: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363819: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363559: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363871: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363885: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363356: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363907: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363697: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363410: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363973: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363536: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.361511: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363817: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363840: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363843: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363329: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363657: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364236: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364252: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364268: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364300: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364319: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364334: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364054: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364365: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364397: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364429: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364462: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364493: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363776: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363995: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364098: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364630: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364651: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364161: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364737: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364760: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364768: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364782: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364791: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364814: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364598: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364636: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364859: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364661: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364439: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364905: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364925: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364936: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364524: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365023: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365055: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364388: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365112: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365133: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365143: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365156: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365178: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.363676: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364964: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365243: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365272: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364828: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365061: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365341: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365087: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365371: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364877: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365429: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365446: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365458: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365503: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365532: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365545: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364342: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365319: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365644: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365655: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365667: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365740: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365761: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364275: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365806: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365825: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365252: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365570: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365881: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365906: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365674: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365915: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364681: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365710: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365999: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364997: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365848: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365588: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366131: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366155: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365392: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.364882: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366205: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366233: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366264: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365991: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366294: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366306: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366322: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366334: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366361: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366374: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365830: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366442: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366457: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366174: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366499: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365947: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366273: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366579: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366595: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366605: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366617: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366649: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365622: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365364: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366718: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366521: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366020: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366036: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366914: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366926: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366957: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366981: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366465: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365977: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365185: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367150: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.365715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367177: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366829: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366858: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367211: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366400: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367243: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367262: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367275: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367324: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367045: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367347: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367211: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367224: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367438: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367455: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367462: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367249: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366168: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366753: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367531: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367557: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366823: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367629: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367412: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367678: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367694: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367701: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367483: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367726: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367548: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367785: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367096: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367369: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367593: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367869: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367886: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367599: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367655: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366672: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367965: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367985: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368008: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368020: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368030: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368053: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367343: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368150: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.366987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367716: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368199: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368209: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368223: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368231: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367776: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368275: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368312: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368338: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368360: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368381: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368401: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368423: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368449: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368462: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368471: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368492: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368539: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367305: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368585: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368039: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368614: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368663: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368677: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368486: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367905: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368716: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368532: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368741: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368787: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368802: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368840: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368850: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368863: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368872: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368699: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368894: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368560: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368756: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368964: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368825: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368441: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.367644: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369075: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369090: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369105: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369113: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368735: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369138: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369152: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369167: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369194: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369183: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369212: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369016: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369033: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369260: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369273: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369283: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369296: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369306: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369318: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369329: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368634: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369231: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369433: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369055: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369483: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369496: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369506: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368911: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368416: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369356: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369582: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369221: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369614: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369638: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369649: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368885: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369686: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369696: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369720: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369753: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369766: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369408: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369830: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369844: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369853: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369875: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369900: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368780: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369933: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369947: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369604: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369979: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369238: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369443: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368692: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370049: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.368915: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370098: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370106: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369926: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370129: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370175: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369795: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370202: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370221: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370024: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370269: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369551: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370120: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370364: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370374: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370387: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370396: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370418: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369867: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370071: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369526: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370493: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370308: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370521: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370151: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.369775: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370000: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370244: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370441: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370708: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370292: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370331: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370800: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370812: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370556: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370564: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370940: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370952: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370976: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370653: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370445: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371049: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370541: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371131: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370887: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370409: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371182: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371196: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371212: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371033: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371281: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371294: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371304: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371327: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371335: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371357: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370841: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371421: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371451: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371467: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371481: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370729: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371072: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371551: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371558: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371582: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371401: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371241: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370754: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371685: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371510: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371524: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371070: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.370824: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371573: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371799: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371812: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371821: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371844: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371867: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371655: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371889: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371902: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371912: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371925: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371935: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371948: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371605: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371007: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372029: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372044: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371725: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371729: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372126: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372143: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372157: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371381: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371978: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372220: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372231: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372243: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371706: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372314: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371792: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372387: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371984: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372442: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372459: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372472: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372482: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372067: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372506: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372545: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372381: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372621: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372629: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372409: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372023: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372677: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371882: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372714: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372723: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372523: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372761: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372591: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372404: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372645: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372502: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372964: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372736: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372565: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373044: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373058: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372768: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372784: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372827: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372877: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372894: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373205: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373213: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372935: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373237: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372098: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373260: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372807: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373308: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.371219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373366: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373170: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373397: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373442: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373457: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373466: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373062: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373488: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373323: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373512: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373338: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373560: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373591: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373603: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373664: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373687: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373701: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373724: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373747: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372915: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373789: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373798: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373813: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373827: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373850: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373859: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373509: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373881: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373895: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373903: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373955: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373621: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373979: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373648: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373282: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374019: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374034: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374070: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374082: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374092: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374138: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374160: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373484: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374186: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374042: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374209: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373873: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374233: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373739: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373388: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374278: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374294: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373420: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373528: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.372869: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374249: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374484: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374497: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374505: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373921: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374529: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374317: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374379: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374630: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374690: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374702: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374724: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374739: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374753: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374771: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374779: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374793: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374816: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374832: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374553: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374600: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.373104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374957: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374402: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374450: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375004: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375022: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374520: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375090: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375113: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375186: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375000: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375025: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374256: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375279: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374577: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375356: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375383: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375391: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375404: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375411: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374964: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375498: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375254: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374550: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375329: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375333: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375643: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375426: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374455: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375722: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375734: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375783: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375520: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375563: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375583: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375853: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375137: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375877: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375892: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375164: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375924: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375194: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375948: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375964: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374897: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375870: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376098: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376109: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376131: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376161: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376170: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376183: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375795: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376284: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376297: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376315: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376345: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376377: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375459: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376406: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376419: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376481: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376504: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376216: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376222: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376553: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376564: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376048: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376596: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376068: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375915: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375696: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376664: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376431: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376687: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376486: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376713: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376743: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376320: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376773: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376792: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376815: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376619: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376658: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376872: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376890: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376903: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376918: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.374435: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377051: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377065: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377075: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376859: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377098: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.375232: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376713: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377167: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377177: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376004: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377226: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377245: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377256: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377268: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377089: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376679: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376438: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377329: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377368: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377191: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376983: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377440: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377455: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377286: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377511: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377352: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377548: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377563: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377391: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377414: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377617: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377017: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377478: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377691: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376926: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376525: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377736: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377751: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377785: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377796: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377807: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377819: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377829: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377661: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377850: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377540: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377716: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377726: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377589: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377392: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376991: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378000: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377620: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.376615: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378086: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377504: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378137: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377870: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377570: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378319: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377946: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378352: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378374: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378395: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378416: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378428: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378111: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378159: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378496: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377941: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378564: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378581: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378594: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378603: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377635: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378434: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378450: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378474: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378209: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378763: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378773: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378783: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378793: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378813: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378823: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378860: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378881: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378892: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378653: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378982: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379008: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378720: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378254: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379084: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379114: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378027: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379224: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379236: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379256: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379269: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379294: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379354: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379025: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379419: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379143: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378914: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379550: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379558: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378676: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379581: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378698: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379440: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379655: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379667: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379679: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.377841: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379512: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379734: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379300: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379572: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379783: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379375: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379631: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378536: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379914: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379511: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379707: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379982: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380023: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379759: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380068: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379323: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379813: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380117: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380137: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380148: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380168: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380181: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380199: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379484: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379710: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380277: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380287: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.378933: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379754: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379795: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380366: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380381: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380403: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380421: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380435: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380443: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380466: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380249: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380495: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380515: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380536: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380548: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380087: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380604: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379176: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380458: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380000: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380306: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380505: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380735: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380757: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380767: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380789: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380624: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379936: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380855: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380881: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380323: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380928: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380568: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379855: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381014: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381022: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380921: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381108: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380049: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381133: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381158: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380814: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381215: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381229: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381244: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381069: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381293: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381311: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381318: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381347: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380992: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.379875: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380808: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381437: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381194: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381037: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381508: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380874: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381252: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381560: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381573: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381583: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381592: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381603: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381615: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381637: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381648: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381354: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381393: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381748: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381456: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381769: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381479: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381273: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380354: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380951: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381868: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381881: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381724: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381948: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.380667: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382000: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382023: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381813: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381858: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381160: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382112: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381679: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382160: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382174: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382185: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382197: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382216: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381100: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382238: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382335: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381965: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382409: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382042: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382266: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382462: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382089: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382507: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382560: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382572: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382583: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382592: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381977: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382231: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382635: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382017: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382683: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382696: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382486: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381669: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382134: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382138: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.381763: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382841: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382605: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382437: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382067: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382967: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382983: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383005: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382796: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382347: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383083: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383106: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382863: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382478: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383226: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382747: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383035: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383048: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383347: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382356: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383393: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383414: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383462: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382716: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383221: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383511: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383528: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383538: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383553: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382933: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383656: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383416: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383435: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383725: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383252: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383847: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383290: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383888: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383582: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383957: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383624: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383986: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383682: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383688: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383176: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383746: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384151: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383815: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383249: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384197: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.382810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384272: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384285: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384296: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384318: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384331: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383782: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384156: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384381: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383868: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384421: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384444: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383965: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384468: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384063: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384099: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384583: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384609: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384619: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384238: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384659: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384459: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384247: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384711: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384723: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384746: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384338: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384777: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384403: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383906: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384847: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384678: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.383154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384905: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384916: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384925: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384768: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384354: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384801: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384821: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385069: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385088: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385097: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385107: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385117: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385161: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384943: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385222: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385236: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385254: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385262: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385034: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385286: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385057: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384667: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384868: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385346: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385132: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385185: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385446: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385458: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385008: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385497: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385314: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385323: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385567: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385584: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385596: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385607: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385656: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385677: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385422: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385720: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385245: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385768: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385779: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385792: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385806: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384870: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385877: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385888: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385897: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385630: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385947: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385972: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385044: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386025: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386049: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386061: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385624: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385901: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386145: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386159: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386174: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385999: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386226: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385521: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386252: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386267: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386300: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386320: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386335: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385940: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.384798: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386182: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386202: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385826: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386245: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386490: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385333: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386548: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386560: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386084: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385912: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386619: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386639: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386353: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386669: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386438: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386741: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385136: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385406: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386922: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386935: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386943: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386967: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386512: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387055: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387065: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387081: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.385280: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387178: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387221: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387254: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387279: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387304: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387342: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387357: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387087: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387440: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387199: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387507: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387523: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386770: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387589: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387042: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386807: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387351: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387676: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387690: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.386831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387150: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387461: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387781: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387863: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387874: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387886: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387902: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387712: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387734: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387984: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387540: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387801: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388049: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387828: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387832: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388095: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387643: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388120: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388133: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388158: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387909: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387931: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388202: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388008: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388292: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388070: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388357: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387376: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387696: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388406: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388173: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387972: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387268: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388516: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388264: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387594: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388592: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388315: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388619: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388636: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388377: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388685: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388429: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388732: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388474: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388771: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388536: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388837: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388848: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388860: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388868: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388658: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388142: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388423: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388707: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388708: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389027: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389035: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389050: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388816: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389082: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389096: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389105: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389128: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389174: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388978: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389223: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389238: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389259: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389271: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389278: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388114: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389300: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388886: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389338: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389346: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388947: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388794: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388247: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389443: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389461: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389511: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389317: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389590: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389609: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389361: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389195: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389652: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389667: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389681: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389692: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389704: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389414: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.387370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389468: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389777: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389819: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389848: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389857: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389557: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389881: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388775: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389926: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389710: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389726: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389752: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389528: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390069: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390215: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389950: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390282: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390304: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389875: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390347: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389392: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390429: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390192: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390238: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.389990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390297: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.388899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390545: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390088: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390374: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390125: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390669: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390680: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390692: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390735: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390524: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390323: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390565: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390353: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390588: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390645: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390909: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390403: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390933: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390445: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390959: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390976: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390989: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391004: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391016: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391082: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390594: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390409: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391196: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390983: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391238: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391024: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391265: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391280: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391072: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391364: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391388: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391397: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391410: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391420: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390708: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391465: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391257: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390780: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391060: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391286: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391583: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391596: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391303: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391106: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391674: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391699: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390495: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391433: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391756: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391765: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391515: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391837: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391617: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391883: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391644: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391439: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391218: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391983: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391492: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392029: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392054: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.390897: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391189: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391934: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391936: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391800: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392168: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391532: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392202: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392023: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391855: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392068: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392317: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392366: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392384: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391886: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392478: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392095: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392525: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392100: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392323: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392572: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392584: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392607: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392620: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392431: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.391897: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392683: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392699: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392706: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392753: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392766: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392776: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392008: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392802: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392196: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392827: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392642: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392661: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392872: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392887: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392941: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392796: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392992: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393016: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393029: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393045: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392479: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393091: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393099: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392124: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393143: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392959: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393255: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393068: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393282: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393114: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392964: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393182: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393412: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393437: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393449: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393461: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393471: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393538: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393610: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393273: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393656: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392516: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393509: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393335: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393160: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393546: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392391: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393816: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393189: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393868: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393232: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393907: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393925: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393933: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393679: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393994: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394015: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393748: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394061: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394092: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394106: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394117: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394128: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393977: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393708: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393356: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394018: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394243: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394258: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394087: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393839: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394308: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392720: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394170: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394419: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394199: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394235: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394466: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394504: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393795: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394265: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394573: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.392271: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394680: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394375: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394396: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394444: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394794: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.393776: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394512: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394842: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394282: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394909: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394921: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394619: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394356: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394992: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394766: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395041: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394819: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394858: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395131: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395144: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394937: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394970: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394702: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395239: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395255: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395262: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394175: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395320: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394553: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395342: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394594: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395170: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395189: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395414: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395430: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395440: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395451: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395020: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395506: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395524: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395550: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395584: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395598: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395605: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394985: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395287: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395649: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395092: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395699: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395713: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395577: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395763: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395780: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395789: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395815: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395826: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395841: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395318: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395666: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395933: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395942: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395735: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395963: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395977: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396033: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395848: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396053: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395867: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395338: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395152: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395729: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396177: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396190: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396201: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396213: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396224: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396236: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396047: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396081: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396278: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396299: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396099: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396318: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396338: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396367: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395621: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396400: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395645: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396450: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396254: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396095: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396505: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396545: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396556: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396567: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396376: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396588: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396419: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396259: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396336: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396738: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.394723: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396830: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396609: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395885: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396872: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396894: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396698: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396918: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396942: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396955: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396978: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396989: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397001: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397019: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397031: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397043: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397054: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397066: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397090: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397100: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397113: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396582: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397144: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397164: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397192: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397206: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397229: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396716: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397258: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397270: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397281: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397292: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397303: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397315: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397337: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396874: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396691: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396889: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397427: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397245: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397450: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396757: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397471: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397488: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397499: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397515: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397525: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397183: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397558: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397579: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.395215: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397474: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397136: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396786: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397690: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397167: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397356: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397552: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397576: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397444: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397617: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397914: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397622: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397965: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396604: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397983: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397992: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397714: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397765: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398079: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397827: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398148: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397876: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398191: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398212: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397708: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398234: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398252: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398275: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398319: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398434: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397600: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398467: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397667: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398256: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398591: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.396670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398341: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398635: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398693: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398408: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398165: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398733: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398757: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398787: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398779: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398830: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398844: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398860: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398882: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398907: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398666: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398714: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398954: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398976: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399002: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399014: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399037: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399069: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398658: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399094: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398913: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398806: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399216: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399229: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398292: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399292: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399084: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399316: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399346: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399375: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399387: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399167: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399439: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398815: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399483: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399250: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399268: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399572: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399638: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399398: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399406: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399461: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398529: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399781: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399796: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399551: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398890: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399600: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399883: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399894: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399604: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399922: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399935: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399948: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399167: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399690: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399994: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399189: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399748: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399505: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400144: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399940: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400164: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400191: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400017: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400252: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400096: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400273: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.398928: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400308: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400317: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399972: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400217: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400410: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400427: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400437: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400450: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400473: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400515: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400543: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400558: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400573: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400583: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400387: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399802: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400266: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400656: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400671: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400681: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400694: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400705: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399667: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400357: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400775: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400783: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400071: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400604: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400826: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400841: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400853: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400863: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400876: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400885: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400722: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400905: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400728: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400951: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400601: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400999: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401009: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401019: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401034: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401057: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400901: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400566: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401128: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400796: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400827: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401194: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401022: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.397929: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401260: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401269: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401281: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401312: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401334: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401145: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401376: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401391: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401235: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.399655: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401454: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401467: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401490: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401333: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401151: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401539: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401217: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401629: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401412: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401431: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400793: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401507: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401738: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401763: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401564: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401786: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401871: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401880: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.400955: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401903: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401351: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401556: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401984: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401806: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402035: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401718: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402114: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401741: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402137: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402160: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402170: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402182: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402191: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401648: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401826: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402231: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401921: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402299: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401791: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402007: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402400: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402411: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402421: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402437: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402272: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402506: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402582: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402424: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402636: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402653: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402684: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402696: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402707: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402717: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402729: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402739: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402752: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402760: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402590: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402798: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402613: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402821: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402445: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402844: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402486: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402877: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401397: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402560: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402206: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402973: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402985: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402775: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403015: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403025: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403038: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403050: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403063: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402837: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402466: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403132: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403175: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403197: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401832: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403220: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403031: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403303: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.401926: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402903: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403403: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403419: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402814: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403237: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403069: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403484: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403264: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403506: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403517: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403526: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403551: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403375: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403600: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403615: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403426: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403661: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403111: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403690: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403712: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403168: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403781: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.402790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403639: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403829: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403262: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403683: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403879: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403889: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403540: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403931: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403733: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403953: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403798: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403442: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404023: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404036: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404082: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403729: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404142: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404165: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404176: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404199: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404211: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404222: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403708: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403905: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403925: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404299: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404334: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404375: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404402: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404411: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403871: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404432: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404233: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404509: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404524: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404533: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404570: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404578: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403158: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404604: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404636: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404658: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404681: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404693: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404704: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404717: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404740: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404453: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404108: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404862: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404351: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404886: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403478: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403855: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404948: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404423: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404967: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404985: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405007: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405017: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405047: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404880: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405071: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404929: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405128: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405145: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405176: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405186: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405244: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405255: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405267: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405278: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405290: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405314: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405324: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404769: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405358: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405371: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405419: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405432: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405442: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405453: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405540: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405553: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405564: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405577: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405087: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405633: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405655: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405678: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405499: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405515: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405793: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405605: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405610: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404905: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405900: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405930: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405940: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404972: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405962: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405724: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406023: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405769: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405412: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406088: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406105: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405699: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406212: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405995: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.403758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406043: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406068: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405824: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406142: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406421: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405988: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406467: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406234: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406538: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405763: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406595: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406619: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406630: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406651: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406672: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406492: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406717: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406577: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406361: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.404251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406799: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406822: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406445: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406843: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406693: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406905: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406713: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406341: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406732: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406973: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406738: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407034: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.405695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407084: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407105: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406865: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407151: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406865: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407185: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407204: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407217: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407232: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407263: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407280: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407311: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407328: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407342: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407112: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407131: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407432: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406922: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406952: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407496: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407009: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406426: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407051: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407058: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407631: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407684: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407698: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407459: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407470: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406930: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407843: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407867: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407879: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407889: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407898: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407651: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407967: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407770: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408009: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408018: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407504: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407523: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407563: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408099: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408111: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406664: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408136: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407729: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408161: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408178: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408000: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407794: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408250: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408062: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407599: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408318: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408345: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408395: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407766: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408444: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408459: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408468: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408481: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408490: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408033: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408533: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408282: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408312: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408666: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408674: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.407996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408697: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408509: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408792: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408802: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408813: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408825: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408636: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408918: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408941: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408716: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408962: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409008: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409016: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409030: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409042: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408891: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408222: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409148: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409164: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409173: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409197: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.406320: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408845: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409247: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409265: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409275: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409293: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409303: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409376: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409406: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409220: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409221: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409461: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409089: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409512: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409551: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409562: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409588: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409613: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409431: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408870: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409656: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409066: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409683: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409694: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409717: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408984: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409400: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409816: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409620: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409638: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409860: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409094: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409706: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408964: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409929: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408292: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409738: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408361: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410014: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410055: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410066: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410088: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410125: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409952: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410273: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410284: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409989: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410307: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409808: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410344: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408937: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410395: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410416: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409880: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409883: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410470: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410486: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410496: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410167: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410521: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410538: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410575: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410588: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410601: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410609: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410364: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410434: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410697: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410712: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410204: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410546: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410767: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409797: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409503: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410368: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410865: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410888: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410898: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409855: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410970: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.408742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410978: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410510: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411004: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410775: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.409844: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411072: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411096: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411109: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410814: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411174: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411209: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411221: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411237: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411263: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411285: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411310: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411336: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411361: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411375: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411387: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411400: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410991: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410735: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411468: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411517: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411532: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411548: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411564: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411579: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411595: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410652: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411622: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411420: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411694: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410999: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411024: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411045: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411780: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411796: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411089: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410806: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411131: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411144: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411911: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411922: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411941: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411950: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411648: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411983: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411801: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412035: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412091: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412107: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411610: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.410915: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412175: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412191: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411671: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412238: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412250: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411743: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411819: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411837: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412404: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412423: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412132: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411643: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412212: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412499: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412521: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412267: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412060: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412615: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412631: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412639: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412678: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412445: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412195: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412728: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412743: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412458: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412767: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412791: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412813: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412345: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412865: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412662: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412978: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412488: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413005: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413019: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413043: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412842: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.411856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413093: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413110: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412963: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413137: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412272: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413005: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412832: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413263: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413279: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413288: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413301: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413314: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412515: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413414: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413176: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413437: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413211: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413068: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413507: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412890: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412912: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413322: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413603: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413642: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413659: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413674: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413688: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413699: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413710: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413722: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413739: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413749: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413759: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413770: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413534: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413579: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413883: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413901: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413951: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.412885: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413528: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413789: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414063: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413159: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413429: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414124: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414142: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413704: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413473: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414213: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414236: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414019: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413995: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414344: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413860: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414403: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413924: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414461: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414499: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414508: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413241: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414243: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414577: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414259: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414634: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414643: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414655: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414666: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414676: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413936: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414518: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414525: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414592: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414773: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.413799: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414817: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414830: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414839: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414424: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414375: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414164: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414573: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414766: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415031: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415045: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414277: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414601: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415098: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414860: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415194: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415209: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414725: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415311: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415333: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415319: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415360: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415051: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414808: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415403: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414430: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415484: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415231: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415579: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415593: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415601: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415638: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415658: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.414366: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415433: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415803: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415824: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415855: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415867: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415887: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415901: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415951: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415962: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415733: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416004: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416044: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415536: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416089: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416106: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416128: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415395: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415662: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416199: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416223: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416308: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416334: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416365: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415614: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416434: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415683: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416233: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416510: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415190: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415803: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416113: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416397: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415067: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416642: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416652: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416414: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416452: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415982: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416752: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416773: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416796: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.415005: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416559: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416845: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416863: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416409: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416918: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416929: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416688: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416954: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416967: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416976: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416065: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417001: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416552: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417054: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417100: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417111: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416890: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417162: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416942: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417199: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417223: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416769: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417032: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417070: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417369: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417134: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417432: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417445: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417455: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416457: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417539: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417560: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417375: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417410: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416173: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417656: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417671: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.416246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417759: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417565: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417581: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417867: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417882: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417889: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417179: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417933: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417678: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417327: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417780: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418049: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418066: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417902: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418113: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417935: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417950: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417718: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417024: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418240: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417983: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418005: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418290: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418322: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418336: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418347: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418358: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418402: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418131: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418138: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418467: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418221: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417977: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418262: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418596: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417630: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418091: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418680: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418377: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418704: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418444: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418766: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418808: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418794: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418824: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418620: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417798: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418925: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418720: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419001: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419045: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418159: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419096: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418534: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418615: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419151: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419177: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419186: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418862: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418697: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419263: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418950: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419024: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419314: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.417468: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419352: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418572: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419116: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419404: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419417: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419440: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418857: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419209: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419509: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419525: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419536: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419270: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419573: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419285: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419595: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419610: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419618: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419638: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419648: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419424: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419694: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419472: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419733: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419746: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419757: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418898: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419780: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419557: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419598: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419062: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419880: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419657: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419712: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419480: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419986: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420000: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418943: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420030: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420043: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419803: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420106: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420132: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420169: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419902: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419951: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420261: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420049: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420064: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420343: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419832: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420124: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420410: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420432: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.418834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420516: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420531: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420538: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420239: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420559: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420282: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420319: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420609: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420624: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420451: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420496: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420737: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420760: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419770: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420822: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420845: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420858: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420881: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420903: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420672: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420935: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420952: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420216: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420981: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420552: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421032: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420791: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420798: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420578: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420614: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420905: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421183: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420694: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.419946: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420959: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421278: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421048: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421098: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421402: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421142: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421426: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421442: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421204: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421224: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420209: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421264: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421531: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421001: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421576: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421591: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421599: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421395: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421162: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421643: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421669: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421681: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421701: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421729: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421756: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421785: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421802: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421822: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421446: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421466: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421909: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421935: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421720: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421615: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422039: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422070: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421837: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421876: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421693: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422181: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422197: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422223: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421961: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421986: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422327: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422017: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.420863: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421510: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421008: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422483: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422205: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422245: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422275: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422352: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422684: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422371: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422735: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422756: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422142: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422825: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422850: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422441: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422304: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422364: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423019: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.421422: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422773: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423109: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422416: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422931: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423181: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423196: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423221: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423044: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422711: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423342: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423414: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423459: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423512: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422603: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423556: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423022: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423582: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423599: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423633: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423306: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423682: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423702: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423369: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423390: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423754: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423134: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423827: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422972: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423957: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423978: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423989: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423997: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423249: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424019: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423229: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424060: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424086: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424111: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423718: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424134: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423782: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423435: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424204: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423874: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423562: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424272: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424290: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424047: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424417: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424438: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423075: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424129: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424493: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424506: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424518: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424533: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424543: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424552: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424182: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424596: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424226: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424658: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424676: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424310: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424331: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424728: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424740: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424759: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424456: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424823: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424844: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424864: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423848: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.422633: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424696: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424354: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424766: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424782: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425030: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425047: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425060: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425084: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424875: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424884: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425194: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424972: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424383: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425273: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425290: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425322: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425345: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424637: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425419: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424911: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425449: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425461: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425488: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425499: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425511: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425534: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425558: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425429: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.423774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425655: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425467: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425677: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425024: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425712: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425724: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425747: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424618: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425773: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425567: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425644: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425862: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425885: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424156: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425738: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425107: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425768: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425410: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426031: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425588: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425812: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425268: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425857: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426152: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426161: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425718: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426182: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425939: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425979: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425795: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426058: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426283: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426082: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.424153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425902: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426366: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426201: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425925: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425988: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426010: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426543: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426589: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.425673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426629: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426178: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426685: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426393: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426740: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426757: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426480: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426222: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426814: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426894: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426638: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426659: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426710: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426763: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426789: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427069: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427079: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427094: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427142: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427165: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427189: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427004: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427020: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427026: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427261: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427281: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427292: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427305: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427315: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427338: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427185: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427206: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427427: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427442: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427233: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426518: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427512: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427525: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426509: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427328: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427603: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427168: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427361: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426707: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427720: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427734: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427757: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427769: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427779: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427792: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427807: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427816: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427609: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427868: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427884: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427898: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427911: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427925: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427935: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427948: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427982: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427994: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428017: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428029: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428039: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428062: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428075: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427448: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427466: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427486: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428143: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428158: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428167: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428191: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428201: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427663: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428222: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428243: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427692: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428268: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428098: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428354: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428367: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427832: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428433: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428444: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428456: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428479: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428092: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428285: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428563: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428581: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428315: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.426564: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427378: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428683: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428713: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428451: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428754: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428781: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428814: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428830: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428598: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428390: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428676: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428740: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429001: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427901: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.427212: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428261: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428499: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428521: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429184: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428879: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429211: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429234: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429258: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429268: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429306: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429314: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429328: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429098: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429381: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429392: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429160: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429430: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429206: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429493: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429525: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429540: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429548: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429347: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429601: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429610: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429639: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429651: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429662: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429684: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429516: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429712: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429722: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429728: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429562: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429408: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429814: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429841: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429283: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429042: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429929: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429937: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429952: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429963: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429988: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429629: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430036: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430051: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430061: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430097: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429737: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429120: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430150: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429759: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430182: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430233: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430265: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430277: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430297: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430308: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430328: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430342: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430360: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430391: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430404: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430438: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.428930: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429879: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430531: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429743: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430601: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430614: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430140: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430164: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430659: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430684: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430450: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430707: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430725: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430471: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430786: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430807: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430838: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430635: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429767: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430994: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429453: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429885: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431116: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431140: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431164: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.429341: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431208: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430621: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430922: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431330: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431089: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431063: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430533: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431182: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431231: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431455: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431473: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431483: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431494: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431506: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431515: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430680: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431557: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431369: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431605: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431621: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431642: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431651: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431662: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430903: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431706: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430943: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431533: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430454: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431564: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431832: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431842: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431579: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431884: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431175: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431907: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431930: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431682: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431285: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432030: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432044: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432054: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432070: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431860: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431901: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431458: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432157: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432181: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432195: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.430574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432260: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432287: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432299: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432095: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432136: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432360: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432377: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431924: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431953: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432199: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432448: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432529: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432539: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431345: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432582: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432341: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432639: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432696: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432390: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432423: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432803: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432824: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432217: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432874: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431752: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.431797: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432560: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432989: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433000: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433010: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433062: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433092: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432751: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432776: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432842: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433196: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433216: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432895: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433261: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432601: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433312: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433334: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433027: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432714: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433114: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433418: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433429: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433453: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433470: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433234: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433504: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433526: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433551: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433578: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433639: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433648: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433176: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433710: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433736: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433768: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433793: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433817: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433600: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433842: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433865: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433888: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433898: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433911: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433925: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433934: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433783: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433957: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434005: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433369: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434031: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433377: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433462: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432552: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433283: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434148: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433946: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434185: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434215: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434055: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433677: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434071: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434296: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434124: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433019: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.432758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434025: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433664: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434499: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434245: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434266: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434631: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434661: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434684: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434698: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434710: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434722: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434434: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434754: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434478: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434777: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434275: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434829: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434845: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434349: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434391: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434933: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434946: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434739: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434748: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435014: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435022: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435049: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434816: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435081: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434316: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435108: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435132: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434396: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435154: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.433979: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434455: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434517: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435031: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435258: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435040: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435280: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435300: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435100: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434880: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435352: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435148: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435178: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434981: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435422: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435211: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435448: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435235: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435472: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435510: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435534: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434853: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435558: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435607: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435465: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434794: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435284: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.434076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435095: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435741: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435761: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435552: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435821: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435575: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435377: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435868: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435882: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435892: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435906: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435915: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435639: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435961: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435991: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436002: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436022: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436035: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436045: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435334: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436068: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435794: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436091: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435926: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436161: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435934: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436183: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435698: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436205: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435526: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436233: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436265: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436279: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436293: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436307: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436133: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436176: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436374: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436390: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436398: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436422: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435785: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436447: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436296: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435843: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436330: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436661: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436683: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436698: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436439: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436470: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436767: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436487: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436791: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436823: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436855: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436631: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436890: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436902: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436913: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436760: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435441: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436784: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436985: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436565: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436813: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.435670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436870: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437111: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437152: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437174: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436929: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436934: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437228: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437252: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437263: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437275: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437283: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437294: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437304: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436058: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437165: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437347: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437358: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436957: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437430: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437447: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437456: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437009: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437031: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437496: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437523: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437546: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437409: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437635: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437470: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437666: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437679: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437691: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436094: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437738: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437051: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437683: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437179: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437976: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.436721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437762: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437780: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438043: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437828: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438066: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438090: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438125: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437317: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438145: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437732: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438168: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438178: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437592: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438232: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438094: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437916: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438330: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437707: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438349: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437951: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438378: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438392: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438401: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438199: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438424: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438258: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438472: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438266: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438498: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438524: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438539: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438550: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438562: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438575: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438585: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438184: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438609: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438441: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438446: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438674: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438285: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438138: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438354: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438785: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438803: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438903: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438649: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438952: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438977: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438723: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439001: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438367: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437984: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438600: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438204: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438037: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439112: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439126: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439137: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439150: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439163: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439173: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438992: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439196: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439045: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439243: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439258: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439267: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439281: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439310: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439322: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439333: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439345: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439357: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439368: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439402: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439412: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439423: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439435: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439443: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439458: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438504: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438692: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438970: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439551: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.437558: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439582: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439591: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439607: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439617: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439630: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439664: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439677: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439688: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439711: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439724: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439735: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439747: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439770: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439781: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439793: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438892: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439853: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439874: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439024: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439962: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439973: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440010: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440024: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440034: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439481: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440057: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438698: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440095: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440112: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439894: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440136: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439220: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.438417: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440205: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439816: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439465: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440050: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440275: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440084: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440316: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440333: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439213: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440365: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440420: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440431: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440455: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439504: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440270: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440508: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439918: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440557: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440353: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440160: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440607: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439088: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440633: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440666: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440712: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440483: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.439889: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440760: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440781: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440536: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440576: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440582: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440198: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440875: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440921: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440674: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440692: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440465: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441041: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441067: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441079: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441093: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440155: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440855: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441144: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441158: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441165: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440898: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441002: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441229: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440737: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440806: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441270: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441285: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441299: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441115: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441344: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441360: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441384: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441396: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441408: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441422: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441431: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441453: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441479: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441488: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440895: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441567: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441578: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441590: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441257: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441470: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441657: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441674: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441682: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441319: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441706: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440428: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441748: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441762: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441772: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441010: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441225: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441890: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441181: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441953: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441962: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441787: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441986: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442015: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442039: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442062: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441726: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440446: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441941: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442133: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442148: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442157: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442169: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442181: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442189: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442003: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440830: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.440835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441701: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442299: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442310: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442086: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441572: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442378: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442402: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442421: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442446: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442456: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442229: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442288: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442538: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441977: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442599: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442621: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442662: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441913: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442717: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441215: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442770: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442797: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441812: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442822: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442845: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442886: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442901: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442912: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442928: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442737: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.441795: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442624: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442637: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443076: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443133: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443162: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443181: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443195: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443215: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443241: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443254: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442954: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443322: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443335: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443346: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443360: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443385: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442269: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442686: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443444: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443457: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443481: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443492: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443505: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443516: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443045: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443573: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443588: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443112: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443652: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442081: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443705: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443718: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443740: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442108: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443801: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443830: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443859: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443889: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443937: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442935: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443985: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444024: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444035: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444054: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444062: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443550: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444097: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443617: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443633: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444156: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443965: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443999: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443767: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444235: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444262: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443365: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444290: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444306: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444322: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444338: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444351: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444366: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444375: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444398: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444226: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444422: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444255: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444497: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444546: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444534: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444170: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444179: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444591: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443259: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444412: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444638: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444653: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444678: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444691: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444702: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444716: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444725: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444346: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444748: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444763: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444771: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444785: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444794: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.442848: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444086: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444444: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444858: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443944: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444149: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444570: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444961: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444571: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444581: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445001: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445025: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445033: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444829: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444878: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445117: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444928: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445165: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445184: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445191: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445206: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445217: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445240: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445249: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445069: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445279: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445309: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445356: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444605: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.443021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444613: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445509: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444450: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445531: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445559: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444973: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445379: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445622: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445422: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445427: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445451: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445061: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445707: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445263: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445091: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445768: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445776: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445799: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445881: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445898: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445914: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445930: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.444886: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445980: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445995: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445789: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446031: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446044: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445686: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446095: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445083: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445753: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445135: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445991: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445579: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446241: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445645: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446064: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446307: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445684: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445725: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446376: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445525: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446458: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446143: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446189: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446503: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446545: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.445389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446260: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446267: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446653: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446323: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446677: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446696: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446716: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446730: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446747: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446438: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446817: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446841: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446526: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446910: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446566: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446952: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446976: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446670: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447022: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447036: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446762: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446480: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447179: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446233: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446937: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446596: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447278: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447317: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447328: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447358: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447377: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447391: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447400: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446396: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447430: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447442: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447456: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447466: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447201: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447534: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447548: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446629: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447306: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447593: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446092: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447616: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447042: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447639: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447108: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447705: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447713: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447723: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447783: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447559: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447806: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447610: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447823: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447662: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447869: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447415: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447891: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447732: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447914: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447930: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447942: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447957: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447570: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447979: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448002: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.446116: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448030: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448018: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448058: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447664: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448083: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448093: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448108: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448143: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448155: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448166: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448179: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447843: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448211: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448079: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447887: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448300: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447498: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448336: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448360: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448384: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448047: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448420: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448430: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448442: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448453: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447953: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448483: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447973: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448531: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448565: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448581: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448591: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447151: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448634: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448658: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448478: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447801: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448731: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448743: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448203: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448398: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448808: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448226: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448642: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448876: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448889: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448898: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448909: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448940: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448965: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448977: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448234: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448827: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449043: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449058: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449067: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449092: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449121: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449132: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447634: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449163: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448783: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449210: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449002: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449234: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448841: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449259: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448684: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449310: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449150: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449181: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449374: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449234: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448865: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449449: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449462: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449484: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449283: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449506: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449528: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449366: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449394: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449400: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449668: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449277: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449732: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449753: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448352: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449807: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449820: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449829: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449844: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449867: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449880: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449890: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449912: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449641: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449942: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449958: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449986: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450002: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450029: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450045: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450056: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450070: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449376: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450105: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450116: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449422: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.447743: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449711: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448702: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449771: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450249: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449567: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450315: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450095: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450379: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450402: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450411: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450424: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450430: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450162: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450223: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.448765: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450267: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450543: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450562: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450291: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450333: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449022: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449607: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450674: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.449907: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450715: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450450: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450778: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450495: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450517: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450565: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450864: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450272: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450931: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450951: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450976: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450134: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450645: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451021: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450651: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450694: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451063: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450747: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451131: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450455: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451175: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451197: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450803: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450827: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451248: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451267: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451286: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451297: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451311: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451327: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450994: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451042: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451409: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451429: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451449: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450746: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451503: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451215: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451557: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451625: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450955: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451387: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451713: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451459: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451110: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451782: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451828: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451529: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451574: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451918: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451939: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451336: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451981: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451093: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451053: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452030: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452054: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452089: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452099: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452111: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450897: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451888: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452163: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451581: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452214: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452236: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452001: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452281: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451736: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452070: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451511: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452368: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.450844: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452417: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452430: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452441: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452453: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452467: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452190: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451961: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452562: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451718: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452300: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452632: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452117: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451883: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452722: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452425: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452746: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452761: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.451640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452495: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452870: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452916: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452305: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452333: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452983: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452659: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453032: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452739: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453062: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452828: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453164: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452528: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452888: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453216: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453229: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453239: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453264: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453279: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453289: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453315: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453340: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452785: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453372: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453387: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453411: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453424: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453435: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453449: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453459: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453475: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453482: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453052: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453507: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453346: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453577: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453597: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452584: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453633: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452963: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452642: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453681: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453004: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453706: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453728: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453798: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453617: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453882: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453909: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453938: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453699: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453965: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453524: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454047: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454079: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454093: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454110: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454128: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454155: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453651: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453657: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454205: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454223: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454353: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454365: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454376: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454391: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453824: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454424: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453847: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.452132: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454489: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454502: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454508: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454533: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454564: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454573: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454068: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454598: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454643: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454659: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454481: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454693: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454729: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454297: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454775: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454800: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454417: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454451: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454861: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454679: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454228: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454997: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454018: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454748: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454752: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455097: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455110: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454132: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455141: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454817: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454172: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455192: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455218: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455226: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454967: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455018: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453988: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455311: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.453253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455336: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455133: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455155: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455408: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455417: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455446: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455454: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455476: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455503: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455517: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455533: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455570: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454902: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455261: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455661: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455673: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455035: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455697: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455711: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455722: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455732: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455367: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455751: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455779: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455168: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455824: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455834: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455612: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455859: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455288: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455690: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455065: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455924: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.454795: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455758: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455974: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455984: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456005: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456020: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456031: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456043: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456053: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455876: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456097: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456108: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455946: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455577: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456188: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455998: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456213: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456294: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456072: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455882: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456341: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455899: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456129: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456400: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456410: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456420: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456208: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455595: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456230: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456236: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456258: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456520: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456537: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456544: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455461: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456591: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456146: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456623: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455798: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456433: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456438: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456691: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456706: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456458: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456499: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456313: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456067: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456786: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.455334: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456829: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456167: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456874: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456902: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456711: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456767: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456561: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456807: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457009: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457025: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457032: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456644: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457060: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457077: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457084: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456479: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457109: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457125: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457133: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456942: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457207: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457046: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456648: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457277: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456669: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457297: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457322: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457148: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457346: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456947: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457370: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456363: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456823: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457217: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457234: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457463: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457472: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457102: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457500: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457514: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457522: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457315: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457545: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457559: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457567: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457163: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457589: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457610: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457417: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457644: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457652: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457304: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457691: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457539: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457717: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457173: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457393: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457822: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457253: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457849: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457874: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.456919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457930: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457943: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457740: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457760: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457801: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457636: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458059: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457868: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458105: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457682: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458128: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457708: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458150: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458177: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458164: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458192: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457735: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457781: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458017: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458311: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458329: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458084: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458393: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458402: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457912: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457339: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458446: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457361: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458465: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.457963: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458490: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458506: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458262: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458288: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458334: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458584: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458596: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458620: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458631: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458644: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458654: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458667: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458677: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458690: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458700: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458718: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458728: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458741: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458751: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458764: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458774: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458787: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458797: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458470: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458481: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458860: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458218: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458512: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458919: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458529: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458945: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458567: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458969: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458413: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458420: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459054: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459075: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458833: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458840: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459122: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459137: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459155: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458034: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458939: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459201: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458080: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458352: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458992: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459014: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459321: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459337: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459091: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458213: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458890: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459418: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459426: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459436: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459464: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459478: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459246: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459530: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459296: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459033: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459343: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459619: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459357: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459380: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459160: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459685: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459448: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459708: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459721: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459179: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458962: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459509: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459792: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459814: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459555: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459576: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459885: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459643: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459702: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459223: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460060: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459765: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459486: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460103: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458988: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459842: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459864: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460228: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460242: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460250: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459908: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460285: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460299: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460012: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460036: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460350: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460078: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460135: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460167: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460456: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.458821: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460480: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460265: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460525: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460308: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459777: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460584: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460368: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460407: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460640: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460274: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460505: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459664: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460712: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460725: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460737: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460751: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460761: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460772: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460786: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460431: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460622: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460832: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460219: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460857: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460664: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460904: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460915: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460928: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460937: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460547: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460983: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461009: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460793: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460485: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460647: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461057: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461073: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461081: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460519: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460541: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460565: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460599: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461179: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461189: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461204: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461213: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461027: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461237: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461251: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460688: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461260: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461288: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461314: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461303: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460951: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461342: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461357: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460390: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460810: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460850: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461447: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461229: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461502: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461524: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461050: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.460874: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461096: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461585: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461118: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461614: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461629: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461362: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461695: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461719: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461729: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461404: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461750: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461472: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461775: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461790: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461799: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461542: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.459451: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461851: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461865: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461876: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461332: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461666: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461930: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461165: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461366: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461384: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462013: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461467: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461781: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462057: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461563: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461634: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462157: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461896: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462180: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461907: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462208: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461985: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461990: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462262: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462278: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462295: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461818: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462345: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462175: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461947: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462411: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462423: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461951: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462445: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461742: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462034: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462496: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461037: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462549: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462113: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.461604: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462609: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462638: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462193: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462675: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462689: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462698: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462716: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462726: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462755: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462768: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462782: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462795: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462302: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462836: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462369: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462390: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462897: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462434: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462952: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462975: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462232: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462466: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462469: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463063: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463093: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463101: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462515: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463126: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463139: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462132: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463196: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462580: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463247: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462858: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462918: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462231: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462993: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463405: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463426: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462074: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463117: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463473: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462527: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463144: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463543: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463163: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463567: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463584: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463596: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463604: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462927: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463628: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463642: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463650: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463662: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463669: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463682: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463029: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463733: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463744: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463220: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463767: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462855: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463786: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463620: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463811: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463320: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463386: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463444: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463496: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463699: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463703: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463936: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463760: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463562: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463987: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463270: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464033: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463804: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463316: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463829: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464100: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463355: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464123: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464145: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464159: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463852: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464187: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464178: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464212: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463914: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463960: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464250: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464005: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464011: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464054: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464075: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464359: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464373: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464382: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463840: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464426: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463893: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.462825: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464473: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464229: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464543: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464255: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464276: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464629: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464649: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464325: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464390: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464727: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464401: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463872: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464770: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.463956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464793: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464817: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464237: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464845: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464606: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464875: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464298: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464665: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464932: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464949: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464745: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464448: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464206: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465018: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465037: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464809: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464518: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465085: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465104: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464897: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465217: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465259: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464701: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464955: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465308: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465326: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464788: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465041: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464566: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465397: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464835: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465423: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465439: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464870: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464909: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465490: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465280: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464971: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465539: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465554: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465563: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465572: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465585: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465061: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465112: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465656: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465416: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465677: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465697: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465182: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465468: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465510: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465767: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465784: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465515: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.464992: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465856: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465864: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465590: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465886: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465902: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465634: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465674: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465952: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465966: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465972: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465986: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465704: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465789: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466047: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465821: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465880: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465608: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466112: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466127: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466138: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466147: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465374: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465130: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465923: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466227: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465445: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466271: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465743: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466006: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466329: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466069: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466091: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466389: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465333: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466414: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465906: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466435: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466451: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466467: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466477: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466247: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466498: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466293: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466518: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466348: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465239: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466563: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466577: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466587: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466601: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466611: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466200: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466441: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466646: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466491: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.465997: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466697: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466513: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466725: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466551: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466369: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466408: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466161: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466171: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466831: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466846: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466854: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466866: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466890: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466900: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466667: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466920: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466311: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466956: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466942: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466979: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466743: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466968: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466768: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467020: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467028: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466805: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466633: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466209: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467095: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467112: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467119: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467133: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467144: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467153: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466996: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467174: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466786: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467027: F lingvo/core/ops/simple_vocab.cc:63] Non-OK-status: Env::Default()->GetMatchingPaths(vocab_glob, &vocab_filenames) status: Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output; No such file or directoryUnable to match vocab pattern: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/vocab.txt 2019-04-23 04:04:30.466627: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467035: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467048: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467303: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467316: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466663: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467351: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467369: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467399: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467428: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.466540: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467483: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467501: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467518: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467535: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467552: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467569: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467586: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467602: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467626: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467660: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467685: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467709: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory 2019-04-23 04:04:30.467733: W lingvo/core/ops/record_batcher.cc:274] Not found: /tmp/lm1b/1-billion-word-language-modeling-benchmark-r13output/training-monolingual.tokenized.shuffled; No such file or directory Aborted (core dumped)