Mem. usage decreased to 861.82 Mb (68.5% reduction) Mem. usage decreased to 430.10 Mb (68.8% reduction) Mem. usage decreased to 932.89 Mb (21.1% reduction) Mem. usage decreased to 468.34 Mb (22.2% reduction) Fold 1 started at Sun Jun 9 19:29:50 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.00394 valid_1's l1: 1.04714 [1000] training's l1: 0.875392 valid_1's l1: 0.947458 [1500] training's l1: 0.798666 valid_1's l1: 0.894978 [2000] training's l1: 0.743384 valid_1's l1: 0.861662 [2500] training's l1: 0.698186 valid_1's l1: 0.835777 [3000] training's l1: 0.66179 valid_1's l1: 0.816979 [3500] training's l1: 0.629892 valid_1's l1: 0.80096 [4000] training's l1: 0.602321 valid_1's l1: 0.78859 [4500] training's l1: 0.577644 valid_1's l1: 0.778103 [5000] training's l1: 0.555214 valid_1's l1: 0.768807 [5500] training's l1: 0.534846 valid_1's l1: 0.760744 [6000] training's l1: 0.516132 valid_1's l1: 0.753666 [6500] training's l1: 0.498581 valid_1's l1: 0.747307 [7000] training's l1: 0.482019 valid_1's l1: 0.741292 [7500] training's l1: 0.466867 valid_1's l1: 0.736258 [8000] training's l1: 0.45257 valid_1's l1: 0.731695 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.45257 valid_1's l1: 0.731695 Fold 2 started at Sun Jun 9 19:43:18 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.00063 valid_1's l1: 1.04643 [1000] training's l1: 0.877343 valid_1's l1: 0.951973 [1500] training's l1: 0.799083 valid_1's l1: 0.897885 [2000] training's l1: 0.742944 valid_1's l1: 0.863767 [2500] training's l1: 0.698114 valid_1's l1: 0.838316 [3000] training's l1: 0.661734 valid_1's l1: 0.819188 [3500] training's l1: 0.629844 valid_1's l1: 0.8033 [4000] training's l1: 0.601585 valid_1's l1: 0.789986 [4500] training's l1: 0.577083 valid_1's l1: 0.779424 [5000] training's l1: 0.554928 valid_1's l1: 0.770495 [5500] training's l1: 0.534481 valid_1's l1: 0.762502 [6000] training's l1: 0.515643 valid_1's l1: 0.755437 [6500] training's l1: 0.497972 valid_1's l1: 0.749173 [7000] training's l1: 0.481526 valid_1's l1: 0.74322 [7500] training's l1: 0.46621 valid_1's l1: 0.738115 [8000] training's l1: 0.452034 valid_1's l1: 0.733712 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.452034 valid_1's l1: 0.733712 Fold 3 started at Sun Jun 9 19:57:49 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.00004 valid_1's l1: 1.04423 [1000] training's l1: 0.872593 valid_1's l1: 0.945539 [1500] training's l1: 0.796632 valid_1's l1: 0.89451 [2000] training's l1: 0.740931 valid_1's l1: 0.860675 [2500] training's l1: 0.696401 valid_1's l1: 0.836021 [3000] training's l1: 0.660002 valid_1's l1: 0.817258 [3500] training's l1: 0.628531 valid_1's l1: 0.8017 [4000] training's l1: 0.600901 valid_1's l1: 0.788832 [4500] training's l1: 0.575974 valid_1's l1: 0.777801 [5000] training's l1: 0.553621 valid_1's l1: 0.768703 [5500] training's l1: 0.533299 valid_1's l1: 0.760762 [6000] training's l1: 0.514414 valid_1's l1: 0.753591 [6500] training's l1: 0.496846 valid_1's l1: 0.746914 [7000] training's l1: 0.480663 valid_1's l1: 0.741465 [7500] training's l1: 0.465451 valid_1's l1: 0.736261 [8000] training's l1: 0.451241 valid_1's l1: 0.731765 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.451241 valid_1's l1: 0.731765 Fold 4 started at Sun Jun 9 20:12:17 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.00274 valid_1's l1: 1.04641 [1000] training's l1: 0.877523 valid_1's l1: 0.950295 [1500] training's l1: 0.798657 valid_1's l1: 0.89666 [2000] training's l1: 0.742359 valid_1's l1: 0.862374 [2500] training's l1: 0.698988 valid_1's l1: 0.838627 [3000] training's l1: 0.662068 valid_1's l1: 0.818953 [3500] training's l1: 0.630593 valid_1's l1: 0.803536 [4000] training's l1: 0.602493 valid_1's l1: 0.790434 [4500] training's l1: 0.577461 valid_1's l1: 0.779497 [5000] training's l1: 0.555046 valid_1's l1: 0.770168 [5500] training's l1: 0.534771 valid_1's l1: 0.762337 [6000] training's l1: 0.516004 valid_1's l1: 0.755308 [6500] training's l1: 0.498329 valid_1's l1: 0.748737 [7000] training's l1: 0.482085 valid_1's l1: 0.743114 [7500] training's l1: 0.466868 valid_1's l1: 0.738118 [8000] training's l1: 0.45254 valid_1's l1: 0.733674 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.45254 valid_1's l1: 0.733674 Fold 5 started at Sun Jun 9 20:26:34 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.00147 valid_1's l1: 1.04993 [1000] training's l1: 0.875209 valid_1's l1: 0.95279 [1500] training's l1: 0.798125 valid_1's l1: 0.899453 [2000] training's l1: 0.74229 valid_1's l1: 0.864327 [2500] training's l1: 0.698739 valid_1's l1: 0.840283 [3000] training's l1: 0.661555 valid_1's l1: 0.820025 [3500] training's l1: 0.630056 valid_1's l1: 0.804563 [4000] training's l1: 0.602506 valid_1's l1: 0.791789 [4500] training's l1: 0.577961 valid_1's l1: 0.78114 [5000] training's l1: 0.555449 valid_1's l1: 0.771665 [5500] training's l1: 0.535027 valid_1's l1: 0.763696 [6000] training's l1: 0.515769 valid_1's l1: 0.756092 [6500] training's l1: 0.498052 valid_1's l1: 0.749475 [7000] training's l1: 0.481946 valid_1's l1: 0.743962 [7500] training's l1: 0.466899 valid_1's l1: 0.738997 [8000] training's l1: 0.452809 valid_1's l1: 0.73457 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.452809 valid_1's l1: 0.73457 CV mean score: -0.4563, std: 0.0009. Training of type 0 Fold 1 started at Sun Jun 9 20:40:38 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.20856 valid_1's l1: 1.42404 [1000] training's l1: 1.01606 valid_1's l1: 1.39948 [1500] training's l1: 0.864538 valid_1's l1: 1.38091 [2000] training's l1: 0.743407 valid_1's l1: 1.36601 [2500] training's l1: 0.643935 valid_1's l1: 1.35289 [3000] training's l1: 0.561855 valid_1's l1: 1.34263 [3500] training's l1: 0.492636 valid_1's l1: 1.33483 [4000] training's l1: 0.434229 valid_1's l1: 1.3279 [4500] training's l1: 0.383928 valid_1's l1: 1.32235 [5000] training's l1: 0.340097 valid_1's l1: 1.31772 [5500] training's l1: 0.302916 valid_1's l1: 1.31387 [6000] training's l1: 0.270027 valid_1's l1: 1.31071 [6500] training's l1: 0.241434 valid_1's l1: 1.30799 [7000] training's l1: 0.216108 valid_1's l1: 1.30571 [7500] training's l1: 0.193939 valid_1's l1: 1.30379 [8000] training's l1: 0.174324 valid_1's l1: 1.30245 [8500] training's l1: 0.156865 valid_1's l1: 1.30104 [9000] training's l1: 0.141451 valid_1's l1: 1.29992 [9500] training's l1: 0.127666 valid_1's l1: 1.29896 [10000] training's l1: 0.115354 valid_1's l1: 1.29814 [10500] training's l1: 0.104394 valid_1's l1: 1.29739 [11000] training's l1: 0.0946156 valid_1's l1: 1.29673 [11500] training's l1: 0.0857716 valid_1's l1: 1.29626 [12000] training's l1: 0.077867 valid_1's l1: 1.29574 [12500] training's l1: 0.0707177 valid_1's l1: 1.29524 [13000] training's l1: 0.0643054 valid_1's l1: 1.29487 [13500] training's l1: 0.058505 valid_1's l1: 1.29459 [14000] training's l1: 0.0532429 valid_1's l1: 1.2943 [14500] training's l1: 0.0485062 valid_1's l1: 1.29406 [15000] training's l1: 0.0442537 valid_1's l1: 1.29388 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0442537 valid_1's l1: 1.29388 Fold 2 started at Sun Jun 9 20:48:03 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.20138 valid_1's l1: 1.42247 [1000] training's l1: 1.00847 valid_1's l1: 1.39822 [1500] training's l1: 0.857665 valid_1's l1: 1.37976 [2000] training's l1: 0.737066 valid_1's l1: 1.36411 [2500] training's l1: 0.639566 valid_1's l1: 1.35226 [3000] training's l1: 0.557447 valid_1's l1: 1.34265 [3500] training's l1: 0.488527 valid_1's l1: 1.33544 [4000] training's l1: 0.430733 valid_1's l1: 1.32865 [4500] training's l1: 0.380912 valid_1's l1: 1.32334 [5000] training's l1: 0.338127 valid_1's l1: 1.31909 [5500] training's l1: 0.300582 valid_1's l1: 1.31564 [6000] training's l1: 0.267917 valid_1's l1: 1.31248 [6500] training's l1: 0.239744 valid_1's l1: 1.30982 [7000] training's l1: 0.214791 valid_1's l1: 1.3077 [7500] training's l1: 0.192734 valid_1's l1: 1.30595 [8000] training's l1: 0.173156 valid_1's l1: 1.30451 [8500] training's l1: 0.15588 valid_1's l1: 1.30311 [9000] training's l1: 0.140496 valid_1's l1: 1.30204 [9500] training's l1: 0.12683 valid_1's l1: 1.3009 [10000] training's l1: 0.114585 valid_1's l1: 1.30004 [10500] training's l1: 0.10369 valid_1's l1: 1.29934 [11000] training's l1: 0.0938863 valid_1's l1: 1.29864 [11500] training's l1: 0.0850638 valid_1's l1: 1.29808 [12000] training's l1: 0.0771541 valid_1's l1: 1.29759 [12500] training's l1: 0.0700855 valid_1's l1: 1.29717 [13000] training's l1: 0.0637421 valid_1's l1: 1.2968 [13500] training's l1: 0.0579272 valid_1's l1: 1.29648 [14000] training's l1: 0.0527014 valid_1's l1: 1.29622 [14500] training's l1: 0.0480195 valid_1's l1: 1.29597 [15000] training's l1: 0.0437393 valid_1's l1: 1.29573 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0437393 valid_1's l1: 1.29573 Fold 3 started at Sun Jun 9 20:55:26 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.19745 valid_1's l1: 1.42954 [1000] training's l1: 1.00492 valid_1's l1: 1.40279 [1500] training's l1: 0.853692 valid_1's l1: 1.38235 [2000] training's l1: 0.733446 valid_1's l1: 1.36546 [2500] training's l1: 0.635683 valid_1's l1: 1.35307 [3000] training's l1: 0.55482 valid_1's l1: 1.34352 [3500] training's l1: 0.48637 valid_1's l1: 1.33496 [4000] training's l1: 0.427963 valid_1's l1: 1.32824 [4500] training's l1: 0.378844 valid_1's l1: 1.32249 [5000] training's l1: 0.336129 valid_1's l1: 1.31788 [5500] training's l1: 0.298808 valid_1's l1: 1.31433 [6000] training's l1: 0.266501 valid_1's l1: 1.31121 [6500] training's l1: 0.238021 valid_1's l1: 1.30865 [7000] training's l1: 0.213239 valid_1's l1: 1.30669 [7500] training's l1: 0.191305 valid_1's l1: 1.30494 [8000] training's l1: 0.171925 valid_1's l1: 1.30328 [8500] training's l1: 0.154837 valid_1's l1: 1.30207 [9000] training's l1: 0.139526 valid_1's l1: 1.30089 [9500] training's l1: 0.126023 valid_1's l1: 1.29993 [10000] training's l1: 0.113771 valid_1's l1: 1.29907 [10500] training's l1: 0.10286 valid_1's l1: 1.29837 [11000] training's l1: 0.0930784 valid_1's l1: 1.2977 [11500] training's l1: 0.0843754 valid_1's l1: 1.29714 [12000] training's l1: 0.0765512 valid_1's l1: 1.29665 [12500] training's l1: 0.069512 valid_1's l1: 1.29619 [13000] training's l1: 0.0631865 valid_1's l1: 1.29578 [13500] training's l1: 0.057519 valid_1's l1: 1.2955 [14000] training's l1: 0.0523694 valid_1's l1: 1.29519 [14500] training's l1: 0.0476846 valid_1's l1: 1.29486 [15000] training's l1: 0.0434622 valid_1's l1: 1.29467 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0434622 valid_1's l1: 1.29467 Fold 4 started at Sun Jun 9 21:02:45 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.20621 valid_1's l1: 1.42945 [1000] training's l1: 1.01233 valid_1's l1: 1.40428 [1500] training's l1: 0.86405 valid_1's l1: 1.38612 [2000] training's l1: 0.742456 valid_1's l1: 1.36986 [2500] training's l1: 0.643246 valid_1's l1: 1.35702 [3000] training's l1: 0.560892 valid_1's l1: 1.34677 [3500] training's l1: 0.491237 valid_1's l1: 1.33848 [4000] training's l1: 0.43281 valid_1's l1: 1.33238 [4500] training's l1: 0.38303 valid_1's l1: 1.32771 [5000] training's l1: 0.339519 valid_1's l1: 1.32307 [5500] training's l1: 0.302276 valid_1's l1: 1.31935 [6000] training's l1: 0.269738 valid_1's l1: 1.31664 [6500] training's l1: 0.241417 valid_1's l1: 1.31381 [7000] training's l1: 0.21598 valid_1's l1: 1.31181 [7500] training's l1: 0.193805 valid_1's l1: 1.30974 [8000] training's l1: 0.174313 valid_1's l1: 1.30807 [8500] training's l1: 0.156945 valid_1's l1: 1.30682 [9000] training's l1: 0.141426 valid_1's l1: 1.30551 [9500] training's l1: 0.127701 valid_1's l1: 1.30452 [10000] training's l1: 0.115378 valid_1's l1: 1.30369 [10500] training's l1: 0.104337 valid_1's l1: 1.30295 [11000] training's l1: 0.0945102 valid_1's l1: 1.30227 [11500] training's l1: 0.0856327 valid_1's l1: 1.30162 [12000] training's l1: 0.0776288 valid_1's l1: 1.30103 [12500] training's l1: 0.0704744 valid_1's l1: 1.30062 [13000] training's l1: 0.0640075 valid_1's l1: 1.3003 [13500] training's l1: 0.0582028 valid_1's l1: 1.30001 [14000] training's l1: 0.0529458 valid_1's l1: 1.29973 [14500] training's l1: 0.048233 valid_1's l1: 1.29952 [15000] training's l1: 0.0439662 valid_1's l1: 1.29931 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0439662 valid_1's l1: 1.29931 Fold 5 started at Sun Jun 9 21:10:02 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 1.20502 valid_1's l1: 1.42955 [1000] training's l1: 1.00917 valid_1's l1: 1.40356 [1500] training's l1: 0.859455 valid_1's l1: 1.38414 [2000] training's l1: 0.73907 valid_1's l1: 1.36925 [2500] training's l1: 0.639174 valid_1's l1: 1.35691 [3000] training's l1: 0.556864 valid_1's l1: 1.34628 [3500] training's l1: 0.488372 valid_1's l1: 1.33781 [4000] training's l1: 0.430885 valid_1's l1: 1.3316 [4500] training's l1: 0.381317 valid_1's l1: 1.32653 [5000] training's l1: 0.338303 valid_1's l1: 1.32239 [5500] training's l1: 0.300863 valid_1's l1: 1.31913 [6000] training's l1: 0.268455 valid_1's l1: 1.316 [6500] training's l1: 0.239967 valid_1's l1: 1.31373 [7000] training's l1: 0.214943 valid_1's l1: 1.31162 [7500] training's l1: 0.192785 valid_1's l1: 1.30989 [8000] training's l1: 0.17338 valid_1's l1: 1.30832 [8500] training's l1: 0.156166 valid_1's l1: 1.3072 [9000] training's l1: 0.140821 valid_1's l1: 1.30601 [9500] training's l1: 0.127113 valid_1's l1: 1.30492 [10000] training's l1: 0.114826 valid_1's l1: 1.30403 [10500] training's l1: 0.10384 valid_1's l1: 1.30325 [11000] training's l1: 0.0940142 valid_1's l1: 1.3026 [11500] training's l1: 0.0852043 valid_1's l1: 1.30203 [12000] training's l1: 0.0772498 valid_1's l1: 1.30154 [12500] training's l1: 0.0701706 valid_1's l1: 1.30108 [13000] training's l1: 0.0637352 valid_1's l1: 1.30064 [13500] training's l1: 0.0579132 valid_1's l1: 1.30031 [14000] training's l1: 0.052731 valid_1's l1: 1.30004 [14500] training's l1: 0.0480274 valid_1's l1: 1.29983 [15000] training's l1: 0.0438149 valid_1's l1: 1.29963 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0438149 valid_1's l1: 1.29963 CV mean score: 0.2598, std: 0.0018. Training of type 3 Fold 1 started at Sun Jun 9 21:17:31 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.255053 valid_1's l1: 0.338954 [1000] training's l1: 0.18074 valid_1's l1: 0.316953 [1500] training's l1: 0.136562 valid_1's l1: 0.306482 [2000] training's l1: 0.107272 valid_1's l1: 0.301244 [2500] training's l1: 0.0859311 valid_1's l1: 0.298177 [3000] training's l1: 0.0694918 valid_1's l1: 0.296255 [3500] training's l1: 0.0567687 valid_1's l1: 0.294855 [4000] training's l1: 0.0466909 valid_1's l1: 0.293858 [4500] training's l1: 0.0387797 valid_1's l1: 0.293188 [5000] training's l1: 0.0322816 valid_1's l1: 0.292705 [5500] training's l1: 0.0270129 valid_1's l1: 0.292336 [6000] training's l1: 0.0226745 valid_1's l1: 0.292035 [6500] training's l1: 0.0191057 valid_1's l1: 0.291802 [7000] training's l1: 0.0161792 valid_1's l1: 0.291643 [7500] training's l1: 0.013783 valid_1's l1: 0.291531 [8000] training's l1: 0.0117846 valid_1's l1: 0.291411 [8500] training's l1: 0.0101171 valid_1's l1: 0.291296 [9000] training's l1: 0.00873852 valid_1's l1: 0.291223 [9500] training's l1: 0.00758674 valid_1's l1: 0.291172 [10000] training's l1: 0.00664684 valid_1's l1: 0.291124 [10500] training's l1: 0.00584269 valid_1's l1: 0.291089 [11000] training's l1: 0.00515783 valid_1's l1: 0.291063 [11500] training's l1: 0.00457537 valid_1's l1: 0.291035 [12000] training's l1: 0.00408263 valid_1's l1: 0.291012 [12500] training's l1: 0.00366928 valid_1's l1: 0.290993 [13000] training's l1: 0.00331498 valid_1's l1: 0.290983 [13500] training's l1: 0.00301304 valid_1's l1: 0.290966 [14000] training's l1: 0.00275299 valid_1's l1: 0.29095 [14500] training's l1: 0.00252856 valid_1's l1: 0.290938 [15000] training's l1: 0.0023325 valid_1's l1: 0.290928 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0023325 valid_1's l1: 0.290928 Fold 2 started at Sun Jun 9 21:24:28 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.252431 valid_1's l1: 0.341809 [1000] training's l1: 0.179845 valid_1's l1: 0.320328 [1500] training's l1: 0.136697 valid_1's l1: 0.310579 [2000] training's l1: 0.107303 valid_1's l1: 0.304922 [2500] training's l1: 0.085819 valid_1's l1: 0.301616 [3000] training's l1: 0.0694613 valid_1's l1: 0.299491 [3500] training's l1: 0.0567425 valid_1's l1: 0.298115 [4000] training's l1: 0.0467245 valid_1's l1: 0.297204 [4500] training's l1: 0.0387247 valid_1's l1: 0.296503 [5000] training's l1: 0.0322164 valid_1's l1: 0.295991 [5500] training's l1: 0.0269488 valid_1's l1: 0.295636 [6000] training's l1: 0.0226371 valid_1's l1: 0.295365 [6500] training's l1: 0.0190848 valid_1's l1: 0.295156 [7000] training's l1: 0.016173 valid_1's l1: 0.294989 [7500] training's l1: 0.0137692 valid_1's l1: 0.294847 [8000] training's l1: 0.0117684 valid_1's l1: 0.294712 [8500] training's l1: 0.0101075 valid_1's l1: 0.294606 [9000] training's l1: 0.00872829 valid_1's l1: 0.294536 [9500] training's l1: 0.00757076 valid_1's l1: 0.29447 [10000] training's l1: 0.00661298 valid_1's l1: 0.294426 [10500] training's l1: 0.00579976 valid_1's l1: 0.294385 [11000] training's l1: 0.00512781 valid_1's l1: 0.294345 [11500] training's l1: 0.00455295 valid_1's l1: 0.294321 [12000] training's l1: 0.00406577 valid_1's l1: 0.294297 [12500] training's l1: 0.00365306 valid_1's l1: 0.294278 [13000] training's l1: 0.00329911 valid_1's l1: 0.294261 [13500] training's l1: 0.00299582 valid_1's l1: 0.294244 [14000] training's l1: 0.00273898 valid_1's l1: 0.29423 [14500] training's l1: 0.00251309 valid_1's l1: 0.294217 [15000] training's l1: 0.00231665 valid_1's l1: 0.294207 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00231665 valid_1's l1: 0.294207 Fold 3 started at Sun Jun 9 21:31:23 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.252605 valid_1's l1: 0.341565 [1000] training's l1: 0.180175 valid_1's l1: 0.319638 [1500] training's l1: 0.137037 valid_1's l1: 0.309262 [2000] training's l1: 0.107165 valid_1's l1: 0.303697 [2500] training's l1: 0.0856711 valid_1's l1: 0.300525 [3000] training's l1: 0.069537 valid_1's l1: 0.298545 [3500] training's l1: 0.0567831 valid_1's l1: 0.297308 [4000] training's l1: 0.0468065 valid_1's l1: 0.296307 [4500] training's l1: 0.0388095 valid_1's l1: 0.295619 [5000] training's l1: 0.0323105 valid_1's l1: 0.295183 [5500] training's l1: 0.0270323 valid_1's l1: 0.294753 [6000] training's l1: 0.0227203 valid_1's l1: 0.294492 [6500] training's l1: 0.01918 valid_1's l1: 0.294217 [7000] training's l1: 0.0162573 valid_1's l1: 0.294045 [7500] training's l1: 0.013851 valid_1's l1: 0.293903 [8000] training's l1: 0.0118424 valid_1's l1: 0.29381 [8500] training's l1: 0.0101683 valid_1's l1: 0.293742 [9000] training's l1: 0.00877076 valid_1's l1: 0.293668 [9500] training's l1: 0.00761162 valid_1's l1: 0.293603 [10000] training's l1: 0.00667234 valid_1's l1: 0.293555 [10500] training's l1: 0.00586943 valid_1's l1: 0.293512 [11000] training's l1: 0.00517774 valid_1's l1: 0.293479 [11500] training's l1: 0.00459136 valid_1's l1: 0.293449 [12000] training's l1: 0.00409485 valid_1's l1: 0.293425 [12500] training's l1: 0.0036753 valid_1's l1: 0.293404 [13000] training's l1: 0.00331794 valid_1's l1: 0.293389 [13500] training's l1: 0.00301302 valid_1's l1: 0.293378 [14000] training's l1: 0.00274809 valid_1's l1: 0.293367 [14500] training's l1: 0.00252123 valid_1's l1: 0.293358 [15000] training's l1: 0.00232356 valid_1's l1: 0.293349 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00232356 valid_1's l1: 0.293349 Fold 4 started at Sun Jun 9 21:38:08 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.252109 valid_1's l1: 0.34075 [1000] training's l1: 0.179953 valid_1's l1: 0.319104 [1500] training's l1: 0.136582 valid_1's l1: 0.309123 [2000] training's l1: 0.107674 valid_1's l1: 0.303933 [2500] training's l1: 0.0861257 valid_1's l1: 0.300777 [3000] training's l1: 0.0697592 valid_1's l1: 0.298795 [3500] training's l1: 0.0571558 valid_1's l1: 0.297544 [4000] training's l1: 0.0470501 valid_1's l1: 0.296634 [4500] training's l1: 0.0390276 valid_1's l1: 0.295896 [5000] training's l1: 0.032467 valid_1's l1: 0.295305 [5500] training's l1: 0.0271198 valid_1's l1: 0.294925 [6000] training's l1: 0.0228047 valid_1's l1: 0.294667 [6500] training's l1: 0.0192461 valid_1's l1: 0.29442 [7000] training's l1: 0.0163293 valid_1's l1: 0.29427 [7500] training's l1: 0.0138994 valid_1's l1: 0.294126 [8000] training's l1: 0.0118731 valid_1's l1: 0.294025 [8500] training's l1: 0.0101948 valid_1's l1: 0.293953 [9000] training's l1: 0.00878973 valid_1's l1: 0.293875 [9500] training's l1: 0.00761585 valid_1's l1: 0.293805 [10000] training's l1: 0.0066449 valid_1's l1: 0.29375 [10500] training's l1: 0.00583223 valid_1's l1: 0.293709 [11000] training's l1: 0.00514436 valid_1's l1: 0.293682 [11500] training's l1: 0.00456666 valid_1's l1: 0.293651 [12000] training's l1: 0.00407284 valid_1's l1: 0.293625 [12500] training's l1: 0.00366165 valid_1's l1: 0.293607 [13000] training's l1: 0.00330596 valid_1's l1: 0.29359 [13500] training's l1: 0.00300129 valid_1's l1: 0.293575 [14000] training's l1: 0.00274332 valid_1's l1: 0.29356 [14500] training's l1: 0.00251514 valid_1's l1: 0.293552 [15000] training's l1: 0.00231759 valid_1's l1: 0.293543 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00231759 valid_1's l1: 0.293543 Fold 5 started at Sun Jun 9 21:44:51 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.252617 valid_1's l1: 0.342036 [1000] training's l1: 0.1794 valid_1's l1: 0.319989 [1500] training's l1: 0.13567 valid_1's l1: 0.309886 [2000] training's l1: 0.106617 valid_1's l1: 0.304704 [2500] training's l1: 0.0851861 valid_1's l1: 0.301386 [3000] training's l1: 0.068809 valid_1's l1: 0.299192 [3500] training's l1: 0.0562866 valid_1's l1: 0.297781 [4000] training's l1: 0.046405 valid_1's l1: 0.296834 [4500] training's l1: 0.0384337 valid_1's l1: 0.296073 [5000] training's l1: 0.0319694 valid_1's l1: 0.2956 [5500] training's l1: 0.0267228 valid_1's l1: 0.295213 [6000] training's l1: 0.0224414 valid_1's l1: 0.294887 [6500] training's l1: 0.0189621 valid_1's l1: 0.294667 [7000] training's l1: 0.0160608 valid_1's l1: 0.29448 [7500] training's l1: 0.0136685 valid_1's l1: 0.294359 [8000] training's l1: 0.0116797 valid_1's l1: 0.294249 [8500] training's l1: 0.0100289 valid_1's l1: 0.294182 [9000] training's l1: 0.00865066 valid_1's l1: 0.294117 [9500] training's l1: 0.00750589 valid_1's l1: 0.294054 [10000] training's l1: 0.00655543 valid_1's l1: 0.293999 [10500] training's l1: 0.00576241 valid_1's l1: 0.293965 [11000] training's l1: 0.00508751 valid_1's l1: 0.293931 [11500] training's l1: 0.00451511 valid_1's l1: 0.293914 [12000] training's l1: 0.00403305 valid_1's l1: 0.293897 [12500] training's l1: 0.00362611 valid_1's l1: 0.293875 [13000] training's l1: 0.00327722 valid_1's l1: 0.293861 [13500] training's l1: 0.00297823 valid_1's l1: 0.293845 [14000] training's l1: 0.00272148 valid_1's l1: 0.293833 [14500] training's l1: 0.00250062 valid_1's l1: 0.293821 [15000] training's l1: 0.00230679 valid_1's l1: 0.293811 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00230679 valid_1's l1: 0.293811 CV mean score: -1.2270, std: 0.0040. Training of type 1 Fold 1 started at Sun Jun 9 21:51:57 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.285929 valid_1's l1: 0.753375 [1000] training's l1: 0.124426 valid_1's l1: 0.731357 [1500] training's l1: 0.0607065 valid_1's l1: 0.724392 [2000] training's l1: 0.0294098 valid_1's l1: 0.721656 [2500] training's l1: 0.0141838 valid_1's l1: 0.720804 [3000] training's l1: 0.00682455 valid_1's l1: 0.720441 [3500] training's l1: 0.00374417 valid_1's l1: 0.720309 [4000] training's l1: 0.00256542 valid_1's l1: 0.720253 [4500] training's l1: 0.00206082 valid_1's l1: 0.720236 [5000] training's l1: 0.00178364 valid_1's l1: 0.720209 [5500] training's l1: 0.00160724 valid_1's l1: 0.720199 [6000] training's l1: 0.00148369 valid_1's l1: 0.720192 [6500] training's l1: 0.00139107 valid_1's l1: 0.720188 [7000] training's l1: 0.00131619 valid_1's l1: 0.720181 Early stopping, best iteration is: [7195] training's l1: 0.00129096 valid_1's l1: 0.720178 Fold 2 started at Sun Jun 9 21:53:07 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.284187 valid_1's l1: 0.739434 [1000] training's l1: 0.128065 valid_1's l1: 0.722787 [1500] training's l1: 0.0622389 valid_1's l1: 0.716151 [2000] training's l1: 0.0303076 valid_1's l1: 0.714419 [2500] training's l1: 0.0143484 valid_1's l1: 0.713546 [3000] training's l1: 0.00688803 valid_1's l1: 0.713137 [3500] training's l1: 0.00377788 valid_1's l1: 0.713005 [4000] training's l1: 0.00257947 valid_1's l1: 0.71295 [4500] training's l1: 0.00205955 valid_1's l1: 0.712918 [5000] training's l1: 0.00178293 valid_1's l1: 0.712904 [5500] training's l1: 0.00161058 valid_1's l1: 0.712895 [6000] training's l1: 0.00148515 valid_1's l1: 0.712885 [6500] training's l1: 0.00138812 valid_1's l1: 0.712883 [7000] training's l1: 0.00131349 valid_1's l1: 0.712878 [7500] training's l1: 0.00125276 valid_1's l1: 0.712877 Early stopping, best iteration is: [7384] training's l1: 0.00126654 valid_1's l1: 0.712875 Fold 3 started at Sun Jun 9 21:54:19 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.280248 valid_1's l1: 0.747848 [1000] training's l1: 0.122811 valid_1's l1: 0.728115 [1500] training's l1: 0.0585882 valid_1's l1: 0.722545 [2000] training's l1: 0.028761 valid_1's l1: 0.720649 [2500] training's l1: 0.0138162 valid_1's l1: 0.719666 [3000] training's l1: 0.00667305 valid_1's l1: 0.719232 [3500] training's l1: 0.00369859 valid_1's l1: 0.719042 [4000] training's l1: 0.00254594 valid_1's l1: 0.71899 [4500] training's l1: 0.00204325 valid_1's l1: 0.718951 [5000] training's l1: 0.00176886 valid_1's l1: 0.718939 [5500] training's l1: 0.00159663 valid_1's l1: 0.718932 [6000] training's l1: 0.00147477 valid_1's l1: 0.718926 [6500] training's l1: 0.00138233 valid_1's l1: 0.718922 [7000] training's l1: 0.00130874 valid_1's l1: 0.718916 [7500] training's l1: 0.00124804 valid_1's l1: 0.718909 [8000] training's l1: 0.0011977 valid_1's l1: 0.718904 Early stopping, best iteration is: [8038] training's l1: 0.00119431 valid_1's l1: 0.718904 Fold 4 started at Sun Jun 9 21:55:31 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.292917 valid_1's l1: 0.744636 [1000] training's l1: 0.128306 valid_1's l1: 0.721079 [1500] training's l1: 0.0621042 valid_1's l1: 0.715307 [2000] training's l1: 0.0303903 valid_1's l1: 0.714177 [2500] training's l1: 0.0146682 valid_1's l1: 0.713326 [3000] training's l1: 0.00702275 valid_1's l1: 0.713047 [3500] training's l1: 0.00383158 valid_1's l1: 0.712997 [4000] training's l1: 0.00259377 valid_1's l1: 0.712943 [4500] training's l1: 0.00206376 valid_1's l1: 0.712908 [5000] training's l1: 0.00177495 valid_1's l1: 0.712894 [5500] training's l1: 0.00159872 valid_1's l1: 0.712885 [6000] training's l1: 0.00147142 valid_1's l1: 0.712876 [6500] training's l1: 0.00137727 valid_1's l1: 0.712871 [7000] training's l1: 0.00130296 valid_1's l1: 0.71287 Early stopping, best iteration is: [7206] training's l1: 0.00127621 valid_1's l1: 0.712868 Fold 5 started at Sun Jun 9 21:56:41 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.289125 valid_1's l1: 0.750328 [1000] training's l1: 0.12806 valid_1's l1: 0.729651 [1500] training's l1: 0.0613567 valid_1's l1: 0.722134 [2000] training's l1: 0.0303199 valid_1's l1: 0.719586 [2500] training's l1: 0.0147517 valid_1's l1: 0.718666 [3000] training's l1: 0.00701592 valid_1's l1: 0.718236 [3500] training's l1: 0.00382622 valid_1's l1: 0.71804 [4000] training's l1: 0.00259509 valid_1's l1: 0.717965 [4500] training's l1: 0.00207378 valid_1's l1: 0.717934 [5000] training's l1: 0.0017921 valid_1's l1: 0.717916 [5500] training's l1: 0.0016143 valid_1's l1: 0.717903 [6000] training's l1: 0.00148612 valid_1's l1: 0.717897 Early stopping, best iteration is: [5869] training's l1: 0.00151657 valid_1's l1: 0.717897 CV mean score: -0.3333, std: 0.0043. Training of type 4 Fold 1 started at Sun Jun 9 21:57:44 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.142329 valid_1's l1: 0.285925 [1000] training's l1: 0.0770115 valid_1's l1: 0.273919 [1500] training's l1: 0.0444409 valid_1's l1: 0.27026 [2000] training's l1: 0.0267102 valid_1's l1: 0.268689 [2500] training's l1: 0.0165638 valid_1's l1: 0.268053 [3000] training's l1: 0.0105904 valid_1's l1: 0.267727 [3500] training's l1: 0.00709832 valid_1's l1: 0.267577 [4000] training's l1: 0.00498107 valid_1's l1: 0.267507 [4500] training's l1: 0.00372707 valid_1's l1: 0.267454 [5000] training's l1: 0.00292273 valid_1's l1: 0.267414 [5500] training's l1: 0.00240277 valid_1's l1: 0.267395 [6000] training's l1: 0.0020481 valid_1's l1: 0.26738 [6500] training's l1: 0.00180805 valid_1's l1: 0.267367 [7000] training's l1: 0.00163872 valid_1's l1: 0.267363 Early stopping, best iteration is: [7057] training's l1: 0.00162113 valid_1's l1: 0.267362 Fold 2 started at Sun Jun 9 21:59:30 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.140579 valid_1's l1: 0.290869 [1000] training's l1: 0.0763884 valid_1's l1: 0.278488 [1500] training's l1: 0.0445327 valid_1's l1: 0.274771 [2000] training's l1: 0.0271346 valid_1's l1: 0.273239 [2500] training's l1: 0.0174056 valid_1's l1: 0.272602 [3000] training's l1: 0.0116896 valid_1's l1: 0.272267 [3500] training's l1: 0.00814923 valid_1's l1: 0.272092 [4000] training's l1: 0.0059894 valid_1's l1: 0.271975 [4500] training's l1: 0.00459854 valid_1's l1: 0.271896 [5000] training's l1: 0.00366195 valid_1's l1: 0.27186 [5500] training's l1: 0.00296697 valid_1's l1: 0.27183 [6000] training's l1: 0.00243827 valid_1's l1: 0.271811 [6500] training's l1: 0.00201834 valid_1's l1: 0.271797 [7000] training's l1: 0.00170892 valid_1's l1: 0.271786 [7500] training's l1: 0.00149562 valid_1's l1: 0.271776 [8000] training's l1: 0.00134636 valid_1's l1: 0.271771 [8500] training's l1: 0.00123814 valid_1's l1: 0.271766 [9000] training's l1: 0.00115407 valid_1's l1: 0.271762 [9500] training's l1: 0.00108829 valid_1's l1: 0.27176 [10000] training's l1: 0.00103485 valid_1's l1: 0.271758 [10500] training's l1: 0.000989693 valid_1's l1: 0.271756 [11000] training's l1: 0.000951184 valid_1's l1: 0.271755 Early stopping, best iteration is: [10862] training's l1: 0.000961268 valid_1's l1: 0.271754 Fold 3 started at Sun Jun 9 22:02:04 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.142725 valid_1's l1: 0.291003 [1000] training's l1: 0.0770173 valid_1's l1: 0.277505 [1500] training's l1: 0.0451856 valid_1's l1: 0.273823 [2000] training's l1: 0.027393 valid_1's l1: 0.27223 [2500] training's l1: 0.0167666 valid_1's l1: 0.271493 [3000] training's l1: 0.0106506 valid_1's l1: 0.271177 [3500] training's l1: 0.00703132 valid_1's l1: 0.271001 [4000] training's l1: 0.00487021 valid_1's l1: 0.270894 [4500] training's l1: 0.00357256 valid_1's l1: 0.270845 [5000] training's l1: 0.00275152 valid_1's l1: 0.270822 [5500] training's l1: 0.00221046 valid_1's l1: 0.270798 [6000] training's l1: 0.00184433 valid_1's l1: 0.270788 [6500] training's l1: 0.00159716 valid_1's l1: 0.270777 [7000] training's l1: 0.00142329 valid_1's l1: 0.270772 Early stopping, best iteration is: [6925] training's l1: 0.00144508 valid_1's l1: 0.270771 Fold 4 started at Sun Jun 9 22:03:55 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.139526 valid_1's l1: 0.286836 [1000] training's l1: 0.0755001 valid_1's l1: 0.275325 [1500] training's l1: 0.0441375 valid_1's l1: 0.271723 [2000] training's l1: 0.0268186 valid_1's l1: 0.270257 [2500] training's l1: 0.0165007 valid_1's l1: 0.269626 [3000] training's l1: 0.0105045 valid_1's l1: 0.269337 [3500] training's l1: 0.00698947 valid_1's l1: 0.269162 [4000] training's l1: 0.00490964 valid_1's l1: 0.269063 [4500] training's l1: 0.0036667 valid_1's l1: 0.268994 [5000] training's l1: 0.0028749 valid_1's l1: 0.268954 [5500] training's l1: 0.00235964 valid_1's l1: 0.268931 [6000] training's l1: 0.00198806 valid_1's l1: 0.268911 [6500] training's l1: 0.00171803 valid_1's l1: 0.268901 [7000] training's l1: 0.00152872 valid_1's l1: 0.268892 [7500] training's l1: 0.00139435 valid_1's l1: 0.268885 [8000] training's l1: 0.00129496 valid_1's l1: 0.268881 [8500] training's l1: 0.0012127 valid_1's l1: 0.268878 [9000] training's l1: 0.00114129 valid_1's l1: 0.268874 [9500] training's l1: 0.00107804 valid_1's l1: 0.268869 [10000] training's l1: 0.00102439 valid_1's l1: 0.268868 [10500] training's l1: 0.000979575 valid_1's l1: 0.268865 [11000] training's l1: 0.000941969 valid_1's l1: 0.268864 [11500] training's l1: 0.000909719 valid_1's l1: 0.268862 [12000] training's l1: 0.000881282 valid_1's l1: 0.268861 Early stopping, best iteration is: [11977] training's l1: 0.000882562 valid_1's l1: 0.268861 Fold 5 started at Sun Jun 9 22:06:37 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.141499 valid_1's l1: 0.285999 [1000] training's l1: 0.0758043 valid_1's l1: 0.274333 [1500] training's l1: 0.044042 valid_1's l1: 0.270347 [2000] training's l1: 0.0264236 valid_1's l1: 0.268789 [2500] training's l1: 0.0162537 valid_1's l1: 0.267938 [3000] training's l1: 0.0103416 valid_1's l1: 0.267581 [3500] training's l1: 0.00686741 valid_1's l1: 0.267413 [4000] training's l1: 0.00478406 valid_1's l1: 0.267336 [4500] training's l1: 0.00353248 valid_1's l1: 0.267292 [5000] training's l1: 0.00273679 valid_1's l1: 0.267255 [5500] training's l1: 0.00222223 valid_1's l1: 0.267237 [6000] training's l1: 0.00187843 valid_1's l1: 0.267224 [6500] training's l1: 0.00165649 valid_1's l1: 0.267216 [7000] training's l1: 0.00151293 valid_1's l1: 0.267208 [7500] training's l1: 0.00140512 valid_1's l1: 0.267204 [8000] training's l1: 0.00133165 valid_1's l1: 0.2672 Early stopping, best iteration is: [8050] training's l1: 0.00132546 valid_1's l1: 0.2672 CV mean score: -1.3124, std: 0.0067. Training of type 2 Fold 1 started at Sun Jun 9 22:08:40 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.53871 valid_1's l1: 0.609858 [1000] training's l1: 0.462407 valid_1's l1: 0.585386 [1500] training's l1: 0.403496 valid_1's l1: 0.569045 [2000] training's l1: 0.355907 valid_1's l1: 0.556396 [2500] training's l1: 0.316604 valid_1's l1: 0.547535 [3000] training's l1: 0.283736 valid_1's l1: 0.540597 [3500] training's l1: 0.255626 valid_1's l1: 0.534842 [4000] training's l1: 0.231437 valid_1's l1: 0.530167 [4500] training's l1: 0.210527 valid_1's l1: 0.526458 [5000] training's l1: 0.191902 valid_1's l1: 0.523021 [5500] training's l1: 0.175432 valid_1's l1: 0.520396 [6000] training's l1: 0.161007 valid_1's l1: 0.518324 [6500] training's l1: 0.147992 valid_1's l1: 0.516471 [7000] training's l1: 0.136226 valid_1's l1: 0.514907 [7500] training's l1: 0.125667 valid_1's l1: 0.513517 [8000] training's l1: 0.116093 valid_1's l1: 0.51234 [8500] training's l1: 0.107445 valid_1's l1: 0.511362 [9000] training's l1: 0.0995341 valid_1's l1: 0.510418 [9500] training's l1: 0.0922815 valid_1's l1: 0.509569 [10000] training's l1: 0.0856105 valid_1's l1: 0.508866 [10500] training's l1: 0.0794826 valid_1's l1: 0.508208 [11000] training's l1: 0.0738904 valid_1's l1: 0.507634 [11500] training's l1: 0.0687294 valid_1's l1: 0.507153 [12000] training's l1: 0.0639613 valid_1's l1: 0.506794 [12500] training's l1: 0.0595936 valid_1's l1: 0.506392 [13000] training's l1: 0.0555625 valid_1's l1: 0.506006 [13500] training's l1: 0.0518492 valid_1's l1: 0.505696 [14000] training's l1: 0.0484032 valid_1's l1: 0.505405 [14500] training's l1: 0.0451987 valid_1's l1: 0.505162 [15000] training's l1: 0.0422533 valid_1's l1: 0.50492 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0422533 valid_1's l1: 0.50492 Fold 2 started at Sun Jun 9 22:17:49 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.539552 valid_1's l1: 0.610149 [1000] training's l1: 0.462692 valid_1's l1: 0.585283 [1500] training's l1: 0.403863 valid_1's l1: 0.568812 [2000] training's l1: 0.356208 valid_1's l1: 0.557232 [2500] training's l1: 0.317076 valid_1's l1: 0.548133 [3000] training's l1: 0.283816 valid_1's l1: 0.540614 [3500] training's l1: 0.255947 valid_1's l1: 0.535123 [4000] training's l1: 0.231675 valid_1's l1: 0.530346 [4500] training's l1: 0.210443 valid_1's l1: 0.526387 [5000] training's l1: 0.192049 valid_1's l1: 0.523199 [5500] training's l1: 0.175589 valid_1's l1: 0.520722 [6000] training's l1: 0.160986 valid_1's l1: 0.518532 [6500] training's l1: 0.147937 valid_1's l1: 0.516695 [7000] training's l1: 0.136237 valid_1's l1: 0.515063 [7500] training's l1: 0.125681 valid_1's l1: 0.513693 [8000] training's l1: 0.116137 valid_1's l1: 0.512468 [8500] training's l1: 0.107381 valid_1's l1: 0.511377 [9000] training's l1: 0.0994534 valid_1's l1: 0.51047 [9500] training's l1: 0.0921552 valid_1's l1: 0.509721 [10000] training's l1: 0.0855457 valid_1's l1: 0.509041 [10500] training's l1: 0.0794883 valid_1's l1: 0.508477 [11000] training's l1: 0.073923 valid_1's l1: 0.507931 [11500] training's l1: 0.0687737 valid_1's l1: 0.507492 [12000] training's l1: 0.064048 valid_1's l1: 0.507148 [12500] training's l1: 0.0596504 valid_1's l1: 0.506787 [13000] training's l1: 0.0556335 valid_1's l1: 0.506457 [13500] training's l1: 0.0519194 valid_1's l1: 0.506168 [14000] training's l1: 0.0484765 valid_1's l1: 0.5059 [14500] training's l1: 0.0452909 valid_1's l1: 0.505645 [15000] training's l1: 0.0423287 valid_1's l1: 0.505446 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0423287 valid_1's l1: 0.505446 Fold 3 started at Sun Jun 9 22:27:02 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.536909 valid_1's l1: 0.607839 [1000] training's l1: 0.46125 valid_1's l1: 0.585606 [1500] training's l1: 0.401809 valid_1's l1: 0.568461 [2000] training's l1: 0.3549 valid_1's l1: 0.557124 [2500] training's l1: 0.315665 valid_1's l1: 0.547724 [3000] training's l1: 0.282654 valid_1's l1: 0.540565 [3500] training's l1: 0.254739 valid_1's l1: 0.53467 [4000] training's l1: 0.230745 valid_1's l1: 0.530239 [4500] training's l1: 0.209864 valid_1's l1: 0.526633 [5000] training's l1: 0.191413 valid_1's l1: 0.523495 [5500] training's l1: 0.175085 valid_1's l1: 0.520772 [6000] training's l1: 0.160516 valid_1's l1: 0.518496 [6500] training's l1: 0.147415 valid_1's l1: 0.516562 [7000] training's l1: 0.135746 valid_1's l1: 0.515144 [7500] training's l1: 0.125216 valid_1's l1: 0.51376 [8000] training's l1: 0.115635 valid_1's l1: 0.512539 [8500] training's l1: 0.106878 valid_1's l1: 0.511495 [9000] training's l1: 0.0989858 valid_1's l1: 0.510674 [9500] training's l1: 0.0917281 valid_1's l1: 0.509919 [10000] training's l1: 0.0851276 valid_1's l1: 0.509277 [10500] training's l1: 0.0790628 valid_1's l1: 0.508693 [11000] training's l1: 0.0734908 valid_1's l1: 0.508108 [11500] training's l1: 0.0683853 valid_1's l1: 0.507633 [12000] training's l1: 0.0636599 valid_1's l1: 0.507237 [12500] training's l1: 0.0593127 valid_1's l1: 0.506823 [13000] training's l1: 0.0553128 valid_1's l1: 0.506485 [13500] training's l1: 0.0516092 valid_1's l1: 0.506176 [14000] training's l1: 0.0482043 valid_1's l1: 0.505865 [14500] training's l1: 0.0450466 valid_1's l1: 0.505604 [15000] training's l1: 0.0421052 valid_1's l1: 0.505368 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0421052 valid_1's l1: 0.505368 Fold 4 started at Sun Jun 9 22:36:07 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.539761 valid_1's l1: 0.606846 [1000] training's l1: 0.462909 valid_1's l1: 0.583698 [1500] training's l1: 0.40355 valid_1's l1: 0.566737 [2000] training's l1: 0.356411 valid_1's l1: 0.554521 [2500] training's l1: 0.317509 valid_1's l1: 0.545494 [3000] training's l1: 0.284519 valid_1's l1: 0.538105 [3500] training's l1: 0.256589 valid_1's l1: 0.532997 [4000] training's l1: 0.232542 valid_1's l1: 0.528513 [4500] training's l1: 0.211479 valid_1's l1: 0.525032 [5000] training's l1: 0.192707 valid_1's l1: 0.521943 [5500] training's l1: 0.17631 valid_1's l1: 0.519427 [6000] training's l1: 0.161764 valid_1's l1: 0.517298 [6500] training's l1: 0.148594 valid_1's l1: 0.515506 [7000] training's l1: 0.136807 valid_1's l1: 0.514001 [7500] training's l1: 0.126117 valid_1's l1: 0.512563 [8000] training's l1: 0.11645 valid_1's l1: 0.51136 [8500] training's l1: 0.107653 valid_1's l1: 0.510297 [9000] training's l1: 0.0996972 valid_1's l1: 0.509406 [9500] training's l1: 0.092425 valid_1's l1: 0.508626 [10000] training's l1: 0.0857731 valid_1's l1: 0.507981 [10500] training's l1: 0.0796812 valid_1's l1: 0.507386 [11000] training's l1: 0.0740521 valid_1's l1: 0.506843 [11500] training's l1: 0.0688313 valid_1's l1: 0.506353 [12000] training's l1: 0.0641118 valid_1's l1: 0.50599 [12500] training's l1: 0.0597278 valid_1's l1: 0.505608 [13000] training's l1: 0.0556826 valid_1's l1: 0.505238 [13500] training's l1: 0.0519917 valid_1's l1: 0.504892 [14000] training's l1: 0.0485517 valid_1's l1: 0.50458 [14500] training's l1: 0.0453774 valid_1's l1: 0.50433 [15000] training's l1: 0.0424322 valid_1's l1: 0.504096 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0424322 valid_1's l1: 0.504096 Fold 5 started at Sun Jun 9 22:45:25 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.539817 valid_1's l1: 0.609916 [1000] training's l1: 0.462611 valid_1's l1: 0.585788 [1500] training's l1: 0.40283 valid_1's l1: 0.56854 [2000] training's l1: 0.35532 valid_1's l1: 0.556393 [2500] training's l1: 0.316385 valid_1's l1: 0.5475 [3000] training's l1: 0.283584 valid_1's l1: 0.540674 [3500] training's l1: 0.255479 valid_1's l1: 0.534703 [4000] training's l1: 0.231336 valid_1's l1: 0.530283 [4500] training's l1: 0.210231 valid_1's l1: 0.526631 [5000] training's l1: 0.192002 valid_1's l1: 0.52365 [5500] training's l1: 0.175699 valid_1's l1: 0.520901 [6000] training's l1: 0.161111 valid_1's l1: 0.518597 [6500] training's l1: 0.148011 valid_1's l1: 0.516857 [7000] training's l1: 0.136268 valid_1's l1: 0.515346 [7500] training's l1: 0.125689 valid_1's l1: 0.513923 [8000] training's l1: 0.116084 valid_1's l1: 0.512713 [8500] training's l1: 0.107366 valid_1's l1: 0.511677 [9000] training's l1: 0.0993762 valid_1's l1: 0.510782 [9500] training's l1: 0.0920821 valid_1's l1: 0.510029 [10000] training's l1: 0.0854722 valid_1's l1: 0.50938 [10500] training's l1: 0.0794073 valid_1's l1: 0.508788 [11000] training's l1: 0.0738107 valid_1's l1: 0.50829 [11500] training's l1: 0.0686843 valid_1's l1: 0.507782 [12000] training's l1: 0.0639485 valid_1's l1: 0.507413 [12500] training's l1: 0.0595991 valid_1's l1: 0.506994 [13000] training's l1: 0.0555948 valid_1's l1: 0.506679 [13500] training's l1: 0.0518774 valid_1's l1: 0.506357 [14000] training's l1: 0.0484174 valid_1's l1: 0.50608 [14500] training's l1: 0.0452315 valid_1's l1: 0.505847 [15000] training's l1: 0.0422833 valid_1's l1: 0.505585 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0422833 valid_1's l1: 0.505585 CV mean score: -0.6830, std: 0.0011. Training of type 6 Fold 1 started at Sun Jun 9 22:54:30 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.262654 valid_1's l1: 0.323445 [1000] training's l1: 0.201184 valid_1's l1: 0.301366 [1500] training's l1: 0.16172 valid_1's l1: 0.289918 [2000] training's l1: 0.133694 valid_1's l1: 0.283533 [2500] training's l1: 0.112268 valid_1's l1: 0.279294 [3000] training's l1: 0.0954833 valid_1's l1: 0.276143 [3500] training's l1: 0.0819939 valid_1's l1: 0.273844 [4000] training's l1: 0.0707719 valid_1's l1: 0.27235 [4500] training's l1: 0.0615213 valid_1's l1: 0.271164 [5000] training's l1: 0.0536611 valid_1's l1: 0.270198 [5500] training's l1: 0.046986 valid_1's l1: 0.26947 [6000] training's l1: 0.0412931 valid_1's l1: 0.268873 [6500] training's l1: 0.0364316 valid_1's l1: 0.268357 [7000] training's l1: 0.0322308 valid_1's l1: 0.267961 [7500] training's l1: 0.0285615 valid_1's l1: 0.267655 [8000] training's l1: 0.0253702 valid_1's l1: 0.267452 [8500] training's l1: 0.0225759 valid_1's l1: 0.267248 [9000] training's l1: 0.020124 valid_1's l1: 0.267089 [9500] training's l1: 0.0179988 valid_1's l1: 0.266923 [10000] training's l1: 0.016127 valid_1's l1: 0.26679 [10500] training's l1: 0.0144855 valid_1's l1: 0.266693 [11000] training's l1: 0.0130377 valid_1's l1: 0.266599 [11500] training's l1: 0.0117493 valid_1's l1: 0.266517 [12000] training's l1: 0.0106189 valid_1's l1: 0.266449 [12500] training's l1: 0.00961049 valid_1's l1: 0.266379 [13000] training's l1: 0.00871912 valid_1's l1: 0.266327 [13500] training's l1: 0.00793132 valid_1's l1: 0.266277 [14000] training's l1: 0.0072239 valid_1's l1: 0.266233 [14500] training's l1: 0.00660416 valid_1's l1: 0.2662 [15000] training's l1: 0.00604866 valid_1's l1: 0.266167 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00604866 valid_1's l1: 0.266167 Fold 2 started at Sun Jun 9 23:00:45 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.262761 valid_1's l1: 0.323972 [1000] training's l1: 0.201543 valid_1's l1: 0.301406 [1500] training's l1: 0.162015 valid_1's l1: 0.289782 [2000] training's l1: 0.133733 valid_1's l1: 0.282776 [2500] training's l1: 0.11245 valid_1's l1: 0.278183 [3000] training's l1: 0.0956713 valid_1's l1: 0.27525 [3500] training's l1: 0.0820176 valid_1's l1: 0.272901 [4000] training's l1: 0.0709085 valid_1's l1: 0.271258 [4500] training's l1: 0.0616326 valid_1's l1: 0.270061 [5000] training's l1: 0.0537544 valid_1's l1: 0.269202 [5500] training's l1: 0.0470916 valid_1's l1: 0.268437 [6000] training's l1: 0.0413885 valid_1's l1: 0.267856 [6500] training's l1: 0.0364637 valid_1's l1: 0.267351 [7000] training's l1: 0.0322318 valid_1's l1: 0.266986 [7500] training's l1: 0.0285533 valid_1's l1: 0.266678 [8000] training's l1: 0.0253492 valid_1's l1: 0.266423 [8500] training's l1: 0.0225735 valid_1's l1: 0.266195 [9000] training's l1: 0.0201561 valid_1's l1: 0.266013 [9500] training's l1: 0.0180316 valid_1's l1: 0.265856 [10000] training's l1: 0.0161465 valid_1's l1: 0.265722 [10500] training's l1: 0.0144922 valid_1's l1: 0.265604 [11000] training's l1: 0.0130414 valid_1's l1: 0.265518 [11500] training's l1: 0.0117661 valid_1's l1: 0.265432 [12000] training's l1: 0.0106245 valid_1's l1: 0.265366 [12500] training's l1: 0.00962228 valid_1's l1: 0.265309 [13000] training's l1: 0.00872981 valid_1's l1: 0.265259 [13500] training's l1: 0.00794712 valid_1's l1: 0.265203 [14000] training's l1: 0.00724576 valid_1's l1: 0.265172 [14500] training's l1: 0.00662488 valid_1's l1: 0.265141 [15000] training's l1: 0.00607206 valid_1's l1: 0.265113 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00607206 valid_1's l1: 0.265113 Fold 3 started at Sun Jun 9 23:07:02 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.26226 valid_1's l1: 0.324989 [1000] training's l1: 0.201089 valid_1's l1: 0.302823 [1500] training's l1: 0.161343 valid_1's l1: 0.291291 [2000] training's l1: 0.132965 valid_1's l1: 0.284451 [2500] training's l1: 0.111613 valid_1's l1: 0.280022 [3000] training's l1: 0.0949092 valid_1's l1: 0.276961 [3500] training's l1: 0.0815319 valid_1's l1: 0.274904 [4000] training's l1: 0.0704721 valid_1's l1: 0.273303 [4500] training's l1: 0.0612079 valid_1's l1: 0.272241 [5000] training's l1: 0.0534047 valid_1's l1: 0.271349 [5500] training's l1: 0.046822 valid_1's l1: 0.270626 [6000] training's l1: 0.0411568 valid_1's l1: 0.270029 [6500] training's l1: 0.0362812 valid_1's l1: 0.269529 [7000] training's l1: 0.0320634 valid_1's l1: 0.269145 [7500] training's l1: 0.0283945 valid_1's l1: 0.268842 [8000] training's l1: 0.0252326 valid_1's l1: 0.268587 [8500] training's l1: 0.0224639 valid_1's l1: 0.268376 [9000] training's l1: 0.0200432 valid_1's l1: 0.268195 [9500] training's l1: 0.0179228 valid_1's l1: 0.268032 [10000] training's l1: 0.0160641 valid_1's l1: 0.267911 [10500] training's l1: 0.0144278 valid_1's l1: 0.267803 [11000] training's l1: 0.0129831 valid_1's l1: 0.267708 [11500] training's l1: 0.0116974 valid_1's l1: 0.267631 [12000] training's l1: 0.0105684 valid_1's l1: 0.267576 [12500] training's l1: 0.00957223 valid_1's l1: 0.267519 [13000] training's l1: 0.00868204 valid_1's l1: 0.267472 [13500] training's l1: 0.00790168 valid_1's l1: 0.267425 [14000] training's l1: 0.00720465 valid_1's l1: 0.267385 [14500] training's l1: 0.00658389 valid_1's l1: 0.267342 [15000] training's l1: 0.00603466 valid_1's l1: 0.267313 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00603466 valid_1's l1: 0.267313 Fold 4 started at Sun Jun 9 23:13:15 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.262319 valid_1's l1: 0.321719 [1000] training's l1: 0.201415 valid_1's l1: 0.300285 [1500] training's l1: 0.161971 valid_1's l1: 0.288548 [2000] training's l1: 0.13364 valid_1's l1: 0.281987 [2500] training's l1: 0.112307 valid_1's l1: 0.277554 [3000] training's l1: 0.095449 valid_1's l1: 0.274826 [3500] training's l1: 0.0819287 valid_1's l1: 0.272575 [4000] training's l1: 0.0708118 valid_1's l1: 0.271138 [4500] training's l1: 0.0615325 valid_1's l1: 0.269929 [5000] training's l1: 0.0536871 valid_1's l1: 0.268984 [5500] training's l1: 0.0470262 valid_1's l1: 0.268347 [6000] training's l1: 0.041295 valid_1's l1: 0.267771 [6500] training's l1: 0.0364014 valid_1's l1: 0.267331 [7000] training's l1: 0.0321836 valid_1's l1: 0.266976 [7500] training's l1: 0.028533 valid_1's l1: 0.266682 [8000] training's l1: 0.0253547 valid_1's l1: 0.266417 [8500] training's l1: 0.0225785 valid_1's l1: 0.266258 [9000] training's l1: 0.0201474 valid_1's l1: 0.266064 [9500] training's l1: 0.0180071 valid_1's l1: 0.265923 [10000] training's l1: 0.0161406 valid_1's l1: 0.265784 [10500] training's l1: 0.0144746 valid_1's l1: 0.26568 [11000] training's l1: 0.0130276 valid_1's l1: 0.265561 [11500] training's l1: 0.0117503 valid_1's l1: 0.265494 [12000] training's l1: 0.0106202 valid_1's l1: 0.265421 [12500] training's l1: 0.00961993 valid_1's l1: 0.265359 [13000] training's l1: 0.00873267 valid_1's l1: 0.265315 [13500] training's l1: 0.00794368 valid_1's l1: 0.265268 [14000] training's l1: 0.00724172 valid_1's l1: 0.265235 [14500] training's l1: 0.00661932 valid_1's l1: 0.265211 [15000] training's l1: 0.00606284 valid_1's l1: 0.265185 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00606284 valid_1's l1: 0.265185 Fold 5 started at Sun Jun 9 23:19:31 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.262534 valid_1's l1: 0.323703 [1000] training's l1: 0.200673 valid_1's l1: 0.301143 [1500] training's l1: 0.161532 valid_1's l1: 0.290046 [2000] training's l1: 0.133617 valid_1's l1: 0.283225 [2500] training's l1: 0.11252 valid_1's l1: 0.279081 [3000] training's l1: 0.0956441 valid_1's l1: 0.276227 [3500] training's l1: 0.082086 valid_1's l1: 0.274079 [4000] training's l1: 0.0709877 valid_1's l1: 0.272465 [4500] training's l1: 0.0616821 valid_1's l1: 0.271306 [5000] training's l1: 0.0538205 valid_1's l1: 0.270353 [5500] training's l1: 0.0471656 valid_1's l1: 0.2697 [6000] training's l1: 0.0414455 valid_1's l1: 0.269115 [6500] training's l1: 0.0365595 valid_1's l1: 0.268621 [7000] training's l1: 0.0323221 valid_1's l1: 0.268237 [7500] training's l1: 0.0286331 valid_1's l1: 0.26792 [8000] training's l1: 0.0254377 valid_1's l1: 0.267688 [8500] training's l1: 0.0226437 valid_1's l1: 0.267461 [9000] training's l1: 0.0201876 valid_1's l1: 0.267291 [9500] training's l1: 0.0180477 valid_1's l1: 0.267129 [10000] training's l1: 0.0161569 valid_1's l1: 0.267005 [10500] training's l1: 0.0145037 valid_1's l1: 0.266884 [11000] training's l1: 0.0130473 valid_1's l1: 0.26682 [11500] training's l1: 0.0117643 valid_1's l1: 0.26674 [12000] training's l1: 0.0106306 valid_1's l1: 0.266679 [12500] training's l1: 0.0096251 valid_1's l1: 0.266621 [13000] training's l1: 0.00872802 valid_1's l1: 0.266571 [13500] training's l1: 0.007937 valid_1's l1: 0.266518 [14000] training's l1: 0.00722817 valid_1's l1: 0.266478 [14500] training's l1: 0.00660484 valid_1's l1: 0.266446 [15000] training's l1: 0.00604828 valid_1's l1: 0.266412 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00604828 valid_1's l1: 0.266412 CV mean score: -1.3241, std: 0.0031. Training of type 5 Fold 1 started at Sun Jun 9 23:25:49 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.532222 valid_1's l1: 0.581997 [1000] training's l1: 0.474575 valid_1's l1: 0.563968 [1500] training's l1: 0.428561 valid_1's l1: 0.551949 [2000] training's l1: 0.389202 valid_1's l1: 0.541734 [2500] training's l1: 0.355953 valid_1's l1: 0.533945 [3000] training's l1: 0.326735 valid_1's l1: 0.527318 [3500] training's l1: 0.300618 valid_1's l1: 0.521707 [4000] training's l1: 0.277493 valid_1's l1: 0.517074 [4500] training's l1: 0.256954 valid_1's l1: 0.512961 [5000] training's l1: 0.238584 valid_1's l1: 0.509553 [5500] training's l1: 0.22189 valid_1's l1: 0.506533 [6000] training's l1: 0.206642 valid_1's l1: 0.503739 [6500] training's l1: 0.192957 valid_1's l1: 0.501435 [7000] training's l1: 0.180398 valid_1's l1: 0.499354 [7500] training's l1: 0.168801 valid_1's l1: 0.497478 [8000] training's l1: 0.158099 valid_1's l1: 0.495873 [8500] training's l1: 0.148322 valid_1's l1: 0.494496 [9000] training's l1: 0.139217 valid_1's l1: 0.493263 [9500] training's l1: 0.130866 valid_1's l1: 0.492137 [10000] training's l1: 0.123075 valid_1's l1: 0.491159 [10500] training's l1: 0.115893 valid_1's l1: 0.490242 [11000] training's l1: 0.10918 valid_1's l1: 0.489498 [11500] training's l1: 0.102931 valid_1's l1: 0.488677 [12000] training's l1: 0.0971157 valid_1's l1: 0.487955 [12500] training's l1: 0.0917253 valid_1's l1: 0.487385 [13000] training's l1: 0.0865873 valid_1's l1: 0.486773 [13500] training's l1: 0.0818053 valid_1's l1: 0.486277 [14000] training's l1: 0.0773776 valid_1's l1: 0.485833 [14500] training's l1: 0.0731879 valid_1's l1: 0.485388 [15000] training's l1: 0.0692859 valid_1's l1: 0.485003 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0692859 valid_1's l1: 0.485003 Fold 2 started at Sun Jun 9 23:36:39 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.531187 valid_1's l1: 0.583743 [1000] training's l1: 0.473636 valid_1's l1: 0.565845 [1500] training's l1: 0.426944 valid_1's l1: 0.553241 [2000] training's l1: 0.388555 valid_1's l1: 0.544217 [2500] training's l1: 0.354866 valid_1's l1: 0.536115 [3000] training's l1: 0.325867 valid_1's l1: 0.52963 [3500] training's l1: 0.300053 valid_1's l1: 0.523813 [4000] training's l1: 0.277081 valid_1's l1: 0.519151 [4500] training's l1: 0.256857 valid_1's l1: 0.515464 [5000] training's l1: 0.238235 valid_1's l1: 0.511873 [5500] training's l1: 0.22156 valid_1's l1: 0.508813 [6000] training's l1: 0.206454 valid_1's l1: 0.506065 [6500] training's l1: 0.192765 valid_1's l1: 0.503731 [7000] training's l1: 0.180189 valid_1's l1: 0.501684 [7500] training's l1: 0.168684 valid_1's l1: 0.499968 [8000] training's l1: 0.158233 valid_1's l1: 0.498499 [8500] training's l1: 0.148414 valid_1's l1: 0.497067 [9000] training's l1: 0.139391 valid_1's l1: 0.495785 [9500] training's l1: 0.131002 valid_1's l1: 0.494679 [10000] training's l1: 0.123224 valid_1's l1: 0.493612 [10500] training's l1: 0.116018 valid_1's l1: 0.492733 [11000] training's l1: 0.109327 valid_1's l1: 0.491905 [11500] training's l1: 0.10309 valid_1's l1: 0.491132 [12000] training's l1: 0.0972481 valid_1's l1: 0.490424 [12500] training's l1: 0.0918341 valid_1's l1: 0.48982 [13000] training's l1: 0.086679 valid_1's l1: 0.48925 [13500] training's l1: 0.0819161 valid_1's l1: 0.488778 [14000] training's l1: 0.0774203 valid_1's l1: 0.488366 [14500] training's l1: 0.0732541 valid_1's l1: 0.48795 [15000] training's l1: 0.0693553 valid_1's l1: 0.487536 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0693553 valid_1's l1: 0.487536 Fold 3 started at Sun Jun 9 23:47:30 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.532709 valid_1's l1: 0.582603 [1000] training's l1: 0.474745 valid_1's l1: 0.564653 [1500] training's l1: 0.42839 valid_1's l1: 0.551959 [2000] training's l1: 0.389462 valid_1's l1: 0.542292 [2500] training's l1: 0.35583 valid_1's l1: 0.534512 [3000] training's l1: 0.326061 valid_1's l1: 0.527714 [3500] training's l1: 0.300062 valid_1's l1: 0.52231 [4000] training's l1: 0.277066 valid_1's l1: 0.517403 [4500] training's l1: 0.256667 valid_1's l1: 0.513321 [5000] training's l1: 0.238314 valid_1's l1: 0.509815 [5500] training's l1: 0.221578 valid_1's l1: 0.506914 [6000] training's l1: 0.206457 valid_1's l1: 0.504464 [6500] training's l1: 0.192784 valid_1's l1: 0.50219 [7000] training's l1: 0.180177 valid_1's l1: 0.500258 [7500] training's l1: 0.168641 valid_1's l1: 0.498485 [8000] training's l1: 0.158091 valid_1's l1: 0.496868 [8500] training's l1: 0.148383 valid_1's l1: 0.495439 [9000] training's l1: 0.13937 valid_1's l1: 0.494109 [9500] training's l1: 0.13103 valid_1's l1: 0.492954 [10000] training's l1: 0.123276 valid_1's l1: 0.491966 [10500] training's l1: 0.116043 valid_1's l1: 0.491049 [11000] training's l1: 0.109362 valid_1's l1: 0.490281 [11500] training's l1: 0.103108 valid_1's l1: 0.489573 [12000] training's l1: 0.0972706 valid_1's l1: 0.488879 [12500] training's l1: 0.0918377 valid_1's l1: 0.488315 [13000] training's l1: 0.0867594 valid_1's l1: 0.487742 [13500] training's l1: 0.0819602 valid_1's l1: 0.487257 [14000] training's l1: 0.0774934 valid_1's l1: 0.486813 [14500] training's l1: 0.0733379 valid_1's l1: 0.486389 [15000] training's l1: 0.0693882 valid_1's l1: 0.485973 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0693882 valid_1's l1: 0.485973 Fold 4 started at Sun Jun 9 23:58:07 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.532665 valid_1's l1: 0.583706 [1000] training's l1: 0.474739 valid_1's l1: 0.565414 [1500] training's l1: 0.428203 valid_1's l1: 0.552342 [2000] training's l1: 0.388519 valid_1's l1: 0.542307 [2500] training's l1: 0.35489 valid_1's l1: 0.534087 [3000] training's l1: 0.325731 valid_1's l1: 0.527416 [3500] training's l1: 0.299969 valid_1's l1: 0.52187 [4000] training's l1: 0.277317 valid_1's l1: 0.517206 [4500] training's l1: 0.256834 valid_1's l1: 0.513046 [5000] training's l1: 0.238432 valid_1's l1: 0.509651 [5500] training's l1: 0.221781 valid_1's l1: 0.506571 [6000] training's l1: 0.206615 valid_1's l1: 0.503915 [6500] training's l1: 0.192943 valid_1's l1: 0.501732 [7000] training's l1: 0.180402 valid_1's l1: 0.499784 [7500] training's l1: 0.168839 valid_1's l1: 0.498055 [8000] training's l1: 0.158208 valid_1's l1: 0.496422 [8500] training's l1: 0.148395 valid_1's l1: 0.49498 [9000] training's l1: 0.139406 valid_1's l1: 0.4937 [9500] training's l1: 0.131078 valid_1's l1: 0.492616 [10000] training's l1: 0.123316 valid_1's l1: 0.491569 [10500] training's l1: 0.116092 valid_1's l1: 0.490674 [11000] training's l1: 0.109418 valid_1's l1: 0.489852 [11500] training's l1: 0.103179 valid_1's l1: 0.489043 [12000] training's l1: 0.0973208 valid_1's l1: 0.488335 [12500] training's l1: 0.0918458 valid_1's l1: 0.487703 [13000] training's l1: 0.0867875 valid_1's l1: 0.487127 [13500] training's l1: 0.0819953 valid_1's l1: 0.48657 [14000] training's l1: 0.077551 valid_1's l1: 0.486089 [14500] training's l1: 0.0733737 valid_1's l1: 0.485607 [15000] training's l1: 0.0694344 valid_1's l1: 0.485207 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0694344 valid_1's l1: 0.485207 Fold 5 started at Mon Jun 10 00:08:54 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.532415 valid_1's l1: 0.582411 [1000] training's l1: 0.474112 valid_1's l1: 0.56424 [1500] training's l1: 0.427322 valid_1's l1: 0.551239 [2000] training's l1: 0.388324 valid_1's l1: 0.541396 [2500] training's l1: 0.3548 valid_1's l1: 0.533782 [3000] training's l1: 0.325438 valid_1's l1: 0.526671 [3500] training's l1: 0.299889 valid_1's l1: 0.521059 [4000] training's l1: 0.276951 valid_1's l1: 0.516406 [4500] training's l1: 0.25666 valid_1's l1: 0.512331 [5000] training's l1: 0.238136 valid_1's l1: 0.508829 [5500] training's l1: 0.221395 valid_1's l1: 0.505679 [6000] training's l1: 0.206335 valid_1's l1: 0.503182 [6500] training's l1: 0.192646 valid_1's l1: 0.500873 [7000] training's l1: 0.180106 valid_1's l1: 0.499114 [7500] training's l1: 0.168644 valid_1's l1: 0.497323 [8000] training's l1: 0.158052 valid_1's l1: 0.495781 [8500] training's l1: 0.148175 valid_1's l1: 0.494379 [9000] training's l1: 0.139082 valid_1's l1: 0.493147 [9500] training's l1: 0.130712 valid_1's l1: 0.492066 [10000] training's l1: 0.122978 valid_1's l1: 0.491075 [10500] training's l1: 0.115753 valid_1's l1: 0.490244 [11000] training's l1: 0.10905 valid_1's l1: 0.489481 [11500] training's l1: 0.102849 valid_1's l1: 0.488783 [12000] training's l1: 0.0970535 valid_1's l1: 0.48809 [12500] training's l1: 0.0916567 valid_1's l1: 0.487482 [13000] training's l1: 0.0865915 valid_1's l1: 0.486952 [13500] training's l1: 0.0818349 valid_1's l1: 0.48645 [14000] training's l1: 0.0773687 valid_1's l1: 0.485993 [14500] training's l1: 0.0732056 valid_1's l1: 0.485579 [15000] training's l1: 0.0693166 valid_1's l1: 0.485211 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0693166 valid_1's l1: 0.485211 CV mean score: -0.7220, std: 0.0019. Training of type 7 Fold 1 started at Mon Jun 10 00:19:45 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.11669 valid_1's l1: 0.216359 [1000] training's l1: 0.0677861 valid_1's l1: 0.206115 [1500] training's l1: 0.0426433 valid_1's l1: 0.202664 [2000] training's l1: 0.0278352 valid_1's l1: 0.200965 [2500] training's l1: 0.0186586 valid_1's l1: 0.200019 [3000] training's l1: 0.0127528 valid_1's l1: 0.199551 [3500] training's l1: 0.00894136 valid_1's l1: 0.199257 [4000] training's l1: 0.0064768 valid_1's l1: 0.199059 [4500] training's l1: 0.00483178 valid_1's l1: 0.198957 [5000] training's l1: 0.00373571 valid_1's l1: 0.198888 [5500] training's l1: 0.00298217 valid_1's l1: 0.198835 [6000] training's l1: 0.00245278 valid_1's l1: 0.198799 [6500] training's l1: 0.00206591 valid_1's l1: 0.198779 [7000] training's l1: 0.00177741 valid_1's l1: 0.198761 [7500] training's l1: 0.0015575 valid_1's l1: 0.198748 [8000] training's l1: 0.00139327 valid_1's l1: 0.198741 [8500] training's l1: 0.0012698 valid_1's l1: 0.198734 [9000] training's l1: 0.00117788 valid_1's l1: 0.198728 [9500] training's l1: 0.00110669 valid_1's l1: 0.198724 [10000] training's l1: 0.00104796 valid_1's l1: 0.198721 Early stopping, best iteration is: [10193] training's l1: 0.0010281 valid_1's l1: 0.19872 Fold 2 started at Mon Jun 10 00:22:44 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.115694 valid_1's l1: 0.216146 [1000] training's l1: 0.0678952 valid_1's l1: 0.206033 [1500] training's l1: 0.042783 valid_1's l1: 0.202182 [2000] training's l1: 0.0278103 valid_1's l1: 0.200554 [2500] training's l1: 0.0186379 valid_1's l1: 0.199663 [3000] training's l1: 0.0127983 valid_1's l1: 0.199222 [3500] training's l1: 0.0090002 valid_1's l1: 0.198965 [4000] training's l1: 0.0065223 valid_1's l1: 0.198793 [4500] training's l1: 0.00487638 valid_1's l1: 0.198685 [5000] training's l1: 0.00377675 valid_1's l1: 0.19861 [5500] training's l1: 0.00301371 valid_1's l1: 0.198562 [6000] training's l1: 0.00247658 valid_1's l1: 0.198536 [6500] training's l1: 0.00208744 valid_1's l1: 0.198513 [7000] training's l1: 0.00180645 valid_1's l1: 0.198495 [7500] training's l1: 0.00161234 valid_1's l1: 0.198483 [8000] training's l1: 0.00148058 valid_1's l1: 0.198475 [8500] training's l1: 0.00140223 valid_1's l1: 0.198469 [9000] training's l1: 0.00134453 valid_1's l1: 0.198463 [9500] training's l1: 0.00129112 valid_1's l1: 0.198458 [10000] training's l1: 0.00121501 valid_1's l1: 0.198454 [10500] training's l1: 0.00113131 valid_1's l1: 0.198449 [11000] training's l1: 0.00106363 valid_1's l1: 0.198446 [11500] training's l1: 0.00100966 valid_1's l1: 0.198445 [12000] training's l1: 0.000967129 valid_1's l1: 0.198442 [12500] training's l1: 0.000930105 valid_1's l1: 0.198441 [13000] training's l1: 0.000898224 valid_1's l1: 0.198439 [13500] training's l1: 0.000870682 valid_1's l1: 0.198437 [14000] training's l1: 0.000847014 valid_1's l1: 0.198436 [14500] training's l1: 0.000825437 valid_1's l1: 0.198435 Early stopping, best iteration is: [14697] training's l1: 0.000817643 valid_1's l1: 0.198434 Fold 3 started at Mon Jun 10 00:26:33 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.115215 valid_1's l1: 0.215107 [1000] training's l1: 0.066886 valid_1's l1: 0.205541 [1500] training's l1: 0.0422545 valid_1's l1: 0.202189 [2000] training's l1: 0.0274822 valid_1's l1: 0.200452 [2500] training's l1: 0.0183317 valid_1's l1: 0.199516 [3000] training's l1: 0.0125237 valid_1's l1: 0.19901 [3500] training's l1: 0.00881343 valid_1's l1: 0.198732 [4000] training's l1: 0.00637525 valid_1's l1: 0.198563 [4500] training's l1: 0.00477651 valid_1's l1: 0.198465 [5000] training's l1: 0.00370245 valid_1's l1: 0.198406 [5500] training's l1: 0.00295466 valid_1's l1: 0.198371 [6000] training's l1: 0.00242997 valid_1's l1: 0.198345 [6500] training's l1: 0.00204563 valid_1's l1: 0.198321 [7000] training's l1: 0.00175931 valid_1's l1: 0.198307 [7500] training's l1: 0.00154552 valid_1's l1: 0.198297 [8000] training's l1: 0.00138771 valid_1's l1: 0.198289 [8500] training's l1: 0.00126925 valid_1's l1: 0.198282 [9000] training's l1: 0.00118029 valid_1's l1: 0.198278 [9500] training's l1: 0.00110948 valid_1's l1: 0.198274 [10000] training's l1: 0.00105157 valid_1's l1: 0.198271 [10500] training's l1: 0.00100396 valid_1's l1: 0.198268 [11000] training's l1: 0.000963838 valid_1's l1: 0.198266 Early stopping, best iteration is: [10962] training's l1: 0.000966549 valid_1's l1: 0.198266 Fold 4 started at Mon Jun 10 00:29:43 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.115557 valid_1's l1: 0.215306 [1000] training's l1: 0.0681546 valid_1's l1: 0.205549 [1500] training's l1: 0.0430772 valid_1's l1: 0.20198 [2000] training's l1: 0.0279919 valid_1's l1: 0.20028 [2500] training's l1: 0.0186952 valid_1's l1: 0.199395 [3000] training's l1: 0.0128081 valid_1's l1: 0.198924 [3500] training's l1: 0.00901227 valid_1's l1: 0.198634 [4000] training's l1: 0.00653217 valid_1's l1: 0.198481 [4500] training's l1: 0.00488947 valid_1's l1: 0.198381 [5000] training's l1: 0.00378346 valid_1's l1: 0.198311 [5500] training's l1: 0.00302282 valid_1's l1: 0.198267 [6000] training's l1: 0.00249252 valid_1's l1: 0.198237 [6500] training's l1: 0.00211172 valid_1's l1: 0.198218 [7000] training's l1: 0.00184631 valid_1's l1: 0.198206 [7500] training's l1: 0.00165495 valid_1's l1: 0.198194 [8000] training's l1: 0.00150598 valid_1's l1: 0.198186 [8500] training's l1: 0.00139094 valid_1's l1: 0.198181 Early stopping, best iteration is: [8388] training's l1: 0.0014137 valid_1's l1: 0.19818 Fold 5 started at Mon Jun 10 00:32:09 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.116132 valid_1's l1: 0.217344 [1000] training's l1: 0.0675205 valid_1's l1: 0.207289 [1500] training's l1: 0.0425057 valid_1's l1: 0.203775 [2000] training's l1: 0.0278373 valid_1's l1: 0.202176 [2500] training's l1: 0.0186073 valid_1's l1: 0.201332 [3000] training's l1: 0.012696 valid_1's l1: 0.200848 [3500] training's l1: 0.00891576 valid_1's l1: 0.200612 [4000] training's l1: 0.00644938 valid_1's l1: 0.20045 [4500] training's l1: 0.00482431 valid_1's l1: 0.200346 [5000] training's l1: 0.00373715 valid_1's l1: 0.200278 [5500] training's l1: 0.00297906 valid_1's l1: 0.200234 [6000] training's l1: 0.00245103 valid_1's l1: 0.200215 [6500] training's l1: 0.00206336 valid_1's l1: 0.200194 [7000] training's l1: 0.00177771 valid_1's l1: 0.200179 [7500] training's l1: 0.00156415 valid_1's l1: 0.200169 [8000] training's l1: 0.00140414 valid_1's l1: 0.20016 [8500] training's l1: 0.00128114 valid_1's l1: 0.200151 [9000] training's l1: 0.00118415 valid_1's l1: 0.200149 [9500] training's l1: 0.00110903 valid_1's l1: 0.200145 [10000] training's l1: 0.00104947 valid_1's l1: 0.200142 [10500] training's l1: 0.00100054 valid_1's l1: 0.20014 [11000] training's l1: 0.000959441 valid_1's l1: 0.200138 Early stopping, best iteration is: [10956] training's l1: 0.000962698 valid_1's l1: 0.200138 CV mean score: -1.6157, std: 0.0036. id scalar_coupling_constant 0 4658147 12.178853 1 4658148 194.814408 2 4658149 9.411926 3 4658150 187.544265 4 4658151 8.907442 finished.