STARTING : 2019-06-13 05:12:15 Mem. usage decreased to 1488.19 Mb (75.7% reduction) Mem. usage decreased to 767.02 Mb (76.0% reduction) Fold 1 started at Thu Jun 13 05:20:21 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.646837 valid_1's l1: 0.675786 [1000] training's l1: 0.558714 valid_1's l1: 0.608391 [1500] training's l1: 0.507368 valid_1's l1: 0.574368 [2000] training's l1: 0.469128 valid_1's l1: 0.550936 [2500] training's l1: 0.439433 valid_1's l1: 0.534594 [3000] training's l1: 0.414957 valid_1's l1: 0.522423 [3500] training's l1: 0.393596 valid_1's l1: 0.512285 [4000] training's l1: 0.375109 valid_1's l1: 0.504541 [4500] training's l1: 0.358585 valid_1's l1: 0.497922 [5000] training's l1: 0.343714 valid_1's l1: 0.492256 [5500] training's l1: 0.330085 valid_1's l1: 0.48729 [6000] training's l1: 0.317488 valid_1's l1: 0.482798 [6500] training's l1: 0.305849 valid_1's l1: 0.478913 [7000] training's l1: 0.295023 valid_1's l1: 0.475407 [7500] training's l1: 0.285045 valid_1's l1: 0.47245 [8000] training's l1: 0.275524 valid_1's l1: 0.469715 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.275524 valid_1's l1: 0.469715 Fold 2 started at Thu Jun 13 05:45:24 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.648475 valid_1's l1: 0.67865 [1000] training's l1: 0.559988 valid_1's l1: 0.611213 [1500] training's l1: 0.508086 valid_1's l1: 0.57648 [2000] training's l1: 0.469927 valid_1's l1: 0.553515 [2500] training's l1: 0.439869 valid_1's l1: 0.537219 [3000] training's l1: 0.414775 valid_1's l1: 0.5244 [3500] training's l1: 0.393295 valid_1's l1: 0.514188 [4000] training's l1: 0.374668 valid_1's l1: 0.506187 [4500] training's l1: 0.358327 valid_1's l1: 0.499452 [5000] training's l1: 0.343496 valid_1's l1: 0.493572 [5500] training's l1: 0.329801 valid_1's l1: 0.488408 [6000] training's l1: 0.317368 valid_1's l1: 0.484036 [6500] training's l1: 0.305728 valid_1's l1: 0.480095 [7000] training's l1: 0.29492 valid_1's l1: 0.476636 [7500] training's l1: 0.284719 valid_1's l1: 0.47348 [8000] training's l1: 0.275445 valid_1's l1: 0.47087 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.275445 valid_1's l1: 0.47087 Fold 3 started at Thu Jun 13 06:10:52 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.648767 valid_1's l1: 0.678756 [1000] training's l1: 0.559764 valid_1's l1: 0.609989 [1500] training's l1: 0.507661 valid_1's l1: 0.575005 [2000] training's l1: 0.469991 valid_1's l1: 0.552751 [2500] training's l1: 0.439645 valid_1's l1: 0.535928 [3000] training's l1: 0.414737 valid_1's l1: 0.523302 [3500] training's l1: 0.393104 valid_1's l1: 0.513002 [4000] training's l1: 0.374381 valid_1's l1: 0.504655 [4500] training's l1: 0.357879 valid_1's l1: 0.498032 [5000] training's l1: 0.342994 valid_1's l1: 0.492293 [5500] training's l1: 0.329326 valid_1's l1: 0.487125 [6000] training's l1: 0.316849 valid_1's l1: 0.482827 [6500] training's l1: 0.305398 valid_1's l1: 0.479152 [7000] training's l1: 0.294597 valid_1's l1: 0.475805 [7500] training's l1: 0.284543 valid_1's l1: 0.472746 [8000] training's l1: 0.27503 valid_1's l1: 0.469924 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.27503 valid_1's l1: 0.469924 Fold 4 started at Thu Jun 13 06:34:39 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.646938 valid_1's l1: 0.677264 [1000] training's l1: 0.560167 valid_1's l1: 0.611286 [1500] training's l1: 0.507725 valid_1's l1: 0.576233 [2000] training's l1: 0.469951 valid_1's l1: 0.553339 [2500] training's l1: 0.439499 valid_1's l1: 0.536302 [3000] training's l1: 0.414612 valid_1's l1: 0.52346 [3500] training's l1: 0.393146 valid_1's l1: 0.513262 [4000] training's l1: 0.374588 valid_1's l1: 0.50512 [4500] training's l1: 0.358199 valid_1's l1: 0.498456 [5000] training's l1: 0.343132 valid_1's l1: 0.492528 [5500] training's l1: 0.329669 valid_1's l1: 0.487738 [6000] training's l1: 0.31708 valid_1's l1: 0.483437 [6500] training's l1: 0.305537 valid_1's l1: 0.479584 [7000] training's l1: 0.294793 valid_1's l1: 0.476215 [7500] training's l1: 0.284587 valid_1's l1: 0.472971 [8000] training's l1: 0.275247 valid_1's l1: 0.470253 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.275247 valid_1's l1: 0.470253 Fold 5 started at Thu Jun 13 07:00:13 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.649177 valid_1's l1: 0.67992 [1000] training's l1: 0.559251 valid_1's l1: 0.610148 [1500] training's l1: 0.505905 valid_1's l1: 0.573945 [2000] training's l1: 0.468066 valid_1's l1: 0.550789 [2500] training's l1: 0.438326 valid_1's l1: 0.534453 [3000] training's l1: 0.413408 valid_1's l1: 0.521546 [3500] training's l1: 0.392366 valid_1's l1: 0.511871 [4000] training's l1: 0.373655 valid_1's l1: 0.503609 [4500] training's l1: 0.357462 valid_1's l1: 0.497032 [5000] training's l1: 0.342405 valid_1's l1: 0.491278 [5500] training's l1: 0.328965 valid_1's l1: 0.486395 [6000] training's l1: 0.316563 valid_1's l1: 0.482147 [6500] training's l1: 0.304924 valid_1's l1: 0.478294 [7000] training's l1: 0.294086 valid_1's l1: 0.474775 [7500] training's l1: 0.284082 valid_1's l1: 0.4718 [8000] training's l1: 0.274725 valid_1's l1: 0.469183 Did not meet early stopping. Best iteration is: [8000] training's l1: 0.274725 valid_1's l1: 0.469183 CV mean score: -0.8756, std: 0.0017. X['type'].unique(): [0 3 1 4 2 6 5 7] Training of type 0 X_t.shape: (709416, 147), X_test_t.shape: (380609, 147) Fold 1 started at Thu Jun 13 07:25:46 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.792723 valid_1's l1: 0.941627 [1000] training's l1: 0.655462 valid_1's l1: 0.927818 [1500] training's l1: 0.549735 valid_1's l1: 0.91646 [2000] training's l1: 0.465247 valid_1's l1: 0.907778 [2500] training's l1: 0.397219 valid_1's l1: 0.899896 [3000] training's l1: 0.341537 valid_1's l1: 0.894055 [3500] training's l1: 0.295777 valid_1's l1: 0.888707 [4000] training's l1: 0.257061 valid_1's l1: 0.884952 [4500] training's l1: 0.224155 valid_1's l1: 0.881786 [5000] training's l1: 0.19596 valid_1's l1: 0.879269 [5500] training's l1: 0.171853 valid_1's l1: 0.877076 [6000] training's l1: 0.15125 valid_1's l1: 0.875409 [6500] training's l1: 0.133361 valid_1's l1: 0.873824 [7000] training's l1: 0.117785 valid_1's l1: 0.872537 [7500] training's l1: 0.104289 valid_1's l1: 0.871471 [8000] training's l1: 0.0924945 valid_1's l1: 0.870754 [8500] training's l1: 0.0820582 valid_1's l1: 0.870064 [9000] training's l1: 0.0729915 valid_1's l1: 0.86949 [9500] training's l1: 0.0649091 valid_1's l1: 0.869017 [10000] training's l1: 0.0578497 valid_1's l1: 0.868516 [10500] training's l1: 0.0516408 valid_1's l1: 0.868135 [11000] training's l1: 0.0461322 valid_1's l1: 0.867814 [11500] training's l1: 0.0412395 valid_1's l1: 0.867554 [12000] training's l1: 0.0369085 valid_1's l1: 0.867288 [12500] training's l1: 0.0330906 valid_1's l1: 0.86708 [13000] training's l1: 0.0296717 valid_1's l1: 0.866889 [13500] training's l1: 0.0266351 valid_1's l1: 0.866711 [14000] training's l1: 0.0239239 valid_1's l1: 0.866548 [14500] training's l1: 0.0214981 valid_1's l1: 0.866428 [15000] training's l1: 0.019366 valid_1's l1: 0.866321 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.019366 valid_1's l1: 0.866321 Fold 2 started at Thu Jun 13 07:37:30 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.788496 valid_1's l1: 0.947337 [1000] training's l1: 0.650798 valid_1's l1: 0.933554 [1500] training's l1: 0.544855 valid_1's l1: 0.921896 [2000] training's l1: 0.461913 valid_1's l1: 0.912429 [2500] training's l1: 0.393869 valid_1's l1: 0.904665 [3000] training's l1: 0.338743 valid_1's l1: 0.898751 [3500] training's l1: 0.293018 valid_1's l1: 0.893477 [4000] training's l1: 0.254501 valid_1's l1: 0.889716 [4500] training's l1: 0.221865 valid_1's l1: 0.886578 [5000] training's l1: 0.194218 valid_1's l1: 0.883647 [5500] training's l1: 0.170399 valid_1's l1: 0.881359 [6000] training's l1: 0.149801 valid_1's l1: 0.879557 [6500] training's l1: 0.1321 valid_1's l1: 0.877933 [7000] training's l1: 0.116719 valid_1's l1: 0.876753 [7500] training's l1: 0.103125 valid_1's l1: 0.875717 [8000] training's l1: 0.0913533 valid_1's l1: 0.874863 [8500] training's l1: 0.0810877 valid_1's l1: 0.874158 [9000] training's l1: 0.0721067 valid_1's l1: 0.873552 [9500] training's l1: 0.0641721 valid_1's l1: 0.873067 [10000] training's l1: 0.0571817 valid_1's l1: 0.872551 [10500] training's l1: 0.05105 valid_1's l1: 0.872071 [11000] training's l1: 0.0455834 valid_1's l1: 0.871754 [11500] training's l1: 0.0407229 valid_1's l1: 0.871469 [12000] training's l1: 0.0364029 valid_1's l1: 0.871225 [12500] training's l1: 0.032607 valid_1's l1: 0.871033 [13000] training's l1: 0.0292355 valid_1's l1: 0.870836 [13500] training's l1: 0.0262457 valid_1's l1: 0.870687 [14000] training's l1: 0.0235795 valid_1's l1: 0.870556 [14500] training's l1: 0.0212333 valid_1's l1: 0.870448 [15000] training's l1: 0.0191301 valid_1's l1: 0.870355 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0191301 valid_1's l1: 0.870355 Fold 3 started at Thu Jun 13 07:49:18 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.782107 valid_1's l1: 0.945667 [1000] training's l1: 0.644864 valid_1's l1: 0.93008 [1500] training's l1: 0.540028 valid_1's l1: 0.918183 [2000] training's l1: 0.457939 valid_1's l1: 0.908885 [2500] training's l1: 0.390865 valid_1's l1: 0.900884 [3000] training's l1: 0.336291 valid_1's l1: 0.894707 [3500] training's l1: 0.291085 valid_1's l1: 0.890081 [4000] training's l1: 0.252782 valid_1's l1: 0.886395 [4500] training's l1: 0.220518 valid_1's l1: 0.883116 [5000] training's l1: 0.193119 valid_1's l1: 0.880597 [5500] training's l1: 0.169619 valid_1's l1: 0.878538 [6000] training's l1: 0.149284 valid_1's l1: 0.876592 [6500] training's l1: 0.131792 valid_1's l1: 0.875071 [7000] training's l1: 0.116401 valid_1's l1: 0.873897 [7500] training's l1: 0.103038 valid_1's l1: 0.87291 [8000] training's l1: 0.0913322 valid_1's l1: 0.872073 [8500] training's l1: 0.0810929 valid_1's l1: 0.871379 [9000] training's l1: 0.0720552 valid_1's l1: 0.870804 [9500] training's l1: 0.06421 valid_1's l1: 0.87034 [10000] training's l1: 0.0572388 valid_1's l1: 0.870003 [10500] training's l1: 0.0511165 valid_1's l1: 0.869656 [11000] training's l1: 0.0456115 valid_1's l1: 0.869349 [11500] training's l1: 0.0408313 valid_1's l1: 0.869086 [12000] training's l1: 0.0365475 valid_1's l1: 0.868848 [12500] training's l1: 0.0327371 valid_1's l1: 0.868646 [13000] training's l1: 0.0293694 valid_1's l1: 0.868478 [13500] training's l1: 0.0263751 valid_1's l1: 0.868334 [14000] training's l1: 0.0236931 valid_1's l1: 0.86816 [14500] training's l1: 0.0213221 valid_1's l1: 0.868045 [15000] training's l1: 0.0191912 valid_1's l1: 0.867929 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0191912 valid_1's l1: 0.867929 Fold 4 started at Thu Jun 13 08:00:56 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.791808 valid_1's l1: 0.948665 [1000] training's l1: 0.654242 valid_1's l1: 0.933704 [1500] training's l1: 0.547647 valid_1's l1: 0.921075 [2000] training's l1: 0.463672 valid_1's l1: 0.911298 [2500] training's l1: 0.395644 valid_1's l1: 0.903454 [3000] training's l1: 0.340461 valid_1's l1: 0.896974 [3500] training's l1: 0.294634 valid_1's l1: 0.892054 [4000] training's l1: 0.255823 valid_1's l1: 0.88813 [4500] training's l1: 0.22292 valid_1's l1: 0.88497 [5000] training's l1: 0.195181 valid_1's l1: 0.882429 [5500] training's l1: 0.171384 valid_1's l1: 0.880093 [6000] training's l1: 0.150796 valid_1's l1: 0.87834 [6500] training's l1: 0.133013 valid_1's l1: 0.876912 [7000] training's l1: 0.117523 valid_1's l1: 0.875714 [7500] training's l1: 0.103971 valid_1's l1: 0.874614 [8000] training's l1: 0.0921729 valid_1's l1: 0.873742 [8500] training's l1: 0.0817963 valid_1's l1: 0.873031 [9000] training's l1: 0.0727461 valid_1's l1: 0.872299 [9500] training's l1: 0.0648181 valid_1's l1: 0.871694 [10000] training's l1: 0.0577368 valid_1's l1: 0.87123 [10500] training's l1: 0.0514986 valid_1's l1: 0.870851 [11000] training's l1: 0.046001 valid_1's l1: 0.87052 [11500] training's l1: 0.0411114 valid_1's l1: 0.870217 [12000] training's l1: 0.0367998 valid_1's l1: 0.869981 [12500] training's l1: 0.0329897 valid_1's l1: 0.869753 [13000] training's l1: 0.0295957 valid_1's l1: 0.869572 [13500] training's l1: 0.0265551 valid_1's l1: 0.869398 [14000] training's l1: 0.0238761 valid_1's l1: 0.869238 [14500] training's l1: 0.0214863 valid_1's l1: 0.869111 [15000] training's l1: 0.0193442 valid_1's l1: 0.869011 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0193442 valid_1's l1: 0.869011 Fold 5 started at Thu Jun 13 08:12:20 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.788394 valid_1's l1: 0.947494 [1000] training's l1: 0.652589 valid_1's l1: 0.933318 [1500] training's l1: 0.547094 valid_1's l1: 0.921136 [2000] training's l1: 0.462805 valid_1's l1: 0.912068 [2500] training's l1: 0.394616 valid_1's l1: 0.904518 [3000] training's l1: 0.339683 valid_1's l1: 0.898781 [3500] training's l1: 0.293713 valid_1's l1: 0.893474 [4000] training's l1: 0.25546 valid_1's l1: 0.889376 [4500] training's l1: 0.222428 valid_1's l1: 0.885571 [5000] training's l1: 0.194658 valid_1's l1: 0.882948 [5500] training's l1: 0.170967 valid_1's l1: 0.880624 [6000] training's l1: 0.150255 valid_1's l1: 0.878731 [6500] training's l1: 0.132476 valid_1's l1: 0.877419 [7000] training's l1: 0.116927 valid_1's l1: 0.876063 [7500] training's l1: 0.103441 valid_1's l1: 0.875151 [8000] training's l1: 0.0917749 valid_1's l1: 0.874157 [8500] training's l1: 0.0815504 valid_1's l1: 0.873525 [9000] training's l1: 0.0724834 valid_1's l1: 0.872965 [9500] training's l1: 0.0645347 valid_1's l1: 0.872415 [10000] training's l1: 0.0574871 valid_1's l1: 0.871959 [10500] training's l1: 0.0512852 valid_1's l1: 0.871557 [11000] training's l1: 0.0458299 valid_1's l1: 0.871259 [11500] training's l1: 0.040995 valid_1's l1: 0.870929 [12000] training's l1: 0.0367017 valid_1's l1: 0.870705 [12500] training's l1: 0.0328788 valid_1's l1: 0.870482 [13000] training's l1: 0.0294966 valid_1's l1: 0.870321 [13500] training's l1: 0.0264603 valid_1's l1: 0.870186 [14000] training's l1: 0.0237662 valid_1's l1: 0.870051 [14500] training's l1: 0.0213843 valid_1's l1: 0.86995 [15000] training's l1: 0.0192509 valid_1's l1: 0.869847 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0192509 valid_1's l1: 0.869847 CV mean score: -0.1408, std: 0.0017. Training of type 3 X_t.shape: (378036, 147), X_test_t.shape: (203126, 147) Fold 1 started at Thu Jun 13 08:24:57 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.178828 valid_1's l1: 0.248121 [1000] training's l1: 0.122138 valid_1's l1: 0.231347 [1500] training's l1: 0.089846 valid_1's l1: 0.223751 [2000] training's l1: 0.0682628 valid_1's l1: 0.219706 [2500] training's l1: 0.0528287 valid_1's l1: 0.217465 [3000] training's l1: 0.041473 valid_1's l1: 0.216062 [3500] training's l1: 0.0329369 valid_1's l1: 0.215181 [4000] training's l1: 0.0263219 valid_1's l1: 0.214508 [4500] training's l1: 0.0211887 valid_1's l1: 0.214089 [5000] training's l1: 0.0171711 valid_1's l1: 0.213788 [5500] training's l1: 0.0140134 valid_1's l1: 0.21357 [6000] training's l1: 0.0115045 valid_1's l1: 0.213383 [6500] training's l1: 0.00947553 valid_1's l1: 0.213253 [7000] training's l1: 0.00787621 valid_1's l1: 0.213159 [7500] training's l1: 0.00659343 valid_1's l1: 0.213099 [8000] training's l1: 0.00556007 valid_1's l1: 0.213037 [8500] training's l1: 0.0047299 valid_1's l1: 0.213003 [9000] training's l1: 0.00405168 valid_1's l1: 0.212963 [9500] training's l1: 0.00350453 valid_1's l1: 0.212933 [10000] training's l1: 0.00305905 valid_1's l1: 0.21291 [10500] training's l1: 0.00268833 valid_1's l1: 0.212888 [11000] training's l1: 0.00238376 valid_1's l1: 0.212874 [11500] training's l1: 0.00212811 valid_1's l1: 0.212857 [12000] training's l1: 0.00191428 valid_1's l1: 0.212845 [12500] training's l1: 0.00173401 valid_1's l1: 0.212835 [13000] training's l1: 0.0015808 valid_1's l1: 0.212826 [13500] training's l1: 0.00144916 valid_1's l1: 0.212818 [14000] training's l1: 0.00133548 valid_1's l1: 0.212812 [14500] training's l1: 0.00123839 valid_1's l1: 0.212806 [15000] training's l1: 0.00115351 valid_1's l1: 0.212802 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00115351 valid_1's l1: 0.212802 Fold 2 started at Thu Jun 13 08:34:11 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.177292 valid_1's l1: 0.247769 [1000] training's l1: 0.122071 valid_1's l1: 0.232179 [1500] training's l1: 0.0894822 valid_1's l1: 0.224206 [2000] training's l1: 0.0679151 valid_1's l1: 0.219898 [2500] training's l1: 0.0527509 valid_1's l1: 0.217814 [3000] training's l1: 0.0414664 valid_1's l1: 0.216367 [3500] training's l1: 0.0329583 valid_1's l1: 0.215526 [4000] training's l1: 0.0263134 valid_1's l1: 0.214908 [4500] training's l1: 0.02116 valid_1's l1: 0.214478 [5000] training's l1: 0.0171468 valid_1's l1: 0.214122 [5500] training's l1: 0.0139777 valid_1's l1: 0.213915 [6000] training's l1: 0.0114508 valid_1's l1: 0.213724 [6500] training's l1: 0.00944944 valid_1's l1: 0.213611 [7000] training's l1: 0.00786436 valid_1's l1: 0.213517 [7500] training's l1: 0.00658414 valid_1's l1: 0.213434 [8000] training's l1: 0.00555229 valid_1's l1: 0.213385 [8500] training's l1: 0.00471955 valid_1's l1: 0.213342 [9000] training's l1: 0.00405132 valid_1's l1: 0.213305 [9500] training's l1: 0.00349918 valid_1's l1: 0.213279 [10000] training's l1: 0.00305181 valid_1's l1: 0.213255 [10500] training's l1: 0.00268207 valid_1's l1: 0.213236 [11000] training's l1: 0.00237774 valid_1's l1: 0.213221 [11500] training's l1: 0.00212265 valid_1's l1: 0.213207 [12000] training's l1: 0.00190907 valid_1's l1: 0.213192 [12500] training's l1: 0.00172788 valid_1's l1: 0.213184 [13000] training's l1: 0.00157529 valid_1's l1: 0.213177 [13500] training's l1: 0.00144259 valid_1's l1: 0.213172 [14000] training's l1: 0.00132979 valid_1's l1: 0.213166 [14500] training's l1: 0.00123192 valid_1's l1: 0.213162 [15000] training's l1: 0.00114644 valid_1's l1: 0.213157 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00114644 valid_1's l1: 0.213157 Fold 3 started at Thu Jun 13 08:43:30 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.177631 valid_1's l1: 0.248488 [1000] training's l1: 0.122284 valid_1's l1: 0.232005 [1500] training's l1: 0.0893866 valid_1's l1: 0.224025 [2000] training's l1: 0.0678913 valid_1's l1: 0.220074 [2500] training's l1: 0.0526694 valid_1's l1: 0.217775 [3000] training's l1: 0.0413707 valid_1's l1: 0.2163 [3500] training's l1: 0.0327794 valid_1's l1: 0.215404 [4000] training's l1: 0.0262293 valid_1's l1: 0.214766 [4500] training's l1: 0.0211113 valid_1's l1: 0.214365 [5000] training's l1: 0.0171035 valid_1's l1: 0.214044 [5500] training's l1: 0.0139446 valid_1's l1: 0.213824 [6000] training's l1: 0.0114476 valid_1's l1: 0.213647 [6500] training's l1: 0.00944802 valid_1's l1: 0.213534 [7000] training's l1: 0.00785288 valid_1's l1: 0.213446 [7500] training's l1: 0.0065664 valid_1's l1: 0.213383 [8000] training's l1: 0.00553407 valid_1's l1: 0.213325 [8500] training's l1: 0.00471236 valid_1's l1: 0.213277 [9000] training's l1: 0.00404237 valid_1's l1: 0.213246 [9500] training's l1: 0.00349383 valid_1's l1: 0.213217 [10000] training's l1: 0.00304824 valid_1's l1: 0.21319 [10500] training's l1: 0.00267848 valid_1's l1: 0.213174 [11000] training's l1: 0.00237666 valid_1's l1: 0.213158 [11500] training's l1: 0.00212313 valid_1's l1: 0.213146 [12000] training's l1: 0.00191054 valid_1's l1: 0.213135 [12500] training's l1: 0.00173008 valid_1's l1: 0.213125 [13000] training's l1: 0.00157733 valid_1's l1: 0.213116 [13500] training's l1: 0.00144602 valid_1's l1: 0.21311 [14000] training's l1: 0.00133297 valid_1's l1: 0.213105 [14500] training's l1: 0.00123582 valid_1's l1: 0.2131 [15000] training's l1: 0.00114995 valid_1's l1: 0.213095 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00114995 valid_1's l1: 0.213095 Fold 4 started at Thu Jun 13 08:52:51 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.178235 valid_1's l1: 0.24835 [1000] training's l1: 0.122674 valid_1's l1: 0.231846 [1500] training's l1: 0.0897113 valid_1's l1: 0.224232 [2000] training's l1: 0.0682108 valid_1's l1: 0.220028 [2500] training's l1: 0.0529672 valid_1's l1: 0.21765 [3000] training's l1: 0.0416029 valid_1's l1: 0.216186 [3500] training's l1: 0.0328813 valid_1's l1: 0.215179 [4000] training's l1: 0.0262529 valid_1's l1: 0.214572 [4500] training's l1: 0.0211336 valid_1's l1: 0.214158 [5000] training's l1: 0.0171162 valid_1's l1: 0.213827 [5500] training's l1: 0.0139537 valid_1's l1: 0.213583 [6000] training's l1: 0.0114364 valid_1's l1: 0.213405 [6500] training's l1: 0.00943673 valid_1's l1: 0.213278 [7000] training's l1: 0.007838 valid_1's l1: 0.21319 [7500] training's l1: 0.00656809 valid_1's l1: 0.213117 [8000] training's l1: 0.00554189 valid_1's l1: 0.213054 [8500] training's l1: 0.00471444 valid_1's l1: 0.21301 [9000] training's l1: 0.00404073 valid_1's l1: 0.212974 [9500] training's l1: 0.00349422 valid_1's l1: 0.212947 [10000] training's l1: 0.00305012 valid_1's l1: 0.21292 [10500] training's l1: 0.00268395 valid_1's l1: 0.212901 [11000] training's l1: 0.00238047 valid_1's l1: 0.212886 [11500] training's l1: 0.00212543 valid_1's l1: 0.212873 [12000] training's l1: 0.0019122 valid_1's l1: 0.212862 [12500] training's l1: 0.00173182 valid_1's l1: 0.212855 [13000] training's l1: 0.00157869 valid_1's l1: 0.212847 [13500] training's l1: 0.00144739 valid_1's l1: 0.21284 [14000] training's l1: 0.00133324 valid_1's l1: 0.212835 [14500] training's l1: 0.00123527 valid_1's l1: 0.21283 [15000] training's l1: 0.00115019 valid_1's l1: 0.212825 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00115019 valid_1's l1: 0.212825 Fold 5 started at Thu Jun 13 09:02:01 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.176967 valid_1's l1: 0.248398 [1000] training's l1: 0.121617 valid_1's l1: 0.23141 [1500] training's l1: 0.0892458 valid_1's l1: 0.223792 [2000] training's l1: 0.0678677 valid_1's l1: 0.21983 [2500] training's l1: 0.0525479 valid_1's l1: 0.217591 [3000] training's l1: 0.0412149 valid_1's l1: 0.216269 [3500] training's l1: 0.0327596 valid_1's l1: 0.215417 [4000] training's l1: 0.0261958 valid_1's l1: 0.214764 [4500] training's l1: 0.0211218 valid_1's l1: 0.214354 [5000] training's l1: 0.0170715 valid_1's l1: 0.214043 [5500] training's l1: 0.0139226 valid_1's l1: 0.213799 [6000] training's l1: 0.0114355 valid_1's l1: 0.213618 [6500] training's l1: 0.00944685 valid_1's l1: 0.213499 [7000] training's l1: 0.00784231 valid_1's l1: 0.21341 [7500] training's l1: 0.00657338 valid_1's l1: 0.213334 [8000] training's l1: 0.00554521 valid_1's l1: 0.213285 [8500] training's l1: 0.00472002 valid_1's l1: 0.21324 [9000] training's l1: 0.00405202 valid_1's l1: 0.213202 [9500] training's l1: 0.0034995 valid_1's l1: 0.213175 [10000] training's l1: 0.0030548 valid_1's l1: 0.213148 [10500] training's l1: 0.00268674 valid_1's l1: 0.213129 [11000] training's l1: 0.00238239 valid_1's l1: 0.213111 [11500] training's l1: 0.002128 valid_1's l1: 0.213099 [12000] training's l1: 0.00191456 valid_1's l1: 0.213086 [12500] training's l1: 0.00173443 valid_1's l1: 0.213077 [13000] training's l1: 0.0015815 valid_1's l1: 0.213068 [13500] training's l1: 0.00144887 valid_1's l1: 0.213062 [14000] training's l1: 0.00133468 valid_1's l1: 0.213054 [14500] training's l1: 0.00123572 valid_1's l1: 0.21305 [15000] training's l1: 0.0011509 valid_1's l1: 0.213046 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0011509 valid_1's l1: 0.213046 CV mean score: -1.5465, std: 0.0007. Training of type 1 X_t.shape: (43363, 147), X_test_t.shape: (24195, 147) Fold 1 started at Thu Jun 13 09:12:25 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.193493 valid_1's l1: 0.535283 [1000] training's l1: 0.0720105 valid_1's l1: 0.519742 [1500] training's l1: 0.0290453 valid_1's l1: 0.515643 [2000] training's l1: 0.0111634 valid_1's l1: 0.514505 [2500] training's l1: 0.00445862 valid_1's l1: 0.514045 [3000] training's l1: 0.00239773 valid_1's l1: 0.513936 [3500] training's l1: 0.00174695 valid_1's l1: 0.513891 [4000] training's l1: 0.00145731 valid_1's l1: 0.513869 [4500] training's l1: 0.00128908 valid_1's l1: 0.513855 [5000] training's l1: 0.001176 valid_1's l1: 0.513847 [5500] training's l1: 0.00109256 valid_1's l1: 0.513839 [6000] training's l1: 0.00102926 valid_1's l1: 0.513835 [6500] training's l1: 0.000978741 valid_1's l1: 0.513829 Early stopping, best iteration is: [6562] training's l1: 0.000972868 valid_1's l1: 0.513828 Fold 2 started at Thu Jun 13 09:13:43 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.209223 valid_1's l1: 0.542939 [1000] training's l1: 0.0766398 valid_1's l1: 0.526326 [1500] training's l1: 0.0308701 valid_1's l1: 0.522043 [2000] training's l1: 0.0119196 valid_1's l1: 0.52065 [2500] training's l1: 0.00477025 valid_1's l1: 0.520307 [3000] training's l1: 0.00252096 valid_1's l1: 0.520221 [3500] training's l1: 0.0018095 valid_1's l1: 0.520193 [4000] training's l1: 0.00149529 valid_1's l1: 0.52018 [4500] training's l1: 0.00132052 valid_1's l1: 0.520161 [5000] training's l1: 0.00120667 valid_1's l1: 0.520152 [5500] training's l1: 0.00112001 valid_1's l1: 0.520147 Early stopping, best iteration is: [5606] training's l1: 0.00110532 valid_1's l1: 0.520146 Fold 3 started at Thu Jun 13 09:14:51 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.197959 valid_1's l1: 0.540502 [1000] training's l1: 0.074555 valid_1's l1: 0.52389 [1500] training's l1: 0.0303658 valid_1's l1: 0.520011 [2000] training's l1: 0.0121253 valid_1's l1: 0.518914 [2500] training's l1: 0.00483036 valid_1's l1: 0.518503 [3000] training's l1: 0.00254155 valid_1's l1: 0.518364 [3500] training's l1: 0.00181812 valid_1's l1: 0.518322 [4000] training's l1: 0.00150235 valid_1's l1: 0.518298 [4500] training's l1: 0.00132111 valid_1's l1: 0.518286 [5000] training's l1: 0.00120316 valid_1's l1: 0.51828 [5500] training's l1: 0.00111662 valid_1's l1: 0.518273 [6000] training's l1: 0.0010499 valid_1's l1: 0.518268 [6500] training's l1: 0.000996315 valid_1's l1: 0.518265 [7000] training's l1: 0.000951467 valid_1's l1: 0.518261 [7500] training's l1: 0.000913215 valid_1's l1: 0.518259 Early stopping, best iteration is: [7601] training's l1: 0.000906742 valid_1's l1: 0.518258 Fold 4 started at Thu Jun 13 09:16:10 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.193437 valid_1's l1: 0.539374 [1000] training's l1: 0.0708492 valid_1's l1: 0.523559 [1500] training's l1: 0.0283021 valid_1's l1: 0.519297 [2000] training's l1: 0.0111353 valid_1's l1: 0.518062 [2500] training's l1: 0.00454137 valid_1's l1: 0.517656 [3000] training's l1: 0.00244542 valid_1's l1: 0.5175 [3500] training's l1: 0.0017695 valid_1's l1: 0.517465 [4000] training's l1: 0.00147053 valid_1's l1: 0.517451 [4500] training's l1: 0.00130077 valid_1's l1: 0.517438 [5000] training's l1: 0.00118585 valid_1's l1: 0.517427 [5500] training's l1: 0.00110346 valid_1's l1: 0.517415 [6000] training's l1: 0.00103913 valid_1's l1: 0.517411 [6500] training's l1: 0.000988096 valid_1's l1: 0.517408 Early stopping, best iteration is: [6771] training's l1: 0.000962967 valid_1's l1: 0.517405 Fold 5 started at Thu Jun 13 09:17:28 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.200968 valid_1's l1: 0.537104 [1000] training's l1: 0.072919 valid_1's l1: 0.520736 [1500] training's l1: 0.0289093 valid_1's l1: 0.516675 [2000] training's l1: 0.0113309 valid_1's l1: 0.515671 [2500] training's l1: 0.00462383 valid_1's l1: 0.515272 [3000] training's l1: 0.00247998 valid_1's l1: 0.515151 [3500] training's l1: 0.00178412 valid_1's l1: 0.515096 [4000] training's l1: 0.00147766 valid_1's l1: 0.515086 [4500] training's l1: 0.00130395 valid_1's l1: 0.515072 [5000] training's l1: 0.00118668 valid_1's l1: 0.515064 [5500] training's l1: 0.00110296 valid_1's l1: 0.515057 [6000] training's l1: 0.00103595 valid_1's l1: 0.515055 Early stopping, best iteration is: [5844] training's l1: 0.00105599 valid_1's l1: 0.515053 CV mean score: -0.6598, std: 0.0044. Training of type 4 X_t.shape: (119253, 147), X_test_t.shape: (64424, 147) Fold 1 started at Thu Jun 13 09:19:17 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.108792 valid_1's l1: 0.236319 [1000] training's l1: 0.0534044 valid_1's l1: 0.227308 [1500] training's l1: 0.0281152 valid_1's l1: 0.224397 [2000] training's l1: 0.0153136 valid_1's l1: 0.223521 [2500] training's l1: 0.00880573 valid_1's l1: 0.223127 [3000] training's l1: 0.00535643 valid_1's l1: 0.222967 [3500] training's l1: 0.00351869 valid_1's l1: 0.22286 [4000] training's l1: 0.00249661 valid_1's l1: 0.222815 [4500] training's l1: 0.00188829 valid_1's l1: 0.222792 [5000] training's l1: 0.00151369 valid_1's l1: 0.222776 [5500] training's l1: 0.00128669 valid_1's l1: 0.222762 [6000] training's l1: 0.00114269 valid_1's l1: 0.222756 [6500] training's l1: 0.00104486 valid_1's l1: 0.222749 [7000] training's l1: 0.000973263 valid_1's l1: 0.222745 [7500] training's l1: 0.0009158 valid_1's l1: 0.222741 [8000] training's l1: 0.000869711 valid_1's l1: 0.222739 Early stopping, best iteration is: [8205] training's l1: 0.000852979 valid_1's l1: 0.222738 Fold 2 started at Thu Jun 13 09:22:16 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.109895 valid_1's l1: 0.236829 [1000] training's l1: 0.0542731 valid_1's l1: 0.228079 [1500] training's l1: 0.0288631 valid_1's l1: 0.225517 [2000] training's l1: 0.0157765 valid_1's l1: 0.224412 [2500] training's l1: 0.00900565 valid_1's l1: 0.223984 [3000] training's l1: 0.00546628 valid_1's l1: 0.223802 [3500] training's l1: 0.00357863 valid_1's l1: 0.223714 [4000] training's l1: 0.00251812 valid_1's l1: 0.223678 [4500] training's l1: 0.00189469 valid_1's l1: 0.223646 [5000] training's l1: 0.00151928 valid_1's l1: 0.223627 [5500] training's l1: 0.00128862 valid_1's l1: 0.223618 [6000] training's l1: 0.00114429 valid_1's l1: 0.223608 [6500] training's l1: 0.00104295 valid_1's l1: 0.223604 [7000] training's l1: 0.000969303 valid_1's l1: 0.2236 [7500] training's l1: 0.00091192 valid_1's l1: 0.223598 Early stopping, best iteration is: [7345] training's l1: 0.000927949 valid_1's l1: 0.223598 Fold 3 started at Thu Jun 13 09:25:05 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.110056 valid_1's l1: 0.237911 [1000] training's l1: 0.0537668 valid_1's l1: 0.22897 [1500] training's l1: 0.0284924 valid_1's l1: 0.226251 [2000] training's l1: 0.0155049 valid_1's l1: 0.225282 [2500] training's l1: 0.00884986 valid_1's l1: 0.224914 [3000] training's l1: 0.00537551 valid_1's l1: 0.224705 [3500] training's l1: 0.00352444 valid_1's l1: 0.224626 [4000] training's l1: 0.00249499 valid_1's l1: 0.224578 [4500] training's l1: 0.00188568 valid_1's l1: 0.224545 [5000] training's l1: 0.00151115 valid_1's l1: 0.224527 [5500] training's l1: 0.00128527 valid_1's l1: 0.224515 [6000] training's l1: 0.00114348 valid_1's l1: 0.22451 [6500] training's l1: 0.00104534 valid_1's l1: 0.224505 [7000] training's l1: 0.000972529 valid_1's l1: 0.224502 [7500] training's l1: 0.000916642 valid_1's l1: 0.2245 [8000] training's l1: 0.000870275 valid_1's l1: 0.224498 [8500] training's l1: 0.000832265 valid_1's l1: 0.224497 [9000] training's l1: 0.000800344 valid_1's l1: 0.224495 [9500] training's l1: 0.000773364 valid_1's l1: 0.224493 [10000] training's l1: 0.000748822 valid_1's l1: 0.224491 [10500] training's l1: 0.00072717 valid_1's l1: 0.224489 [11000] training's l1: 0.000707952 valid_1's l1: 0.224489 [11500] training's l1: 0.000690895 valid_1's l1: 0.224488 [12000] training's l1: 0.000675491 valid_1's l1: 0.224487 Early stopping, best iteration is: [11940] training's l1: 0.000677343 valid_1's l1: 0.224487 Fold 4 started at Thu Jun 13 09:28:57 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.10728 valid_1's l1: 0.237932 [1000] training's l1: 0.0528796 valid_1's l1: 0.228649 [1500] training's l1: 0.0281219 valid_1's l1: 0.225965 [2000] training's l1: 0.0154626 valid_1's l1: 0.225032 [2500] training's l1: 0.00882393 valid_1's l1: 0.224604 [3000] training's l1: 0.00535461 valid_1's l1: 0.224402 [3500] training's l1: 0.00352018 valid_1's l1: 0.224314 [4000] training's l1: 0.00249322 valid_1's l1: 0.224277 [4500] training's l1: 0.00188006 valid_1's l1: 0.22425 [5000] training's l1: 0.001509 valid_1's l1: 0.224232 [5500] training's l1: 0.00128475 valid_1's l1: 0.224219 [6000] training's l1: 0.00114275 valid_1's l1: 0.224211 [6500] training's l1: 0.0010449 valid_1's l1: 0.224207 [7000] training's l1: 0.000972923 valid_1's l1: 0.224203 [7500] training's l1: 0.000915659 valid_1's l1: 0.224201 [8000] training's l1: 0.000869573 valid_1's l1: 0.224198 [8500] training's l1: 0.000832386 valid_1's l1: 0.224197 Early stopping, best iteration is: [8405] training's l1: 0.000839033 valid_1's l1: 0.224196 Fold 5 started at Thu Jun 13 09:31:59 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.110592 valid_1's l1: 0.239627 [1000] training's l1: 0.0546373 valid_1's l1: 0.229776 [1500] training's l1: 0.0288621 valid_1's l1: 0.226908 [2000] training's l1: 0.0158431 valid_1's l1: 0.225784 [2500] training's l1: 0.00906687 valid_1's l1: 0.225356 [3000] training's l1: 0.00550409 valid_1's l1: 0.225135 [3500] training's l1: 0.00360533 valid_1's l1: 0.225024 [4000] training's l1: 0.00254399 valid_1's l1: 0.224973 [4500] training's l1: 0.00191209 valid_1's l1: 0.224941 [5000] training's l1: 0.00152627 valid_1's l1: 0.224922 [5500] training's l1: 0.00129383 valid_1's l1: 0.224909 [6000] training's l1: 0.00114709 valid_1's l1: 0.224901 [6500] training's l1: 0.00104671 valid_1's l1: 0.224894 [7000] training's l1: 0.000972411 valid_1's l1: 0.22489 [7500] training's l1: 0.000914884 valid_1's l1: 0.224887 [8000] training's l1: 0.000868834 valid_1's l1: 0.224883 [8500] training's l1: 0.000830242 valid_1's l1: 0.224882 [9000] training's l1: 0.000798011 valid_1's l1: 0.224881 [9500] training's l1: 0.000771166 valid_1's l1: 0.224879 [10000] training's l1: 0.000746948 valid_1's l1: 0.224878 [10500] training's l1: 0.00072584 valid_1's l1: 0.224877 [11000] training's l1: 0.000706704 valid_1's l1: 0.224876 Early stopping, best iteration is: [11046] training's l1: 0.000705119 valid_1's l1: 0.224876 CV mean score: -1.4962, std: 0.0033. Training of type 2 X_t.shape: (1140674, 147), X_test_t.shape: (613138, 147) Fold 1 started at Thu Jun 13 09:36:14 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.360538 valid_1's l1: 0.412689 [1000] training's l1: 0.304047 valid_1's l1: 0.393992 [1500] training's l1: 0.260989 valid_1's l1: 0.380642 [2000] training's l1: 0.227332 valid_1's l1: 0.371444 [2500] training's l1: 0.199962 valid_1's l1: 0.364254 [3000] training's l1: 0.177452 valid_1's l1: 0.359107 [3500] training's l1: 0.158255 valid_1's l1: 0.354899 [4000] training's l1: 0.141968 valid_1's l1: 0.351452 [4500] training's l1: 0.127815 valid_1's l1: 0.348767 [5000] training's l1: 0.115605 valid_1's l1: 0.346692 [5500] training's l1: 0.104945 valid_1's l1: 0.344972 [6000] training's l1: 0.0955574 valid_1's l1: 0.343637 [6500] training's l1: 0.0872078 valid_1's l1: 0.34259 [7000] training's l1: 0.0796953 valid_1's l1: 0.341602 [7500] training's l1: 0.0729635 valid_1's l1: 0.340764 [8000] training's l1: 0.0668822 valid_1's l1: 0.340056 [8500] training's l1: 0.0614642 valid_1's l1: 0.339492 [9000] training's l1: 0.0565228 valid_1's l1: 0.338938 [9500] training's l1: 0.0520163 valid_1's l1: 0.338454 [10000] training's l1: 0.0479345 valid_1's l1: 0.338052 [10500] training's l1: 0.0441871 valid_1's l1: 0.337673 [11000] training's l1: 0.0407874 valid_1's l1: 0.337391 [11500] training's l1: 0.0376911 valid_1's l1: 0.337111 [12000] training's l1: 0.0348668 valid_1's l1: 0.336892 [12500] training's l1: 0.032274 valid_1's l1: 0.336715 [13000] training's l1: 0.0298927 valid_1's l1: 0.336526 [13500] training's l1: 0.027713 valid_1's l1: 0.336369 [14000] training's l1: 0.0257113 valid_1's l1: 0.336212 [14500] training's l1: 0.0238541 valid_1's l1: 0.336077 [15000] training's l1: 0.0221611 valid_1's l1: 0.335969 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0221611 valid_1's l1: 0.335969 Fold 2 started at Thu Jun 13 09:51:03 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.359976 valid_1's l1: 0.410564 [1000] training's l1: 0.304853 valid_1's l1: 0.39348 [1500] training's l1: 0.261436 valid_1's l1: 0.380919 [2000] training's l1: 0.2273 valid_1's l1: 0.371755 [2500] training's l1: 0.200002 valid_1's l1: 0.36512 [3000] training's l1: 0.177406 valid_1's l1: 0.359789 [3500] training's l1: 0.158334 valid_1's l1: 0.355253 [4000] training's l1: 0.142098 valid_1's l1: 0.351927 [4500] training's l1: 0.12816 valid_1's l1: 0.349254 [5000] training's l1: 0.115945 valid_1's l1: 0.347087 [5500] training's l1: 0.105196 valid_1's l1: 0.345408 [6000] training's l1: 0.0957228 valid_1's l1: 0.34408 [6500] training's l1: 0.0873019 valid_1's l1: 0.342898 [7000] training's l1: 0.0797657 valid_1's l1: 0.341984 [7500] training's l1: 0.07303 valid_1's l1: 0.341142 [8000] training's l1: 0.0669288 valid_1's l1: 0.340375 [8500] training's l1: 0.0614934 valid_1's l1: 0.33978 [9000] training's l1: 0.0564942 valid_1's l1: 0.339261 [9500] training's l1: 0.0519968 valid_1's l1: 0.338826 [10000] training's l1: 0.04793 valid_1's l1: 0.338421 [10500] training's l1: 0.0442124 valid_1's l1: 0.338094 [11000] training's l1: 0.040823 valid_1's l1: 0.337771 [11500] training's l1: 0.0377091 valid_1's l1: 0.3375 [12000] training's l1: 0.0348781 valid_1's l1: 0.337253 [12500] training's l1: 0.0322632 valid_1's l1: 0.337051 [13000] training's l1: 0.0298878 valid_1's l1: 0.336853 [13500] training's l1: 0.0276987 valid_1's l1: 0.336697 [14000] training's l1: 0.0256989 valid_1's l1: 0.336543 [14500] training's l1: 0.0238524 valid_1's l1: 0.336382 [15000] training's l1: 0.0221469 valid_1's l1: 0.336252 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0221469 valid_1's l1: 0.336252 Fold 3 started at Thu Jun 13 10:06:04 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.36073 valid_1's l1: 0.41226 [1000] training's l1: 0.304308 valid_1's l1: 0.394875 [1500] training's l1: 0.261113 valid_1's l1: 0.38164 [2000] training's l1: 0.227133 valid_1's l1: 0.372121 [2500] training's l1: 0.199682 valid_1's l1: 0.365374 [3000] training's l1: 0.176903 valid_1's l1: 0.359734 [3500] training's l1: 0.157735 valid_1's l1: 0.355361 [4000] training's l1: 0.141629 valid_1's l1: 0.352088 [4500] training's l1: 0.127624 valid_1's l1: 0.349356 [5000] training's l1: 0.115465 valid_1's l1: 0.347327 [5500] training's l1: 0.104816 valid_1's l1: 0.345581 [6000] training's l1: 0.0954358 valid_1's l1: 0.344098 [6500] training's l1: 0.087106 valid_1's l1: 0.342945 [7000] training's l1: 0.0796057 valid_1's l1: 0.341968 [7500] training's l1: 0.0729028 valid_1's l1: 0.341111 [8000] training's l1: 0.0668234 valid_1's l1: 0.340376 [8500] training's l1: 0.0613506 valid_1's l1: 0.339734 [9000] training's l1: 0.0564348 valid_1's l1: 0.339189 [9500] training's l1: 0.0519381 valid_1's l1: 0.338705 [10000] training's l1: 0.0478674 valid_1's l1: 0.338302 [10500] training's l1: 0.0441894 valid_1's l1: 0.337971 [11000] training's l1: 0.0407801 valid_1's l1: 0.337663 [11500] training's l1: 0.0376815 valid_1's l1: 0.337416 [12000] training's l1: 0.034843 valid_1's l1: 0.337169 [12500] training's l1: 0.032248 valid_1's l1: 0.336978 [13000] training's l1: 0.0298516 valid_1's l1: 0.336787 [13500] training's l1: 0.0276705 valid_1's l1: 0.336619 [14000] training's l1: 0.0256814 valid_1's l1: 0.33647 [14500] training's l1: 0.0238426 valid_1's l1: 0.336345 [15000] training's l1: 0.0221432 valid_1's l1: 0.33623 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0221432 valid_1's l1: 0.33623 Fold 4 started at Thu Jun 13 10:21:02 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.362713 valid_1's l1: 0.408753 [1000] training's l1: 0.307368 valid_1's l1: 0.391776 [1500] training's l1: 0.263458 valid_1's l1: 0.378643 [2000] training's l1: 0.229205 valid_1's l1: 0.36912 [2500] training's l1: 0.201502 valid_1's l1: 0.362342 [3000] training's l1: 0.178428 valid_1's l1: 0.356825 [3500] training's l1: 0.159284 valid_1's l1: 0.352584 [4000] training's l1: 0.142832 valid_1's l1: 0.349442 [4500] training's l1: 0.128728 valid_1's l1: 0.346795 [5000] training's l1: 0.116354 valid_1's l1: 0.344657 [5500] training's l1: 0.105575 valid_1's l1: 0.343001 [6000] training's l1: 0.0960192 valid_1's l1: 0.341573 [6500] training's l1: 0.0875426 valid_1's l1: 0.340489 [7000] training's l1: 0.0800011 valid_1's l1: 0.3395 [7500] training's l1: 0.0732172 valid_1's l1: 0.338599 [8000] training's l1: 0.0671099 valid_1's l1: 0.337933 [8500] training's l1: 0.0615907 valid_1's l1: 0.337356 [9000] training's l1: 0.0565776 valid_1's l1: 0.336852 [9500] training's l1: 0.0520714 valid_1's l1: 0.336387 [10000] training's l1: 0.0479434 valid_1's l1: 0.33601 [10500] training's l1: 0.044204 valid_1's l1: 0.335675 [11000] training's l1: 0.0408091 valid_1's l1: 0.335326 [11500] training's l1: 0.0377243 valid_1's l1: 0.335054 [12000] training's l1: 0.0348907 valid_1's l1: 0.334832 [12500] training's l1: 0.0322927 valid_1's l1: 0.334634 [13000] training's l1: 0.0298969 valid_1's l1: 0.33446 [13500] training's l1: 0.0277242 valid_1's l1: 0.334303 [14000] training's l1: 0.0257223 valid_1's l1: 0.334158 [14500] training's l1: 0.0238843 valid_1's l1: 0.334038 [15000] training's l1: 0.0221748 valid_1's l1: 0.333912 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0221748 valid_1's l1: 0.333912 Fold 5 started at Thu Jun 13 10:36:10 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.360864 valid_1's l1: 0.411889 [1000] training's l1: 0.304228 valid_1's l1: 0.393799 [1500] training's l1: 0.26105 valid_1's l1: 0.38044 [2000] training's l1: 0.227037 valid_1's l1: 0.37097 [2500] training's l1: 0.199618 valid_1's l1: 0.364004 [3000] training's l1: 0.176891 valid_1's l1: 0.358674 [3500] training's l1: 0.157835 valid_1's l1: 0.354363 [4000] training's l1: 0.141505 valid_1's l1: 0.351125 [4500] training's l1: 0.127526 valid_1's l1: 0.348664 [5000] training's l1: 0.115493 valid_1's l1: 0.346669 [5500] training's l1: 0.104703 valid_1's l1: 0.344796 [6000] training's l1: 0.0952323 valid_1's l1: 0.343305 [6500] training's l1: 0.0868027 valid_1's l1: 0.342097 [7000] training's l1: 0.0793518 valid_1's l1: 0.341228 [7500] training's l1: 0.0726936 valid_1's l1: 0.340406 [8000] training's l1: 0.0666485 valid_1's l1: 0.339669 [8500] training's l1: 0.0611757 valid_1's l1: 0.339107 [9000] training's l1: 0.0562773 valid_1's l1: 0.33861 [9500] training's l1: 0.0517837 valid_1's l1: 0.338176 [10000] training's l1: 0.0477332 valid_1's l1: 0.337789 [10500] training's l1: 0.0440469 valid_1's l1: 0.337426 [11000] training's l1: 0.0406554 valid_1's l1: 0.337144 [11500] training's l1: 0.0375597 valid_1's l1: 0.336896 [12000] training's l1: 0.0347313 valid_1's l1: 0.336664 [12500] training's l1: 0.0321305 valid_1's l1: 0.336442 [13000] training's l1: 0.0297485 valid_1's l1: 0.336281 [13500] training's l1: 0.0275825 valid_1's l1: 0.336125 [14000] training's l1: 0.0255873 valid_1's l1: 0.335984 [14500] training's l1: 0.0237601 valid_1's l1: 0.335862 [15000] training's l1: 0.0220705 valid_1's l1: 0.335745 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0220705 valid_1's l1: 0.335745 CV mean score: -1.0918, std: 0.0026. Training of type 6 X_t.shape: (590611, 147), X_test_t.shape: (317435, 147) Fold 1 started at Thu Jun 13 10:51:54 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.17624 valid_1's l1: 0.221697 [1000] training's l1: 0.131125 valid_1's l1: 0.206593 [1500] training's l1: 0.102562 valid_1's l1: 0.198728 [2000] training's l1: 0.082806 valid_1's l1: 0.194257 [2500] training's l1: 0.0681511 valid_1's l1: 0.191535 [3000] training's l1: 0.0567305 valid_1's l1: 0.189592 [3500] training's l1: 0.0476651 valid_1's l1: 0.188203 [4000] training's l1: 0.0403145 valid_1's l1: 0.187258 [4500] training's l1: 0.0342821 valid_1's l1: 0.186667 [5000] training's l1: 0.0293322 valid_1's l1: 0.186136 [5500] training's l1: 0.0251948 valid_1's l1: 0.185774 [6000] training's l1: 0.0217284 valid_1's l1: 0.18547 [6500] training's l1: 0.0187841 valid_1's l1: 0.185219 [7000] training's l1: 0.0162931 valid_1's l1: 0.185027 [7500] training's l1: 0.0141939 valid_1's l1: 0.184887 [8000] training's l1: 0.012397 valid_1's l1: 0.184758 [8500] training's l1: 0.0108607 valid_1's l1: 0.184644 [9000] training's l1: 0.00953556 valid_1's l1: 0.184572 [9500] training's l1: 0.00840917 valid_1's l1: 0.184499 [10000] training's l1: 0.00743473 valid_1's l1: 0.184447 [10500] training's l1: 0.00659913 valid_1's l1: 0.184395 [11000] training's l1: 0.00588175 valid_1's l1: 0.184357 [11500] training's l1: 0.0052545 valid_1's l1: 0.184321 [12000] training's l1: 0.00470993 valid_1's l1: 0.184292 [12500] training's l1: 0.00424033 valid_1's l1: 0.184266 [13000] training's l1: 0.0038343 valid_1's l1: 0.184246 [13500] training's l1: 0.00347476 valid_1's l1: 0.184226 [14000] training's l1: 0.00316126 valid_1's l1: 0.184211 [14500] training's l1: 0.00288786 valid_1's l1: 0.184197 [15000] training's l1: 0.00264541 valid_1's l1: 0.184185 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00264541 valid_1's l1: 0.184185 Fold 2 started at Thu Jun 13 11:03:48 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.174411 valid_1's l1: 0.221854 [1000] training's l1: 0.129973 valid_1's l1: 0.207005 [1500] training's l1: 0.101889 valid_1's l1: 0.199214 [2000] training's l1: 0.08219 valid_1's l1: 0.194383 [2500] training's l1: 0.067689 valid_1's l1: 0.191462 [3000] training's l1: 0.0563841 valid_1's l1: 0.189605 [3500] training's l1: 0.0474272 valid_1's l1: 0.188383 [4000] training's l1: 0.040123 valid_1's l1: 0.187426 [4500] training's l1: 0.034125 valid_1's l1: 0.186769 [5000] training's l1: 0.0292283 valid_1's l1: 0.186243 [5500] training's l1: 0.0251002 valid_1's l1: 0.185865 [6000] training's l1: 0.0216265 valid_1's l1: 0.185551 [6500] training's l1: 0.0187154 valid_1's l1: 0.185333 [7000] training's l1: 0.0162376 valid_1's l1: 0.185146 [7500] training's l1: 0.0141413 valid_1's l1: 0.184983 [8000] training's l1: 0.0123399 valid_1's l1: 0.184864 [8500] training's l1: 0.0108175 valid_1's l1: 0.18476 [9000] training's l1: 0.00950858 valid_1's l1: 0.184677 [9500] training's l1: 0.00839385 valid_1's l1: 0.184601 [10000] training's l1: 0.00741749 valid_1's l1: 0.184555 [10500] training's l1: 0.00658001 valid_1's l1: 0.184509 [11000] training's l1: 0.00586524 valid_1's l1: 0.184473 [11500] training's l1: 0.00524471 valid_1's l1: 0.184432 [12000] training's l1: 0.00470797 valid_1's l1: 0.184402 [12500] training's l1: 0.0042353 valid_1's l1: 0.184377 [13000] training's l1: 0.00382633 valid_1's l1: 0.184357 [13500] training's l1: 0.00347088 valid_1's l1: 0.18434 [14000] training's l1: 0.00316083 valid_1's l1: 0.184322 [14500] training's l1: 0.00288913 valid_1's l1: 0.184306 [15000] training's l1: 0.0026492 valid_1's l1: 0.184293 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0026492 valid_1's l1: 0.184293 Fold 3 started at Thu Jun 13 11:15:30 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.174442 valid_1's l1: 0.222398 [1000] training's l1: 0.130251 valid_1's l1: 0.207312 [1500] training's l1: 0.101845 valid_1's l1: 0.199326 [2000] training's l1: 0.0821609 valid_1's l1: 0.194656 [2500] training's l1: 0.0675297 valid_1's l1: 0.191794 [3000] training's l1: 0.0561733 valid_1's l1: 0.189872 [3500] training's l1: 0.0472209 valid_1's l1: 0.18858 [4000] training's l1: 0.0399668 valid_1's l1: 0.187682 [4500] training's l1: 0.0340134 valid_1's l1: 0.187 [5000] training's l1: 0.0291121 valid_1's l1: 0.186458 [5500] training's l1: 0.0249811 valid_1's l1: 0.186077 [6000] training's l1: 0.0215532 valid_1's l1: 0.185782 [6500] training's l1: 0.0186567 valid_1's l1: 0.185545 [7000] training's l1: 0.0162127 valid_1's l1: 0.185354 [7500] training's l1: 0.0141156 valid_1's l1: 0.185223 [8000] training's l1: 0.0123202 valid_1's l1: 0.185091 [8500] training's l1: 0.010802 valid_1's l1: 0.184983 [9000] training's l1: 0.00948397 valid_1's l1: 0.184896 [9500] training's l1: 0.00835834 valid_1's l1: 0.184822 [10000] training's l1: 0.00739478 valid_1's l1: 0.184772 [10500] training's l1: 0.00656438 valid_1's l1: 0.184718 [11000] training's l1: 0.00584475 valid_1's l1: 0.184673 [11500] training's l1: 0.00521965 valid_1's l1: 0.184632 [12000] training's l1: 0.00468258 valid_1's l1: 0.184612 [12500] training's l1: 0.00421436 valid_1's l1: 0.184584 [13000] training's l1: 0.00380962 valid_1's l1: 0.184561 [13500] training's l1: 0.00345371 valid_1's l1: 0.184542 [14000] training's l1: 0.00314466 valid_1's l1: 0.184527 [14500] training's l1: 0.00287409 valid_1's l1: 0.184511 [15000] training's l1: 0.00263448 valid_1's l1: 0.1845 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00263448 valid_1's l1: 0.1845 Fold 4 started at Thu Jun 13 11:27:25 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.175595 valid_1's l1: 0.221851 [1000] training's l1: 0.130642 valid_1's l1: 0.206258 [1500] training's l1: 0.102249 valid_1's l1: 0.198418 [2000] training's l1: 0.0824756 valid_1's l1: 0.193911 [2500] training's l1: 0.0678006 valid_1's l1: 0.191077 [3000] training's l1: 0.0563906 valid_1's l1: 0.18925 [3500] training's l1: 0.0474507 valid_1's l1: 0.188002 [4000] training's l1: 0.0401687 valid_1's l1: 0.187077 [4500] training's l1: 0.0342116 valid_1's l1: 0.186397 [5000] training's l1: 0.0292963 valid_1's l1: 0.185871 [5500] training's l1: 0.0251545 valid_1's l1: 0.185491 [6000] training's l1: 0.0216942 valid_1's l1: 0.185185 [6500] training's l1: 0.01875 valid_1's l1: 0.184952 [7000] training's l1: 0.0162592 valid_1's l1: 0.18473 [7500] training's l1: 0.0141723 valid_1's l1: 0.184592 [8000] training's l1: 0.0123693 valid_1's l1: 0.184455 [8500] training's l1: 0.0108405 valid_1's l1: 0.184348 [9000] training's l1: 0.00953638 valid_1's l1: 0.184276 [9500] training's l1: 0.00840606 valid_1's l1: 0.184193 [10000] training's l1: 0.00743378 valid_1's l1: 0.184132 [10500] training's l1: 0.00659645 valid_1's l1: 0.184089 [11000] training's l1: 0.00587341 valid_1's l1: 0.184057 [11500] training's l1: 0.00524947 valid_1's l1: 0.184023 [12000] training's l1: 0.00470794 valid_1's l1: 0.183994 [12500] training's l1: 0.00423784 valid_1's l1: 0.183968 [13000] training's l1: 0.00382894 valid_1's l1: 0.183946 [13500] training's l1: 0.00347133 valid_1's l1: 0.183925 [14000] training's l1: 0.00315936 valid_1's l1: 0.183907 [14500] training's l1: 0.0028867 valid_1's l1: 0.183893 [15000] training's l1: 0.00264616 valid_1's l1: 0.183882 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00264616 valid_1's l1: 0.183882 Fold 5 started at Thu Jun 13 11:39:24 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.175895 valid_1's l1: 0.222461 [1000] training's l1: 0.131261 valid_1's l1: 0.207699 [1500] training's l1: 0.102471 valid_1's l1: 0.199444 [2000] training's l1: 0.0825545 valid_1's l1: 0.194732 [2500] training's l1: 0.067852 valid_1's l1: 0.191721 [3000] training's l1: 0.0565954 valid_1's l1: 0.189836 [3500] training's l1: 0.0475696 valid_1's l1: 0.188473 [4000] training's l1: 0.0402678 valid_1's l1: 0.187482 [4500] training's l1: 0.0342937 valid_1's l1: 0.186859 [5000] training's l1: 0.029302 valid_1's l1: 0.186329 [5500] training's l1: 0.0251715 valid_1's l1: 0.185907 [6000] training's l1: 0.0216968 valid_1's l1: 0.185614 [6500] training's l1: 0.0187666 valid_1's l1: 0.185371 [7000] training's l1: 0.0162887 valid_1's l1: 0.185166 [7500] training's l1: 0.0141713 valid_1's l1: 0.184994 [8000] training's l1: 0.0123807 valid_1's l1: 0.184888 [8500] training's l1: 0.0108505 valid_1's l1: 0.184789 [9000] training's l1: 0.00953622 valid_1's l1: 0.184715 [9500] training's l1: 0.00841155 valid_1's l1: 0.184646 [10000] training's l1: 0.00743955 valid_1's l1: 0.184587 [10500] training's l1: 0.00660138 valid_1's l1: 0.184542 [11000] training's l1: 0.00587644 valid_1's l1: 0.184501 [11500] training's l1: 0.00524842 valid_1's l1: 0.184466 [12000] training's l1: 0.00471199 valid_1's l1: 0.184434 [12500] training's l1: 0.00424311 valid_1's l1: 0.18441 [13000] training's l1: 0.00383177 valid_1's l1: 0.184388 [13500] training's l1: 0.00347568 valid_1's l1: 0.184365 [14000] training's l1: 0.00316294 valid_1's l1: 0.184349 [14500] training's l1: 0.00288942 valid_1's l1: 0.184332 [15000] training's l1: 0.00264904 valid_1's l1: 0.18432 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.00264904 valid_1's l1: 0.18432 CV mean score: -1.6915, std: 0.0011. Training of type 5 X_t.shape: (1510379, 147), X_test_t.shape: (811999, 147) Fold 1 started at Thu Jun 13 11:52:21 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.341779 valid_1's l1: 0.378012 [1000] training's l1: 0.302409 valid_1's l1: 0.368023 [1500] training's l1: 0.269477 valid_1's l1: 0.359007 [2000] training's l1: 0.241988 valid_1's l1: 0.352108 [2500] training's l1: 0.218727 valid_1's l1: 0.346592 [3000] training's l1: 0.198629 valid_1's l1: 0.341845 [3500] training's l1: 0.180981 valid_1's l1: 0.337776 [4000] training's l1: 0.165379 valid_1's l1: 0.334066 [4500] training's l1: 0.151755 valid_1's l1: 0.33122 [5000] training's l1: 0.139676 valid_1's l1: 0.328787 [5500] training's l1: 0.128763 valid_1's l1: 0.326718 [6000] training's l1: 0.119055 valid_1's l1: 0.324869 [6500] training's l1: 0.110262 valid_1's l1: 0.323336 [7000] training's l1: 0.102286 valid_1's l1: 0.322019 [7500] training's l1: 0.0951297 valid_1's l1: 0.320895 [8000] training's l1: 0.0886314 valid_1's l1: 0.319899 [8500] training's l1: 0.0826305 valid_1's l1: 0.319079 [9000] training's l1: 0.0770768 valid_1's l1: 0.318273 [9500] training's l1: 0.0719873 valid_1's l1: 0.317636 [10000] training's l1: 0.0673016 valid_1's l1: 0.317062 [10500] training's l1: 0.062975 valid_1's l1: 0.316588 [11000] training's l1: 0.0589422 valid_1's l1: 0.316157 [11500] training's l1: 0.0552488 valid_1's l1: 0.315722 [12000] training's l1: 0.0518257 valid_1's l1: 0.315351 [12500] training's l1: 0.0486184 valid_1's l1: 0.315034 [13000] training's l1: 0.0456326 valid_1's l1: 0.314744 [13500] training's l1: 0.042881 valid_1's l1: 0.314516 [14000] training's l1: 0.0403168 valid_1's l1: 0.314281 [14500] training's l1: 0.0379286 valid_1's l1: 0.314072 [15000] training's l1: 0.0356988 valid_1's l1: 0.313844 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0356988 valid_1's l1: 0.313844 Fold 2 started at Thu Jun 13 12:12:15 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.341239 valid_1's l1: 0.37828 [1000] training's l1: 0.302505 valid_1's l1: 0.368182 [1500] training's l1: 0.269764 valid_1's l1: 0.359588 [2000] training's l1: 0.242392 valid_1's l1: 0.352614 [2500] training's l1: 0.218976 valid_1's l1: 0.346777 [3000] training's l1: 0.199083 valid_1's l1: 0.342024 [3500] training's l1: 0.181267 valid_1's l1: 0.337933 [4000] training's l1: 0.165771 valid_1's l1: 0.334537 [4500] training's l1: 0.152033 valid_1's l1: 0.331554 [5000] training's l1: 0.139878 valid_1's l1: 0.329182 [5500] training's l1: 0.129003 valid_1's l1: 0.327074 [6000] training's l1: 0.119279 valid_1's l1: 0.325412 [6500] training's l1: 0.110528 valid_1's l1: 0.323977 [7000] training's l1: 0.102577 valid_1's l1: 0.322608 [7500] training's l1: 0.0953453 valid_1's l1: 0.321476 [8000] training's l1: 0.0887386 valid_1's l1: 0.320452 [8500] training's l1: 0.0826727 valid_1's l1: 0.319606 [9000] training's l1: 0.077147 valid_1's l1: 0.318891 [9500] training's l1: 0.0720833 valid_1's l1: 0.318243 [10000] training's l1: 0.0673436 valid_1's l1: 0.317642 [10500] training's l1: 0.0630281 valid_1's l1: 0.317136 [11000] training's l1: 0.0590136 valid_1's l1: 0.316684 [11500] training's l1: 0.055301 valid_1's l1: 0.316279 [12000] training's l1: 0.051852 valid_1's l1: 0.315914 [12500] training's l1: 0.0486427 valid_1's l1: 0.315611 [13000] training's l1: 0.045689 valid_1's l1: 0.315317 [13500] training's l1: 0.0429344 valid_1's l1: 0.315058 [14000] training's l1: 0.040368 valid_1's l1: 0.314785 [14500] training's l1: 0.037982 valid_1's l1: 0.314561 [15000] training's l1: 0.0357428 valid_1's l1: 0.314336 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0357428 valid_1's l1: 0.314336 Fold 3 started at Thu Jun 13 12:32:27 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.341356 valid_1's l1: 0.377337 [1000] training's l1: 0.302205 valid_1's l1: 0.367212 [1500] training's l1: 0.269799 valid_1's l1: 0.358818 [2000] training's l1: 0.242424 valid_1's l1: 0.35203 [2500] training's l1: 0.218768 valid_1's l1: 0.345893 [3000] training's l1: 0.198398 valid_1's l1: 0.341084 [3500] training's l1: 0.180999 valid_1's l1: 0.337138 [4000] training's l1: 0.165358 valid_1's l1: 0.333461 [4500] training's l1: 0.151697 valid_1's l1: 0.330514 [5000] training's l1: 0.139748 valid_1's l1: 0.328266 [5500] training's l1: 0.128964 valid_1's l1: 0.326295 [6000] training's l1: 0.119289 valid_1's l1: 0.324569 [6500] training's l1: 0.110459 valid_1's l1: 0.322952 [7000] training's l1: 0.102441 valid_1's l1: 0.321599 [7500] training's l1: 0.0952716 valid_1's l1: 0.320527 [8000] training's l1: 0.0886608 valid_1's l1: 0.319505 [8500] training's l1: 0.0826427 valid_1's l1: 0.318709 [9000] training's l1: 0.0771038 valid_1's l1: 0.317942 [9500] training's l1: 0.0720021 valid_1's l1: 0.317296 [10000] training's l1: 0.0672961 valid_1's l1: 0.316724 [10500] training's l1: 0.0630009 valid_1's l1: 0.316176 [11000] training's l1: 0.058984 valid_1's l1: 0.315674 [11500] training's l1: 0.0552778 valid_1's l1: 0.315258 [12000] training's l1: 0.0518541 valid_1's l1: 0.314878 [12500] training's l1: 0.048658 valid_1's l1: 0.314541 [13000] training's l1: 0.0456868 valid_1's l1: 0.314228 [13500] training's l1: 0.0429216 valid_1's l1: 0.313965 [14000] training's l1: 0.0403388 valid_1's l1: 0.313752 [14500] training's l1: 0.0379226 valid_1's l1: 0.313545 [15000] training's l1: 0.0356953 valid_1's l1: 0.313332 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0356953 valid_1's l1: 0.313332 Fold 4 started at Thu Jun 13 12:52:32 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.34213 valid_1's l1: 0.377687 [1000] training's l1: 0.30336 valid_1's l1: 0.3683 [1500] training's l1: 0.270921 valid_1's l1: 0.360105 [2000] training's l1: 0.243481 valid_1's l1: 0.353044 [2500] training's l1: 0.219458 valid_1's l1: 0.346677 [3000] training's l1: 0.199057 valid_1's l1: 0.341461 [3500] training's l1: 0.181176 valid_1's l1: 0.337195 [4000] training's l1: 0.165635 valid_1's l1: 0.333824 [4500] training's l1: 0.152088 valid_1's l1: 0.331132 [5000] training's l1: 0.139953 valid_1's l1: 0.328576 [5500] training's l1: 0.129026 valid_1's l1: 0.326437 [6000] training's l1: 0.119383 valid_1's l1: 0.324816 [6500] training's l1: 0.110563 valid_1's l1: 0.323215 [7000] training's l1: 0.102612 valid_1's l1: 0.321891 [7500] training's l1: 0.0954088 valid_1's l1: 0.320805 [8000] training's l1: 0.0888183 valid_1's l1: 0.319737 [8500] training's l1: 0.0827798 valid_1's l1: 0.318912 [9000] training's l1: 0.0772203 valid_1's l1: 0.318206 [9500] training's l1: 0.0721083 valid_1's l1: 0.317564 [10000] training's l1: 0.0674181 valid_1's l1: 0.316998 [10500] training's l1: 0.0630756 valid_1's l1: 0.316458 [11000] training's l1: 0.059075 valid_1's l1: 0.315992 [11500] training's l1: 0.0553338 valid_1's l1: 0.315604 [12000] training's l1: 0.0518845 valid_1's l1: 0.315231 [12500] training's l1: 0.0487034 valid_1's l1: 0.314927 [13000] training's l1: 0.0457268 valid_1's l1: 0.314617 [13500] training's l1: 0.0429602 valid_1's l1: 0.314347 [14000] training's l1: 0.0403864 valid_1's l1: 0.31409 [14500] training's l1: 0.0379908 valid_1's l1: 0.313851 [15000] training's l1: 0.0357354 valid_1's l1: 0.31366 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0357354 valid_1's l1: 0.31366 Fold 5 started at Thu Jun 13 13:12:25 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.341411 valid_1's l1: 0.37778 [1000] training's l1: 0.302427 valid_1's l1: 0.367903 [1500] training's l1: 0.270012 valid_1's l1: 0.359788 [2000] training's l1: 0.242142 valid_1's l1: 0.352492 [2500] training's l1: 0.218599 valid_1's l1: 0.346497 [3000] training's l1: 0.198223 valid_1's l1: 0.341504 [3500] training's l1: 0.180555 valid_1's l1: 0.337225 [4000] training's l1: 0.165068 valid_1's l1: 0.333606 [4500] training's l1: 0.151715 valid_1's l1: 0.330827 [5000] training's l1: 0.13969 valid_1's l1: 0.328465 [5500] training's l1: 0.128807 valid_1's l1: 0.326474 [6000] training's l1: 0.119163 valid_1's l1: 0.324737 [6500] training's l1: 0.110479 valid_1's l1: 0.323413 [7000] training's l1: 0.102523 valid_1's l1: 0.322113 [7500] training's l1: 0.0953563 valid_1's l1: 0.321159 [8000] training's l1: 0.0887175 valid_1's l1: 0.320158 [8500] training's l1: 0.0826631 valid_1's l1: 0.319296 [9000] training's l1: 0.0771304 valid_1's l1: 0.318546 [9500] training's l1: 0.0720279 valid_1's l1: 0.317822 [10000] training's l1: 0.0673342 valid_1's l1: 0.317218 [10500] training's l1: 0.0629946 valid_1's l1: 0.316685 [11000] training's l1: 0.0589855 valid_1's l1: 0.316255 [11500] training's l1: 0.0552799 valid_1's l1: 0.315858 [12000] training's l1: 0.0518077 valid_1's l1: 0.315468 [12500] training's l1: 0.048616 valid_1's l1: 0.31515 [13000] training's l1: 0.0456214 valid_1's l1: 0.314843 [13500] training's l1: 0.0428466 valid_1's l1: 0.314603 [14000] training's l1: 0.0402623 valid_1's l1: 0.31433 [14500] training's l1: 0.03787 valid_1's l1: 0.31412 [15000] training's l1: 0.0356333 valid_1's l1: 0.313932 Did not meet early stopping. Best iteration is: [15000] training's l1: 0.0356333 valid_1's l1: 0.313932 CV mean score: -1.1589, std: 0.0010. Training of type 7 X_t.shape: (166415, 147), X_test_t.shape: (90616, 147) Fold 1 started at Thu Jun 13 13:33:23 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.0841227 valid_1's l1: 0.166437 [1000] training's l1: 0.0454598 valid_1's l1: 0.158773 [1500] training's l1: 0.0270106 valid_1's l1: 0.156576 [2000] training's l1: 0.0166006 valid_1's l1: 0.15553 [2500] training's l1: 0.0105561 valid_1's l1: 0.155015 [3000] training's l1: 0.00697956 valid_1's l1: 0.154758 [3500] training's l1: 0.00481419 valid_1's l1: 0.15464 [4000] training's l1: 0.00347031 valid_1's l1: 0.154576 [4500] training's l1: 0.00261766 valid_1's l1: 0.154536 [5000] training's l1: 0.00205853 valid_1's l1: 0.154504 [5500] training's l1: 0.00167588 valid_1's l1: 0.154482 [6000] training's l1: 0.00140856 valid_1's l1: 0.154469 [6500] training's l1: 0.00122268 valid_1's l1: 0.154459 [7000] training's l1: 0.00109514 valid_1's l1: 0.154453 [7500] training's l1: 0.00100381 valid_1's l1: 0.154449 [8000] training's l1: 0.000935372 valid_1's l1: 0.154445 [8500] training's l1: 0.000880926 valid_1's l1: 0.154443 [9000] training's l1: 0.000836935 valid_1's l1: 0.154441 [9500] training's l1: 0.000800607 valid_1's l1: 0.154439 [10000] training's l1: 0.000770012 valid_1's l1: 0.154438 [10500] training's l1: 0.000743925 valid_1's l1: 0.154436 [11000] training's l1: 0.000720946 valid_1's l1: 0.154435 [11500] training's l1: 0.000700542 valid_1's l1: 0.154434 [12000] training's l1: 0.000682307 valid_1's l1: 0.154432 [12500] training's l1: 0.000665529 valid_1's l1: 0.154432 [13000] training's l1: 0.000650933 valid_1's l1: 0.15443 [13500] training's l1: 0.000637192 valid_1's l1: 0.15443 [14000] training's l1: 0.000624587 valid_1's l1: 0.154429 [14500] training's l1: 0.000613105 valid_1's l1: 0.154428 Early stopping, best iteration is: [14587] training's l1: 0.000611207 valid_1's l1: 0.154428 Fold 2 started at Thu Jun 13 13:39:00 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.083832 valid_1's l1: 0.164222 [1000] training's l1: 0.0459235 valid_1's l1: 0.15711 [1500] training's l1: 0.0271462 valid_1's l1: 0.154743 [2000] training's l1: 0.0166865 valid_1's l1: 0.153748 [2500] training's l1: 0.0105884 valid_1's l1: 0.153258 [3000] training's l1: 0.00699344 valid_1's l1: 0.152996 [3500] training's l1: 0.00482635 valid_1's l1: 0.152868 [4000] training's l1: 0.0034797 valid_1's l1: 0.152789 [4500] training's l1: 0.00262825 valid_1's l1: 0.15274 [5000] training's l1: 0.00206479 valid_1's l1: 0.152709 [5500] training's l1: 0.00167975 valid_1's l1: 0.152686 [6000] training's l1: 0.00141327 valid_1's l1: 0.15267 [6500] training's l1: 0.00122691 valid_1's l1: 0.15266 [7000] training's l1: 0.0010966 valid_1's l1: 0.152651 [7500] training's l1: 0.00100444 valid_1's l1: 0.152645 [8000] training's l1: 0.000934868 valid_1's l1: 0.152641 [8500] training's l1: 0.000880831 valid_1's l1: 0.152638 [9000] training's l1: 0.000837738 valid_1's l1: 0.152635 [9500] training's l1: 0.000801698 valid_1's l1: 0.152633 [10000] training's l1: 0.000770553 valid_1's l1: 0.152631 [10500] training's l1: 0.000744006 valid_1's l1: 0.15263 [11000] training's l1: 0.000720863 valid_1's l1: 0.152629 [11500] training's l1: 0.000700092 valid_1's l1: 0.152627 [12000] training's l1: 0.000681783 valid_1's l1: 0.152625 [12500] training's l1: 0.000664954 valid_1's l1: 0.152624 [13000] training's l1: 0.00064979 valid_1's l1: 0.152623 [13500] training's l1: 0.000636264 valid_1's l1: 0.152622 [14000] training's l1: 0.000623682 valid_1's l1: 0.152621 [14500] training's l1: 0.000612104 valid_1's l1: 0.152621 Early stopping, best iteration is: [14369] training's l1: 0.000615051 valid_1's l1: 0.152621 Fold 3 started at Thu Jun 13 13:44:20 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.0838985 valid_1's l1: 0.165479 [1000] training's l1: 0.0458 valid_1's l1: 0.158234 [1500] training's l1: 0.0271883 valid_1's l1: 0.156022 [2000] training's l1: 0.0167777 valid_1's l1: 0.155107 [2500] training's l1: 0.0106417 valid_1's l1: 0.154637 [3000] training's l1: 0.00700531 valid_1's l1: 0.154402 [3500] training's l1: 0.00483407 valid_1's l1: 0.154257 [4000] training's l1: 0.00349069 valid_1's l1: 0.154166 [4500] training's l1: 0.00263587 valid_1's l1: 0.154113 [5000] training's l1: 0.0020674 valid_1's l1: 0.154086 [5500] training's l1: 0.00168284 valid_1's l1: 0.154066 [6000] training's l1: 0.00141588 valid_1's l1: 0.154052 [6500] training's l1: 0.00122741 valid_1's l1: 0.154043 [7000] training's l1: 0.00109596 valid_1's l1: 0.154034 [7500] training's l1: 0.00100434 valid_1's l1: 0.15403 [8000] training's l1: 0.000935303 valid_1's l1: 0.154025 [8500] training's l1: 0.000880492 valid_1's l1: 0.154022 [9000] training's l1: 0.000836828 valid_1's l1: 0.154018 [9500] training's l1: 0.000800316 valid_1's l1: 0.154016 [10000] training's l1: 0.000769257 valid_1's l1: 0.154014 [10500] training's l1: 0.000742481 valid_1's l1: 0.154013 [11000] training's l1: 0.000719594 valid_1's l1: 0.154012 [11500] training's l1: 0.000699396 valid_1's l1: 0.154011 [12000] training's l1: 0.000680717 valid_1's l1: 0.154009 [12500] training's l1: 0.00066404 valid_1's l1: 0.154007 Early stopping, best iteration is: [12589] training's l1: 0.000661184 valid_1's l1: 0.154007 Fold 4 started at Thu Jun 13 13:49:12 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.0841533 valid_1's l1: 0.164025 [1000] training's l1: 0.0461179 valid_1's l1: 0.157113 [1500] training's l1: 0.027318 valid_1's l1: 0.154756 [2000] training's l1: 0.0167972 valid_1's l1: 0.153694 [2500] training's l1: 0.0106937 valid_1's l1: 0.153171 [3000] training's l1: 0.00706766 valid_1's l1: 0.152903 [3500] training's l1: 0.00486282 valid_1's l1: 0.152748 [4000] training's l1: 0.00350898 valid_1's l1: 0.152656 [4500] training's l1: 0.00264518 valid_1's l1: 0.152602 [5000] training's l1: 0.00207392 valid_1's l1: 0.15257 [5500] training's l1: 0.00168524 valid_1's l1: 0.152547 [6000] training's l1: 0.00141735 valid_1's l1: 0.152535 [6500] training's l1: 0.00122699 valid_1's l1: 0.152523 [7000] training's l1: 0.00109664 valid_1's l1: 0.152515 [7500] training's l1: 0.00100379 valid_1's l1: 0.15251 [8000] training's l1: 0.000934746 valid_1's l1: 0.152506 [8500] training's l1: 0.000880598 valid_1's l1: 0.152503 [9000] training's l1: 0.000836369 valid_1's l1: 0.152501 [9500] training's l1: 0.000800563 valid_1's l1: 0.152498 [10000] training's l1: 0.000769409 valid_1's l1: 0.152497 [10500] training's l1: 0.000742851 valid_1's l1: 0.152495 [11000] training's l1: 0.000719641 valid_1's l1: 0.152494 [11500] training's l1: 0.000699264 valid_1's l1: 0.152493 [12000] training's l1: 0.000680993 valid_1's l1: 0.152491 [12500] training's l1: 0.000664786 valid_1's l1: 0.15249 [13000] training's l1: 0.000649739 valid_1's l1: 0.152489 [13500] training's l1: 0.000635971 valid_1's l1: 0.152489 [14000] training's l1: 0.000623343 valid_1's l1: 0.152488 Early stopping, best iteration is: [13861] training's l1: 0.000626634 valid_1's l1: 0.152488 Fold 5 started at Thu Jun 13 13:54:33 2019 [LightGBM] [Warning] num_threads is set=-1, n_jobs=-1 will be ignored. Current value: num_threads=-1 Training until validation scores don't improve for 200 rounds. [500] training's l1: 0.083815 valid_1's l1: 0.165271 [1000] training's l1: 0.0460591 valid_1's l1: 0.158439 [1500] training's l1: 0.0270144 valid_1's l1: 0.156103 [2000] training's l1: 0.0165319 valid_1's l1: 0.155171 [2500] training's l1: 0.0105278 valid_1's l1: 0.154658 [3000] training's l1: 0.00697839 valid_1's l1: 0.154412 [3500] training's l1: 0.00481769 valid_1's l1: 0.15429 [4000] training's l1: 0.00347583 valid_1's l1: 0.154219 [4500] training's l1: 0.00262584 valid_1's l1: 0.154162 [5000] training's l1: 0.00206373 valid_1's l1: 0.154127 [5500] training's l1: 0.00167927 valid_1's l1: 0.154107 [6000] training's l1: 0.00140995 valid_1's l1: 0.154092 [6500] training's l1: 0.00122182 valid_1's l1: 0.154083 [7000] training's l1: 0.00109241 valid_1's l1: 0.154077 [7500] training's l1: 0.000999932 valid_1's l1: 0.154071 [8000] training's l1: 0.000931002 valid_1's l1: 0.154067 [8500] training's l1: 0.000877784 valid_1's l1: 0.154065 [9000] training's l1: 0.000833412 valid_1's l1: 0.154063 [9500] training's l1: 0.000798005 valid_1's l1: 0.15406 [10000] training's l1: 0.000767287 valid_1's l1: 0.154058 [10500] training's l1: 0.000740502 valid_1's l1: 0.154057 [11000] training's l1: 0.000717078 valid_1's l1: 0.154056 Early stopping, best iteration is: [10924] training's l1: 0.000720345 valid_1's l1: 0.154056 CV mean score: -1.8739, std: 0.0052. id scalar_coupling_constant 0 4658147 17.760219 1 4658148 183.064138 2 4658149 3.539468 3 4658150 182.823797 4 4658151 11.020824 oof_log_mae: -1.2074376400054934 finished. : 2019-06-13 13:59:58