no data files

[lzh66]

FileNotFoundError: [Errno 2] No such file or directory: '/home/hsucheng/DRS/dataset/RS/ny.checkin'

Is there any pre-process code and data to make the code running? thx a lot

[xinsheng44]

yes,i want it,too

[xinsheng44]

@retagnn

[YangTakeshi]

I used movielens-1m for testing, and did not achieve the effect in the paper, probably because my data preprocessing was not written correctly, I hope the author will disclose the preprocessing process of movielens-1m.
Here are the results of my tests：

0
0-0
Epoch 1 - loss=205.3567
0-1
Epoch 1 - loss=204.9783
0-2
Epoch 1 - loss=196.8071
0-3
Epoch 1 - loss=184.8365
0-4
Epoch 1 - loss=176.3383
0-5
Epoch 1 - loss=162.3856
0-6
Epoch 1 - loss=151.6234
0-7
Epoch 1 - loss=135.2499
0-8
Epoch 1 - loss=127.9580
0-9
Epoch 1 - loss=118.2730
0-10
Epoch 1 - loss=111.0059
0-11
Epoch 1 - loss=105.8223
0-12
Epoch 1 - loss=94.1179
0-13
Epoch 1 - loss=86.8087
0-14
Epoch 1 - loss=60.6968
precision : [0.04330671676843606, 0.04250821982151244, 0.03958039768279323, 0.034194457491780066]
recall : [0.010826679192109015, 0.02125410991075622, 0.029685298262094796, 0.034194457491780066]
MAP : [0.028232346954751842, 0.019905537289285524, 0.0158144583179811, 0.012819485926088576]
ndcg : [0.04664384611184905, 0.044812432401552686, 0.042337863019969404, 0.03822263438122158]
1
1-0
Epoch 2 - loss=90.2064
1-1
Epoch 2 - loss=80.5032
1-2
Epoch 2 - loss=67.9278
1-3
Epoch 2 - loss=63.5593
1-4
Epoch 2 - loss=65.5669
1-5
Epoch 2 - loss=60.2247
1-6
Epoch 2 - loss=56.5831
1-7
Epoch 2 - loss=55.1667
1-8
Epoch 2 - loss=57.8262
1-9
Epoch 2 - loss=53.6529
1-10
Epoch 2 - loss=56.9821
1-11
Epoch 2 - loss=57.8628
1-12
Epoch 2 - loss=48.0727
1-13
Epoch 2 - loss=52.6325
1-14
Epoch 2 - loss=33.6227
precision : [0.040112728980742175, 0.049318929074682716, 0.048097698449976536, 0.04704086425551872]
recall : [0.010028182245185544, 0.024659464537341358, 0.03607327383748213, 0.04704086425551872]
MAP : [0.03491780178487553, 0.02682060658927732, 0.0223135642604877, 0.01819596037708147]
ndcg : [0.047541501319847544, 0.05203337254587955, 0.050625748384504204, 0.04943947268136284]
2
2-0
Epoch 3 - loss=74.5687
2-1
Epoch 3 - loss=67.0918
2-2
Epoch 3 - loss=47.4482
2-3
Epoch 3 - loss=43.1047
2-4
Epoch 3 - loss=49.8758
2-5
Epoch 3 - loss=47.1292
2-6
Epoch 3 - loss=44.1439
2-7
Epoch 3 - loss=39.9284
2-8
Epoch 3 - loss=42.8612
2-9
Epoch 3 - loss=42.3989
2-10
Epoch 3 - loss=45.9361
2-11
Epoch 3 - loss=43.3453
2-12
Epoch 3 - loss=39.5204
2-13
Epoch 3 - loss=37.3069
2-14
Epoch 3 - loss=25.4328
precision : [0.05429779239079387, 0.04814466885861889, 0.04239862220134654, 0.036942226397369375]
recall : [0.013574448097698467, 0.024072334429309446, 0.03179896665100968, 0.036942226397369375]
MAP : [0.04006575857209958, 0.02675417701134, 0.02026879206071315, 0.01608916531509153]
ndcg : [0.056491204501605045, 0.05160543321965035, 0.047006346681776875, 0.042562423217882395]
3
3-0
Epoch 4 - loss=72.6122
3-1
Epoch 4 - loss=53.5380
3-2
Epoch 4 - loss=41.2988
3-3
Epoch 4 - loss=36.9067
3-4
Epoch 4 - loss=44.2711
3-5
Epoch 4 - loss=43.7877
3-6
Epoch 4 - loss=37.6888
3-7
Epoch 4 - loss=37.6778
3-8
Epoch 4 - loss=35.0479
3-9
Epoch 4 - loss=36.2907
3-10
Epoch 4 - loss=40.4050
3-11
Epoch 4 - loss=41.9591
3-12
Epoch 4 - loss=34.3850
3-13
Epoch 4 - loss=36.0059
3-14
Epoch 4 - loss=23.9649
precision : [0.045185533114138254, 0.04307186472522295, 0.038108658211993156, 0.041874119304837594]
recall : [0.011296383278534564, 0.021535932362611476, 0.028581493658994643, 0.041874119304837594]
MAP : [0.027075309221856896, 0.019563287033930527, 0.015171435735080636, 0.013857002950885784]
ndcg : [0.04525629258374485, 0.043717310801200414, 0.04020202661295856, 0.04236376473433662]
4
4-0
Epoch 5 - loss=61.8925
4-1
Epoch 5 - loss=50.0482
4-2
Epoch 5 - loss=35.6327
4-3
Epoch 5 - loss=34.2871
4-4
Epoch 5 - loss=37.6356
4-5
Epoch 5 - loss=40.5915
4-6
Epoch 5 - loss=35.0897
4-7
Epoch 5 - loss=36.0132
4-8
Epoch 5 - loss=33.8157
4-9
Epoch 5 - loss=33.8290
4-10
Epoch 5 - loss=36.7306
4-11
Epoch 5 - loss=40.2762
4-12
Epoch 5 - loss=33.1490
4-13
Epoch 5 - loss=33.8866
4-14
Epoch 5 - loss=19.2487
precision : [0.045185533114138254, 0.04011272898074214, 0.034695475183967546, 0.0393377172381398]
recall : [0.011296383278534564, 0.02005636449037107, 0.02602160638797548, 0.0393377172381398]
MAP : [0.027145764834820733, 0.021772890618592826, 0.01631726405563888, 0.014273858349092073]
ndcg : [0.04564281740656943, 0.04195963100557218, 0.03775462939602092, 0.040415909549211176]
5
5-0
Epoch 6 - loss=58.4320
5-1
Epoch 6 - loss=50.8018
5-2
Epoch 6 - loss=37.0527
5-3
Epoch 6 - loss=32.8270
5-4
Epoch 6 - loss=37.1209
5-5
Epoch 6 - loss=37.1875
5-6
Epoch 6 - loss=33.1775
5-7
Epoch 6 - loss=32.7904
5-8
Epoch 6 - loss=34.6279
5-9
Epoch 6 - loss=32.0058
5-10
Epoch 6 - loss=35.3103
5-11
Epoch 6 - loss=34.9769
5-12
Epoch 6 - loss=31.5922
5-13
Epoch 6 - loss=32.9718
5-14
Epoch 6 - loss=18.4296
precision : [0.045185533114138254, 0.04941286989196785, 0.04468451542195087, 0.042226397369656804]
recall : [0.011296383278534564, 0.024706434945983926, 0.033513386566462876, 0.042226397369656804]
MAP : [0.026884296226710503, 0.02263785442155569, 0.01744196976935352, 0.014593090849419312]
ndcg : [0.045465659985436856, 0.04832486733435034, 0.0453425346385716, 0.043608224215221855]
6
6-0
Epoch 7 - loss=58.4213
6-1
Epoch 7 - loss=45.7135
6-2
Epoch 7 - loss=36.9579
6-3
Epoch 7 - loss=31.4550
6-4
Epoch 7 - loss=35.1586
6-5
Epoch 7 - loss=32.9685
6-6
Epoch 7 - loss=35.8421
6-7
Epoch 7 - loss=30.7457
6-8
Epoch 7 - loss=29.3249
6-9
Epoch 7 - loss=30.6614
6-10
Epoch 7 - loss=36.5477
6-11
Epoch 7 - loss=36.3523
6-12
Epoch 7 - loss=32.4100
6-13
Epoch 7 - loss=33.5181
6-14
Epoch 7 - loss=18.9208
precision : [0.045185533114138254, 0.03832785345232497, 0.044778456239235966, 0.042578675434475965]
recall : [0.011296383278534564, 0.019163926726162486, 0.03358384217942674, 0.042578675434475965]
MAP : [0.026884296226710503, 0.018490814675643234, 0.01723182711205257, 0.014830713508133864]
ndcg : [0.045465659985436856, 0.04035198211461505, 0.04425321088620042, 0.042954125105814145]
7
7-0
Epoch 8 - loss=55.3511
7-1
Epoch 8 - loss=49.8505
7-2
Epoch 8 - loss=34.8276
7-3
Epoch 8 - loss=29.2295
7-4
Epoch 8 - loss=33.9552
7-5
Epoch 8 - loss=33.1419
7-6
Epoch 8 - loss=32.8799
7-7
Epoch 8 - loss=31.0669
7-8
Epoch 8 - loss=31.1622
7-9
Epoch 8 - loss=30.7182
7-10
Epoch 8 - loss=35.6672
7-11
Epoch 8 - loss=35.0867
7-12
Epoch 8 - loss=34.3456
7-13
Epoch 8 - loss=28.9197
7-14
Epoch 8 - loss=18.0465
precision : [0.045185533114138254, 0.044058243306716594, 0.045467355565993614, 0.04605448567402504]
recall : [0.011296383278534564, 0.022029121653358297, 0.034100516674494874, 0.04605448567402504]
MAP : [0.022492563018631593, 0.015344319190021397, 0.013568173471884134, 0.012894196729506917]
ndcg : [0.03997085843739438, 0.04077617713482408, 0.0423819034161583, 0.04336216128727592]
8
8-0
Epoch 9 - loss=56.0580
8-1
Epoch 9 - loss=46.4357
8-2
Epoch 9 - loss=30.7667
8-3
Epoch 9 - loss=29.0713
8-4
Epoch 9 - loss=32.4376
8-5
Epoch 9 - loss=31.5925
8-6
Epoch 9 - loss=33.1686
8-7
Epoch 9 - loss=32.6105
8-8
Epoch 9 - loss=29.3623
8-9
Epoch 9 - loss=28.9745
8-10
Epoch 9 - loss=31.4513
8-11
Epoch 9 - loss=33.9913
8-12
Epoch 9 - loss=28.3835
8-13
Epoch 9 - loss=28.1203
8-14
Epoch 9 - loss=18.1663
precision : [0.06077970878346682, 0.04950681070925292, 0.04778456239235964, 0.051385627054955016]
recall : [0.015194927195866705, 0.02475340535462646, 0.035838421794269375, 0.051385627054955016]
MAP : [0.038038202599029285, 0.023979623789393632, 0.018980455377825035, 0.016558795630094856]
ndcg : [0.06468481207097997, 0.05565032997554468, 0.05313523868406691, 0.05471932857585353]
9
9-0
Epoch 10 - loss=52.7719
9-1
Epoch 10 - loss=42.9529
9-2
Epoch 10 - loss=32.9765
9-3
Epoch 10 - loss=27.3142
9-4
Epoch 10 - loss=31.6532
9-5
Epoch 10 - loss=33.5192
9-6
Epoch 10 - loss=31.0452
9-7
Epoch 10 - loss=27.5306
9-8
Epoch 10 - loss=28.2761
9-9
Epoch 10 - loss=30.1534
9-10
Epoch 10 - loss=32.4576
9-11
Epoch 10 - loss=32.6327
9-12
Epoch 10 - loss=27.1999
9-13
Epoch 10 - loss=28.2267
9-14
Epoch 10 - loss=16.3549
precision : [0.06566463128229241, 0.0529356505401594, 0.0562392359480195, 0.05767966181305709]
recall : [0.016416157820573103, 0.0264678252700797, 0.042179426961014094, 0.05767966181305709]
MAP : [0.03945201189917019, 0.024120069039045084, 0.019940927590058638, 0.017796747292454337]
ndcg : [0.07159990512658894, 0.060638204824848996, 0.06110001039687664, 0.061255800814033104]
10
10-0
Epoch 11 - loss=49.0057
10-1
Epoch 11 - loss=42.1460
10-2
Epoch 11 - loss=28.2850
10-3
Epoch 11 - loss=26.3456
10-4
Epoch 11 - loss=32.0856
10-5
Epoch 11 - loss=30.2405
10-6
Epoch 11 - loss=27.4258
10-7
Epoch 11 - loss=23.1670
10-8
Epoch 11 - loss=24.1116
10-9
Epoch 11 - loss=27.2802
10-10
Epoch 11 - loss=30.9590
10-11
Epoch 11 - loss=29.1598
10-12
Epoch 11 - loss=27.0448
10-13
Epoch 11 - loss=25.0346
10-14
Epoch 11 - loss=14.4787
precision : [0.09243776420854802, 0.08158759981211734, 0.07427587286676032, 0.06906998590887718]
recall : [0.023109441052137004, 0.04079379990605867, 0.05570690465006973, 0.06906998590887718]
MAP : [0.05584155315484578, 0.0363989353374041, 0.02800120864470324, 0.023273693190853314]
ndcg : [0.09642779815118717, 0.08737738911213011, 0.08113783502030189, 0.07648540843604405]
11
11-0
Epoch 12 - loss=48.2827
11-1
Epoch 12 - loss=39.9674
11-2
Epoch 12 - loss=29.2160
11-3
Epoch 12 - loss=26.2362
11-4
Epoch 12 - loss=28.6038
11-5
Epoch 12 - loss=28.8925
11-6
Epoch 12 - loss=27.4668
11-7
Epoch 12 - loss=24.0685
11-8
Epoch 12 - loss=21.2066
11-9
Epoch 12 - loss=22.7477
11-10
Epoch 12 - loss=26.5697
11-11
Epoch 12 - loss=28.5727
11-12
Epoch 12 - loss=25.6128
11-13
Epoch 12 - loss=24.6799
11-14
Epoch 12 - loss=16.2045
precision : [0.0978863316110844, 0.08604978863316, 0.0779708783466412, 0.07287458900892435]
recall : [0.0244715829027711, 0.04302489431658, 0.05847815875998064, 0.07287458900892435]
MAP : [0.061698763112572406, 0.04122594630462174, 0.03198675487308649, 0.02646535579354989]
ndcg : [0.10576556772476561, 0.0948704144446469, 0.08745562602065801, 0.08245132878159134]
12
12-0
Epoch 13 - loss=48.4861
12-1
Epoch 13 - loss=38.6461
12-2
Epoch 13 - loss=26.0090
12-3
Epoch 13 - loss=23.6564
12-4
Epoch 13 - loss=28.3239
12-5
Epoch 13 - loss=25.3221
12-6
Epoch 13 - loss=24.2761
12-7
Epoch 13 - loss=20.1080
12-8
Epoch 13 - loss=21.5273
12-9
Epoch 13 - loss=20.7912
12-10
Epoch 13 - loss=26.0327
12-11
Epoch 13 - loss=26.0098
12-12
Epoch 13 - loss=22.7495
12-13
Epoch 13 - loss=22.7097
12-14
Epoch 13 - loss=13.3440
precision : [0.09300140911225886, 0.09234382339126232, 0.08345075935493927, 0.07703147017379056]
recall : [0.023250352278064716, 0.04617191169563116, 0.06258806951620449, 0.07703147017379056]
MAP : [0.06007671833411617, 0.041551645082645555, 0.03221132215730618, 0.02677880703873481]
ndcg : [0.1020820636926194, 0.09878285512572993, 0.09141998575260606, 0.08577923929912881]
13
13-0
Epoch 14 - loss=47.5182
13-1
Epoch 14 - loss=37.1316
13-2
Epoch 14 - loss=23.1244
13-3
Epoch 14 - loss=22.2895
13-4
Epoch 14 - loss=24.3929
13-5
Epoch 14 - loss=23.1046
13-6
Epoch 14 - loss=23.9708
13-7
Epoch 14 - loss=20.5655
13-8
Epoch 14 - loss=21.2519
13-9
Epoch 14 - loss=22.7694
13-10
Epoch 14 - loss=25.3373
13-11
Epoch 14 - loss=26.0772
13-12
Epoch 14 - loss=24.4897
13-13
Epoch 14 - loss=21.4710
13-14
Epoch 14 - loss=13.1921
precision : [0.09469234382339085, 0.08351338656646219, 0.07865977767339893, 0.07428370126820105]
recall : [0.023673085955847713, 0.041756693283231096, 0.058994833255048895, 0.07428370126820105]
MAP : [0.05535149522467512, 0.036725398316520906, 0.02902807741464388, 0.024226335187201783]
ndcg : [0.09865520650866366, 0.0894120889127534, 0.0848747719353327, 0.0809013977260015]
14
14-0
Epoch 15 - loss=44.3069
14-1
Epoch 15 - loss=35.2363
14-2
Epoch 15 - loss=23.8678
14-3
Epoch 15 - loss=21.6857
14-4
Epoch 15 - loss=25.1394
14-5
Epoch 15 - loss=25.7987
14-6
Epoch 15 - loss=22.3635
14-7
Epoch 15 - loss=22.7689
14-8
Epoch 15 - loss=20.5078
14-9
Epoch 15 - loss=19.9842
14-10
Epoch 15 - loss=24.2718
14-11
Epoch 15 - loss=23.7482
14-12
Epoch 15 - loss=21.0331
14-13
Epoch 15 - loss=19.0839
14-14
Epoch 15 - loss=13.1097
precision : [0.08896195396899914, 0.08243306716768346, 0.07693752935650522, 0.07207609206200091]
recall : [0.022240488492249785, 0.04121653358384173, 0.05770314701737852, 0.07207609206200091]
MAP : [0.05107875371849068, 0.034972824263571095, 0.027361810466554472, 0.02284144458278705]
ndcg : [0.09101831519730881, 0.08570255722128158, 0.08129961287410348, 0.07732955724134832]
15
15-0
Epoch 16 - loss=41.5867
15-1
Epoch 16 - loss=35.4304
15-2
Epoch 16 - loss=23.7324
15-3
Epoch 16 - loss=23.0161
15-4
Epoch 16 - loss=26.0383
15-5
Epoch 16 - loss=23.0243
15-6
Epoch 16 - loss=22.9148
15-7
Epoch 16 - loss=22.3321
15-8
Epoch 16 - loss=18.6186
15-9
Epoch 16 - loss=20.0840
15-10
Epoch 16 - loss=24.0604
15-11
Epoch 16 - loss=25.0408
15-12
Epoch 16 - loss=24.7186
15-13
Epoch 16 - loss=22.7209
15-14
Epoch 16 - loss=12.5533
precision : [0.0898074213245651, 0.0764678252700791, 0.07145764834820736, 0.06928135274776877]
recall : [0.022451855331141274, 0.03823391263503955, 0.053593236261154996, 0.06928135274776877]
MAP : [0.05169406607170816, 0.03356893093858806, 0.02618595711127416, 0.022019812151433817]
ndcg : [0.09264416299423339, 0.0826056714653445, 0.07788622729243448, 0.07531241704907025]
16
16-0
Epoch 17 - loss=47.4120
16-1
Epoch 17 - loss=34.4431
16-2
Epoch 17 - loss=23.3237
16-3
Epoch 17 - loss=22.2416
16-4
Epoch 17 - loss=24.8582
16-5
Epoch 17 - loss=23.4470
16-6
Epoch 17 - loss=22.7879
16-7
Epoch 17 - loss=20.7911
16-8
Epoch 17 - loss=19.4555
16-9
Epoch 17 - loss=20.0486
16-10
Epoch 17 - loss=23.0827
16-11
Epoch 17 - loss=22.6455
16-12
Epoch 17 - loss=21.9224
16-13
Epoch 17 - loss=22.1572
16-14
Epoch 17 - loss=13.4514
precision : [0.0936589948332545, 0.0817754814466876, 0.07455769531861585, 0.06930483795209015]
recall : [0.023414748708313626, 0.0408877407233438, 0.05591827148896146, 0.06930483795209015]
MAP : [0.050945670894003446, 0.03415320927180956, 0.0268741919493446, 0.022442206918917663]
ndcg : [0.09536461896139942, 0.08644781627799819, 0.08056414475347046, 0.07604710036614157]
17
17-0
Epoch 18 - loss=41.5430
17-1
Epoch 18 - loss=37.1483
17-2
Epoch 18 - loss=23.4037
17-3
Epoch 18 - loss=22.0392
17-4
Epoch 18 - loss=24.6136
17-5
Epoch 18 - loss=22.7024
17-6
Epoch 18 - loss=24.0229
17-7
Epoch 18 - loss=22.9068
17-8
Epoch 18 - loss=19.3535
17-9
Epoch 18 - loss=19.9766
17-10
Epoch 18 - loss=24.4832
17-11
Epoch 18 - loss=23.5675
17-12
Epoch 18 - loss=21.1765
17-13
Epoch 18 - loss=20.8950
17-14
Epoch 18 - loss=11.1753
precision : [0.08802254579614814, 0.08276186002818135, 0.07621731642398626, 0.07209957726632214]
recall : [0.022005636449037035, 0.041380930014090676, 0.05716298731798919, 0.07209957726632214]
MAP : [0.04750587130108032, 0.03319119193003646, 0.026525894647078302, 0.022399395029593403]
ndcg : [0.0879000495601815, 0.08404062247505334, 0.07940098221691258, 0.07610997211763348]
18
18-0
Epoch 19 - loss=43.5013
18-1
Epoch 19 - loss=34.1201
18-2
Epoch 19 - loss=22.1453
18-3
Epoch 19 - loss=21.2373
18-4
Epoch 19 - loss=23.6785
18-5
Epoch 19 - loss=23.0822
18-6
Epoch 19 - loss=20.0395
18-7
Epoch 19 - loss=19.6106
18-8
Epoch 19 - loss=17.0490
18-9
Epoch 19 - loss=19.9648
18-10
Epoch 19 - loss=22.9726
18-11
Epoch 19 - loss=23.8467
18-12
Epoch 19 - loss=22.4087
18-13
Epoch 19 - loss=20.9216
18-14
Epoch 19 - loss=11.5324
precision : [0.09365899483325453, 0.08177548144668766, 0.07590418036636903, 0.07240488492249879]
recall : [0.023414748708313633, 0.04088774072334383, 0.05692813527477648, 0.07240488492249879]
MAP : [0.05093314545169876, 0.03453391188947789, 0.02754268103727944, 0.023315187203952585]
ndcg : [0.09415257723102553, 0.08589287800266072, 0.08098434238480993, 0.07781704846860789]
19
19-0
Epoch 20 - loss=42.1636
19-1
Epoch 20 - loss=35.6826
19-2
Epoch 20 - loss=24.5285
19-3
Epoch 20 - loss=20.2476
19-4
Epoch 20 - loss=24.2312
19-5
Epoch 20 - loss=21.9783
19-6
Epoch 20 - loss=21.2962
19-7
Epoch 20 - loss=21.2387
19-8
Epoch 20 - loss=19.0846
19-9
Epoch 20 - loss=22.2493
19-10
Epoch 20 - loss=24.8553
19-11
Epoch 20 - loss=22.9710
19-12
Epoch 20 - loss=21.4654
19-13
Epoch 20 - loss=20.1881
19-14
Epoch 20 - loss=11.5895
precision : [0.10145608266791863, 0.08666040394551341, 0.07928604978863299, 0.07456552372005645]
recall : [0.025364020666979657, 0.04333020197275671, 0.059464537341474416, 0.07456552372005645]
MAP : [0.05754814466885862, 0.03844872769837542, 0.030172293739696276, 0.025311877753799134]
ndcg : [0.10269666362861683, 0.09199675596506543, 0.08587201294286323, 0.08160436857762103]
20
20-0
Epoch 21 - loss=41.6457
20-1
Epoch 21 - loss=34.2919
20-2
Epoch 21 - loss=22.8238
20-3
Epoch 21 - loss=19.9459
20-4
Epoch 21 - loss=20.7845
20-5
Epoch 21 - loss=22.1473
20-6
Epoch 21 - loss=20.7723
20-7
Epoch 21 - loss=19.6995
20-8
Epoch 21 - loss=17.4602
20-9
Epoch 21 - loss=20.3163
20-10
Epoch 21 - loss=23.2800
20-11
Epoch 21 - loss=23.3658
20-12
Epoch 21 - loss=20.4970
20-13
Epoch 21 - loss=19.1422
20-14
Epoch 21 - loss=11.1251
precision : [0.09816815406293983, 0.08553311413809211, 0.07537184906842012, 0.07007984969469226]
recall : [0.024542038515734957, 0.04276655706904606, 0.05652888680131465, 0.07007984969469226]
MAP : [0.054958509472365746, 0.03674379505990591, 0.028502171766615167, 0.023596762665581583]
ndcg : [0.09840234311129559, 0.08964827584410563, 0.08186766681794135, 0.07721431412123902]
21
21-0
Epoch 22 - loss=39.0476
21-1
Epoch 22 - loss=30.3627
21-2
Epoch 22 - loss=21.6400
21-3
Epoch 22 - loss=20.8707
21-4
Epoch 22 - loss=23.5824
21-5
Epoch 22 - loss=22.3741
21-6
Epoch 22 - loss=21.1678
21-7
Epoch 22 - loss=19.7558
21-8
Epoch 22 - loss=17.8111
21-9
Epoch 22 - loss=19.6743
21-10
Epoch 22 - loss=23.4116
21-11
Epoch 22 - loss=24.5015
21-12
Epoch 22 - loss=22.1431
21-13
Epoch 22 - loss=22.4161
21-14
Epoch 22 - loss=11.4953
precision : [0.0975105683419441, 0.08759981211836453, 0.07847189603882875, 0.07181775481446673]
recall : [0.024377642085486026, 0.04379990605918226, 0.05885392202912127, 0.07181775481446673]
MAP : [0.05747925473618287, 0.039059044785911864, 0.03026371563478186, 0.025009075596038467]
ndcg : [0.10218596524520224, 0.0935787246248673, 0.08614848485944232, 0.0803959648338711]
22
22-0
Epoch 23 - loss=38.0880
22-1
Epoch 23 - loss=32.6214
22-2
Epoch 23 - loss=21.0014
22-3
Epoch 23 - loss=21.8306
22-4
Epoch 23 - loss=23.9615
22-5
Epoch 23 - loss=23.3802
22-6
Epoch 23 - loss=21.1952
22-7
Epoch 23 - loss=20.0696
22-8
Epoch 23 - loss=18.1329
22-9
Epoch 23 - loss=17.9208
22-10
Epoch 23 - loss=23.4841
22-11
Epoch 23 - loss=21.3550
22-12
Epoch 23 - loss=19.7238
22-13
Epoch 23 - loss=19.1752
22-14
Epoch 23 - loss=10.4145
precision : [0.09675904180366332, 0.08388914983560279, 0.07574761233756072, 0.07022076092062002]
recall : [0.02418976045091583, 0.041944574917801396, 0.056810709253170034, 0.07022076092062002]
MAP : [0.054967903554094255, 0.037263134939273974, 0.02899277357473694, 0.023914939445703245]
ndcg : [0.09853543719555016, 0.08909656553192193, 0.08249782041067194, 0.07765743416667199]
23
23-0
Epoch 24 - loss=38.7437
23-1
Epoch 24 - loss=33.5115
23-2
Epoch 24 - loss=22.8534
23-3
Epoch 24 - loss=21.0817
23-4
Epoch 24 - loss=24.3165
23-5
Epoch 24 - loss=22.7471
23-6
Epoch 24 - loss=22.2557
23-7
Epoch 24 - loss=21.0050
23-8
Epoch 24 - loss=16.5600
23-9
Epoch 24 - loss=18.5369
23-10
Epoch 24 - loss=20.4993
23-11
Epoch 24 - loss=23.9274
23-12
Epoch 24 - loss=21.5577
23-13
Epoch 24 - loss=18.8542
23-14
Epoch 24 - loss=10.9952
precision : [0.10192578675434431, 0.08600281822451782, 0.07634257084703303, 0.07106622827618589]
recall : [0.02548144668858608, 0.04300140911225891, 0.0572569281352744, 0.07106622827618589]
MAP : [0.05896038828871144, 0.03924426103618212, 0.03013435636263255, 0.025167366145007756]
ndcg : [0.10420501596165607, 0.0923868488255388, 0.08445080660918368, 0.07955116874548884]
24
24-0
Epoch 25 - loss=37.0999
24-1
Epoch 25 - loss=30.8851
24-2
Epoch 25 - loss=20.8154
24-3
Epoch 25 - loss=21.8736
24-4
Epoch 25 - loss=23.5907
24-5
Epoch 25 - loss=22.2276
24-6
Epoch 25 - loss=18.0298
24-7
Epoch 25 - loss=18.1723
24-8
Epoch 25 - loss=17.3043
24-9
Epoch 25 - loss=20.4208
24-10
Epoch 25 - loss=24.8741
24-11
Epoch 25 - loss=22.4153
24-12
Epoch 25 - loss=20.4428
24-13
Epoch 25 - loss=19.7919
24-14
Epoch 25 - loss=11.2819
precision : [0.0963832785345227, 0.08727101925786669, 0.07909816815406277, 0.07217003287928603]
recall : [0.024095819633630677, 0.043635509628933346, 0.05932362611554686, 0.07217003287928603]
MAP : [0.0530624706434946, 0.037091040580941946, 0.029305444481583513, 0.02431081039783635]
ndcg : [0.09754633297298815, 0.09094597785262153, 0.08462722922852592, 0.0790798605020886]
25
25-0
Epoch 26 - loss=38.3628
25-1
Epoch 26 - loss=32.7378
25-2
Epoch 26 - loss=21.7697
25-3
Epoch 26 - loss=20.9224
25-4
Epoch 26 - loss=19.7254
25-5
Epoch 26 - loss=21.8181
25-6
Epoch 26 - loss=20.2575
25-7
Epoch 26 - loss=19.3778
25-8
Epoch 26 - loss=18.1240
25-9
Epoch 26 - loss=21.8190
25-10
Epoch 26 - loss=23.4541
25-11
Epoch 26 - loss=22.6891
25-12
Epoch 26 - loss=21.0351
25-13
Epoch 26 - loss=20.2887
25-14
Epoch 26 - loss=12.4617
precision : [0.0936589948332545, 0.0831845937059643, 0.0759354939721308, 0.06979802724283694]
recall : [0.023414748708313626, 0.04159229685298215, 0.0569516204790978, 0.06979802724283694]
MAP : [0.05123062470643494, 0.03554001058698099, 0.02797981952984302, 0.02322750160764872]
ndcg : [0.09628562237496154, 0.08821270489073825, 0.08219515203409163, 0.07703893180826628]
26
26-0
Epoch 27 - loss=38.2052
26-1
Epoch 27 - loss=34.2235
26-2
Epoch 27 - loss=21.8188
26-3
Epoch 27 - loss=22.0204
26-4
Epoch 27 - loss=25.3950
26-5
Epoch 27 - loss=19.2322
26-6
Epoch 27 - loss=19.6525
26-7
Epoch 27 - loss=18.3555
26-8
Epoch 27 - loss=16.9228
26-9
Epoch 27 - loss=19.0337
26-10
Epoch 27 - loss=21.4098
26-11
Epoch 27 - loss=19.9957
26-12
Epoch 27 - loss=20.3848
26-13
Epoch 27 - loss=20.7026
26-14
Epoch 27 - loss=12.0784
precision : [0.09891968060122058, 0.08158759981211763, 0.07214654767496477, 0.07036167214654762]
recall : [0.024729920150305146, 0.04079379990605882, 0.054109910756223185, 0.07036167214654762]
MAP : [0.05168780335055582, 0.03475271570973779, 0.026966877476506407, 0.023119676921637935]
ndcg : [0.09742863176120756, 0.08589932626741872, 0.07856975117371551, 0.07629730248853077]
27
27-0
Epoch 28 - loss=41.9956
27-1
Epoch 28 - loss=29.8256
27-2
Epoch 28 - loss=21.4519
27-3
Epoch 28 - loss=20.6814
27-4
Epoch 28 - loss=22.2663
27-5
Epoch 28 - loss=22.7836
27-6
Epoch 28 - loss=20.2231
27-7
Epoch 28 - loss=20.0183
27-8
Epoch 28 - loss=16.8969
27-9
Epoch 28 - loss=18.9573
27-10
Epoch 28 - loss=24.1928
27-11
Epoch 28 - loss=23.9645
27-12
Epoch 28 - loss=20.8611
27-13
Epoch 28 - loss=21.3173
27-14
Epoch 28 - loss=13.2960
precision : [0.09929544387036107, 0.08525129168623688, 0.07596680757789255, 0.0693987787693752]
recall : [0.024823860967590268, 0.04262564584311844, 0.05697510568341904, 0.0693987787693752]
MAP : [0.0563472678878973, 0.03786074019399524, 0.029622862828593218, 0.02458051677484466]
ndcg : [0.09939227708729428, 0.08969044240323655, 0.0824719944093542, 0.0769722503469909]
28
28-0
Epoch 29 - loss=37.3316
28-1
Epoch 29 - loss=30.2809
28-2
Epoch 29 - loss=22.5016
28-3
Epoch 29 - loss=22.2178
28-4
Epoch 29 - loss=23.6033
28-5
Epoch 29 - loss=22.6223
28-6
Epoch 29 - loss=19.3238
28-7
Epoch 29 - loss=17.9658
28-8
Epoch 29 - loss=18.1570
28-9
Epoch 29 - loss=19.8830
28-10
Epoch 29 - loss=21.2568
28-11
Epoch 29 - loss=19.9139
28-12
Epoch 29 - loss=20.3560
28-13
Epoch 29 - loss=18.0446
28-14
Epoch 29 - loss=12.0048
precision : [0.09732268670737385, 0.08717707844058162, 0.07703147017379058, 0.07125410991075626]
recall : [0.02433067167684346, 0.04358853922029081, 0.05777360263034254, 0.07125410991075626]
MAP : [0.05532018161891342, 0.038142115308625414, 0.029572355431913906, 0.02483058779643282]
ndcg : [0.09761030215194433, 0.09052050789993558, 0.08292936245174601, 0.0780841548889868]
29
29-0
Epoch 30 - loss=35.7203
29-1
Epoch 30 - loss=31.2097
29-2
Epoch 30 - loss=23.4501
29-3
Epoch 30 - loss=21.8427
29-4
Epoch 30 - loss=22.1267
29-5
Epoch 30 - loss=22.1310
29-6
Epoch 30 - loss=20.2252
29-7
Epoch 30 - loss=20.3377
29-8
Epoch 30 - loss=16.1319
29-9
Epoch 30 - loss=18.1911
29-10
Epoch 30 - loss=23.4760
29-11
Epoch 30 - loss=21.8117
29-12
Epoch 30 - loss=20.3228
29-13
Epoch 30 - loss=20.1933
29-14
Epoch 30 - loss=11.8447
precision : [0.09140441521841201, 0.08337247534053484, 0.07521528103961175, 0.06979802724283704]
recall : [0.022851103804603003, 0.04168623767026742, 0.05641146077970845, 0.06979802724283704]
MAP : [0.04960544856740254, 0.03527941801427006, 0.027662605908261147, 0.02334864760778666]
ndcg : [0.08951989738346539, 0.0847016636549115, 0.07893278122435823, 0.07469588637997883]
30
30-0
Epoch 31 - loss=36.0849
30-1
Epoch 31 - loss=30.5486
30-2
Epoch 31 - loss=21.4659
30-3
Epoch 31 - loss=18.7373
30-4
Epoch 31 - loss=22.6550
30-5
Epoch 31 - loss=20.0415
30-6
Epoch 31 - loss=19.6875
30-7
Epoch 31 - loss=19.0066
30-8
Epoch 31 - loss=18.4218
30-9
Epoch 31 - loss=19.2580
30-10
Epoch 31 - loss=23.2215
30-11
Epoch 31 - loss=21.9722
30-12
Epoch 31 - loss=21.0013
30-13
Epoch 31 - loss=18.4116
30-14
Epoch 31 - loss=11.6736
precision : [0.09365899483325461, 0.08276186002818156, 0.07612337560670109, 0.06998590887740729]
recall : [0.023414748708313653, 0.04138093001409078, 0.05709253170502542, 0.06998590887740729]
MAP : [0.050172224831689365, 0.03492108225786009, 0.027955752648096473, 0.02340674241145872]
ndcg : [0.09090729190629997, 0.08437193586775371, 0.07954016948466655, 0.07486423026706182]
31
31-0
Epoch 32 - loss=41.2126
31-1
Epoch 32 - loss=32.5614
31-2
Epoch 32 - loss=23.0906
31-3
Epoch 32 - loss=20.7711
31-4
Epoch 32 - loss=21.3568
31-5
Epoch 32 - loss=18.6025
31-6
Epoch 32 - loss=20.4259
31-7
Epoch 32 - loss=17.9931
31-8
Epoch 32 - loss=17.0026
31-9
Epoch 32 - loss=17.4770
31-10
Epoch 32 - loss=21.6324
31-11
Epoch 32 - loss=21.0675
31-12
Epoch 32 - loss=22.1762
31-13
Epoch 32 - loss=19.6753
31-14
Epoch 32 - loss=11.7686
precision : [0.08971348050728016, 0.08130577736026245, 0.07643651166431807, 0.07078440582433065]
recall : [0.02242837012682004, 0.04065288868013123, 0.05732738374823822, 0.07078440582433065]
MAP : [0.05121496790355409, 0.03521636210457254, 0.028543382056768624, 0.02414602204662292]
ndcg : [0.09128250165265706, 0.08496347952085272, 0.0808932721656055, 0.07638034528135355]
32
32-0
Epoch 33 - loss=36.8174
32-1
Epoch 33 - loss=29.7700
32-2
Epoch 33 - loss=23.1473
32-3
Epoch 33 - loss=18.9229
32-4
Epoch 33 - loss=20.6554
32-5
Epoch 33 - loss=17.6282
32-6
Epoch 33 - loss=18.6542
32-7
Epoch 33 - loss=20.1573
32-8
Epoch 33 - loss=17.1738
32-9
Epoch 33 - loss=19.8614
32-10
Epoch 33 - loss=25.0011
32-11
Epoch 33 - loss=21.7495
32-12
Epoch 33 - loss=20.1617
32-13
Epoch 33 - loss=18.7978
32-14
Epoch 33 - loss=11.0000
precision : [0.08529826209488, 0.07740723344293045, 0.07233442930953511, 0.06759041803663679]
recall : [0.02132456552372, 0.038703616721465224, 0.05425082198215086, 0.06759041803663679]
MAP : [0.04760137779865352, 0.03312947803201444, 0.026527438342844635, 0.02238763967550757]
ndcg : [0.08544233586436974, 0.07999375490804171, 0.07596886885177175, 0.07219767090414046]
33
33-0
Epoch 34 - loss=35.5435
33-1
Epoch 34 - loss=30.5069
33-2
Epoch 34 - loss=21.8653
33-3
Epoch 34 - loss=19.2858
33-4
Epoch 34 - loss=22.8881
33-5
Epoch 34 - loss=20.8998
33-6
Epoch 34 - loss=17.7019
33-7
Epoch 34 - loss=17.9104
33-8
Epoch 34 - loss=15.5232
33-9
Epoch 34 - loss=18.4722
33-10
Epoch 34 - loss=21.3273
33-11
Epoch 34 - loss=20.3236
33-12
Epoch 34 - loss=21.0814
33-13
Epoch 34 - loss=18.8795
33-14
Epoch 34 - loss=12.0990
precision : [0.08708313762329713, 0.07956787224048788, 0.06995459527164564, 0.06596993893846848]
recall : [0.021770784405824282, 0.03978393612024394, 0.052465946453733696, 0.06596993893846848]
MAP : [0.04925473618287146, 0.03435853705816129, 0.026355383999818006, 0.0220137028501633]
ndcg : [0.0867866048633476, 0.08172555748899114, 0.07478727068667125, 0.07129685388958913]
34
34-0
Epoch 35 - loss=35.9846
34-1
Epoch 35 - loss=32.3184
34-2
Epoch 35 - loss=21.9195
34-3
Epoch 35 - loss=18.4961
34-4
Epoch 35 - loss=20.8349
34-5
Epoch 35 - loss=20.8801
34-6
Epoch 35 - loss=20.5023
34-7
Epoch 35 - loss=17.0032
34-8
Epoch 35 - loss=16.0369
34-9
Epoch 35 - loss=16.1583
34-10
Epoch 35 - loss=21.9246
34-11
Epoch 35 - loss=20.0310
34-12
Epoch 35 - loss=20.6165
34-13
Epoch 35 - loss=17.2709
34-14
Epoch 35 - loss=12.0291
precision : [0.08745890089243752, 0.08013151714419851, 0.07095663065602019, 0.0659699389384685]
recall : [0.02186472522310938, 0.04006575857209926, 0.053217472992014576, 0.0659699389384685]
MAP : [0.04996712071395021, 0.034624609511880525, 0.026802993294303766, 0.02237471518927514]
ndcg : [0.08845831624895549, 0.08312092479779142, 0.07628875319464591, 0.07203959151566604]
35
35-0
Epoch 36 - loss=35.3951
35-1
Epoch 36 - loss=30.4173
35-2
Epoch 36 - loss=21.3768
35-3
Epoch 36 - loss=16.8042
35-4
Epoch 36 - loss=22.2439
35-5
Epoch 36 - loss=18.5142
35-6
Epoch 36 - loss=18.9709
35-7
Epoch 36 - loss=16.8992
35-8
Epoch 36 - loss=16.0597
35-9
Epoch 36 - loss=17.0066
35-10
Epoch 36 - loss=23.2739
35-11
Epoch 36 - loss=21.2009
35-12
Epoch 36 - loss=21.6945
35-13
Epoch 36 - loss=19.5272
35-14
Epoch 36 - loss=10.4266
precision : [0.08708313762329707, 0.07642085486143668, 0.06860811022389232, 0.06550023485204294]
recall : [0.021770784405824268, 0.03821042743071834, 0.05145608266791882, 0.06550023485204294]
MAP : [0.04989040237983404, 0.03368710252223638, 0.02625956719897537, 0.02223892212604682]
ndcg : [0.08806509824140023, 0.08037256039822374, 0.07420837721004717, 0.07119705511695461]
36
36-0
Epoch 37 - loss=34.8728
36-1
Epoch 37 - loss=28.9537
36-2
Epoch 37 - loss=19.2248
36-3
Epoch 37 - loss=18.5842
36-4
Epoch 37 - loss=22.2871
36-5
Epoch 37 - loss=18.2125
36-6
Epoch 37 - loss=22.6152
36-7
Epoch 37 - loss=18.3627
36-8
Epoch 37 - loss=16.7159
36-9
Epoch 37 - loss=18.1318
36-10
Epoch 37 - loss=24.0809
36-11
Epoch 37 - loss=21.0140
36-12
Epoch 37 - loss=20.2708
36-13
Epoch 37 - loss=17.5906
36-14
Epoch 37 - loss=10.3221
precision : [0.08332550493189268, 0.07543447627994308, 0.06845154219508388, 0.06561766087364936]
recall : [0.02083137623297317, 0.03771723813997154, 0.05133865664631242, 0.06561766087364936]
MAP : [0.04666666666666667, 0.03286823309251679, 0.025439541322585003, 0.021601714573102792]
ndcg : [0.0835380815425438, 0.0779671986157911, 0.07271055517462954, 0.0700970506227838]
37
37-0
Epoch 38 - loss=36.3031
37-1
Epoch 38 - loss=30.0425
37-2
Epoch 38 - loss=22.4881
37-3
Epoch 38 - loss=20.9810
37-4
Epoch 38 - loss=19.3368
37-5
Epoch 38 - loss=20.3573
37-6
Epoch 38 - loss=20.2334
37-7
Epoch 38 - loss=18.5761
37-8
Epoch 38 - loss=15.9313
37-9
Epoch 38 - loss=19.7482
37-10
Epoch 38 - loss=20.5477
37-11
Epoch 38 - loss=19.1629
37-12
Epoch 38 - loss=18.9919
37-13
Epoch 38 - loss=19.6261
37-14
Epoch 38 - loss=10.4846
precision : [0.08529826209488002, 0.07665570690464954, 0.07114451229059035, 0.0685767966181305]
recall : [0.021324565523720005, 0.03832785345232477, 0.05335838421794232, 0.0685767966181305]
MAP : [0.04890558947862847, 0.03387192735243463, 0.02703540079773053, 0.02300710903800135]
ndcg : [0.08747094693110266, 0.08063234004383832, 0.0760942027638195, 0.07356970316874452]
38
38-0
Epoch 39 - loss=33.6774
38-1
Epoch 39 - loss=29.2174
38-2
Epoch 39 - loss=19.6380
38-3
Epoch 39 - loss=19.6836
38-4
Epoch 39 - loss=21.4473
38-5
Epoch 39 - loss=18.9107
38-6
Epoch 39 - loss=19.4583
38-7
Epoch 39 - loss=16.3241
38-8
Epoch 39 - loss=17.6952
38-9
Epoch 39 - loss=17.2860
38-10
Epoch 39 - loss=19.3110
38-11
Epoch 39 - loss=21.2638
38-12
Epoch 39 - loss=22.1005
38-13
Epoch 39 - loss=18.5498
38-14
Epoch 39 - loss=10.2177
precision : [0.08520432127759488, 0.07839361202442409, 0.07374354156881162, 0.06869422263973696]
recall : [0.02130108031939872, 0.039196806012212045, 0.055307656176608315, 0.06869422263973696]
MAP : [0.04897761077188038, 0.03448026870055992, 0.02732748506820841, 0.023001477326347684]
ndcg : [0.08627066278699017, 0.08119285777824427, 0.07743325346616627, 0.07344753494528174]
39
39-0
Epoch 40 - loss=31.1885
39-1
Epoch 40 - loss=27.7858
39-2
Epoch 40 - loss=22.6855
39-3
Epoch 40 - loss=19.7619
39-4
Epoch 40 - loss=21.1462
39-5
Epoch 40 - loss=19.3175
39-6
Epoch 40 - loss=16.2801
39-7
Epoch 40 - loss=20.0801
39-8
Epoch 40 - loss=18.6826
39-9
Epoch 40 - loss=17.4023
39-10
Epoch 40 - loss=21.2429
39-11
Epoch 40 - loss=21.5252
39-12
Epoch 40 - loss=20.4866
39-13
Epoch 40 - loss=20.2789
39-14
Epoch 40 - loss=10.0483
precision : [0.08558008454673526, 0.07956787224048782, 0.07289807421324561, 0.06855331141380924]
recall : [0.021395021136683814, 0.03978393612024391, 0.054673555659933905, 0.06855331141380924]
MAP : [0.05137779865351495, 0.03590716261453697, 0.028192012743445342, 0.023727308414443503]
ndcg : [0.09009274907348612, 0.08439802670943039, 0.07882726894118136, 0.07491530334149174]
40
40-0
Epoch 41 - loss=34.9776
40-1
Epoch 41 - loss=30.4592
40-2
Epoch 41 - loss=20.0046
40-3
Epoch 41 - loss=18.8637
40-4
Epoch 41 - loss=22.1172
40-5
Epoch 41 - loss=20.9020
40-6
Epoch 41 - loss=19.9932
40-7
Epoch 41 - loss=18.8289
40-8
Epoch 41 - loss=17.1563
40-9
Epoch 41 - loss=18.1651
40-10
Epoch 41 - loss=21.9781
40-11
Epoch 41 - loss=20.3384
40-12
Epoch 41 - loss=18.3358
40-13
Epoch 41 - loss=18.5627
40-14
Epoch 41 - loss=10.8087
precision : [0.08886801315171416, 0.07834664161578155, 0.07296070142476913, 0.06751996242367296]
recall : [0.02221700328792854, 0.03917332080789077, 0.054720526068576456, 0.06751996242367296]
MAP : [0.053372475340535463, 0.03619701849739426, 0.02846852875739677, 0.02362929243835173]
ndcg : [0.09232617960899876, 0.08371283404725836, 0.07891038272326988, 0.07426642812739448]
41
41-0
Epoch 42 - loss=35.5163
41-1
Epoch 42 - loss=27.8969
41-2
Epoch 42 - loss=19.7567
41-3
Epoch 42 - loss=18.8720
41-4
Epoch 42 - loss=20.1755
41-5
Epoch 42 - loss=19.4703
41-6
Epoch 42 - loss=19.2565
41-7
Epoch 42 - loss=17.7559
41-8
Epoch 42 - loss=17.7602
41-9
Epoch 42 - loss=17.2313
41-10
Epoch 42 - loss=21.2040
41-11
Epoch 42 - loss=20.7662
41-12
Epoch 42 - loss=18.1949
41-13
Epoch 42 - loss=18.1354
41-14
Epoch 42 - loss=11.7690
precision : [0.08595584781587574, 0.07642085486143682, 0.07042429935807121, 0.06587599812118346]
recall : [0.021488961953968936, 0.03821042743071841, 0.05281822451855296, 0.06587599812118346]
MAP : [0.050497886331611085, 0.03448285952865568, 0.0271063340743942, 0.022515058613490884]
ndcg : [0.08841490746748319, 0.08092570968482699, 0.07589172001693956, 0.07193531786207939]
42
42-0
Epoch 43 - loss=33.2613
42-1
Epoch 43 - loss=27.0375
42-2
Epoch 43 - loss=20.2550
42-3
Epoch 43 - loss=20.1637
42-4
Epoch 43 - loss=20.7583
42-5
Epoch 43 - loss=18.8502
42-6
Epoch 43 - loss=18.4343
42-7
Epoch 43 - loss=15.9305
42-8
Epoch 43 - loss=15.8750
42-9
Epoch 43 - loss=17.1741
42-10
Epoch 43 - loss=21.8767
42-11
Epoch 43 - loss=20.8043
42-12
Epoch 43 - loss=23.6859
42-13
Epoch 43 - loss=20.2129
42-14
Epoch 43 - loss=11.2905
precision : [0.09027712541099071, 0.07759511507750066, 0.06967277281979035, 0.06651009863785799]
recall : [0.02256928135274768, 0.03879755753875033, 0.05225457961484228, 0.06651009863785799]
MAP : [0.05222483168936903, 0.034933794090675256, 0.026999742598615307, 0.02291482545032592]
ndcg : [0.09137652133747243, 0.08229468640786868, 0.07590368150526246, 0.07275418936515136]
43
43-0
Epoch 44 - loss=35.9051
43-1
Epoch 44 - loss=26.1727
43-2
Epoch 44 - loss=20.1484
43-3
Epoch 44 - loss=19.1559
43-4
Epoch 44 - loss=19.7056
43-5
Epoch 44 - loss=17.3436
43-6
Epoch 44 - loss=18.2709
43-7
Epoch 44 - loss=17.0312
43-8
Epoch 44 - loss=15.5512
43-9
Epoch 44 - loss=17.3966
43-10
Epoch 44 - loss=20.5162
43-11
Epoch 44 - loss=20.1015
43-12
Epoch 44 - loss=20.2794
43-13
Epoch 44 - loss=17.8342
43-14
Epoch 44 - loss=10.4929
precision : [0.0901831845937056, 0.07891028651949226, 0.07330515108814785, 0.06794269610145605]
recall : [0.0225457961484264, 0.03945514325974613, 0.05497886331611051, 0.06794269610145605]
MAP : [0.05238296539846564, 0.03557365407412378, 0.028077054462681515, 0.023439229444633402]
ndcg : [0.09203655173418353, 0.08360407689291093, 0.0787972786905793, 0.07428849652340173]
44
44-0
Epoch 45 - loss=35.1636
44-1
Epoch 45 - loss=28.3121
44-2
Epoch 45 - loss=18.6909
44-3
Epoch 45 - loss=20.0439
44-4
Epoch 45 - loss=21.5477
44-5
Epoch 45 - loss=21.9268
44-6
Epoch 45 - loss=19.0882
44-7
Epoch 45 - loss=18.0230
44-8
Epoch 45 - loss=17.9661
44-9
Epoch 45 - loss=19.3644
44-10
Epoch 45 - loss=18.0566
44-11
Epoch 45 - loss=17.2971
44-12
Epoch 45 - loss=19.8007
44-13
Epoch 45 - loss=19.9186
44-14
Epoch 45 - loss=10.0836
precision : [0.09309534992954392, 0.08069516204790916, 0.07355565993424137, 0.06909347111319855]
recall : [0.02327383748238598, 0.04034758102395458, 0.055166744950680774, 0.06909347111319855]
MAP : [0.0528401440425865, 0.03560101620106317, 0.02811673469963747, 0.02358610884979298]
ndcg : [0.09379449685579332, 0.08484376935656104, 0.07911024873428077, 0.07519060898329205]
45
45-0
Epoch 46 - loss=30.0522
45-1
Epoch 46 - loss=27.6206
45-2
Epoch 46 - loss=21.8918
45-3
Epoch 46 - loss=20.8981
45-4
Epoch 46 - loss=19.5246
45-5
Epoch 46 - loss=21.1413
45-6
Epoch 46 - loss=18.6469
45-7
Epoch 46 - loss=16.9828
45-8
Epoch 46 - loss=15.9137
45-9
Epoch 46 - loss=16.6472
45-10
Epoch 46 - loss=20.7943
45-11
Epoch 46 - loss=19.9625
45-12
Epoch 46 - loss=20.7956
45-13
Epoch 46 - loss=19.0982
45-14
Epoch 46 - loss=10.4687
precision : [0.09112259276655674, 0.08210427430718578, 0.07496477219351819, 0.06942226397369654]
recall : [0.022780648191639184, 0.04105213715359289, 0.0562235791451383, 0.06942226397369654]
MAP : [0.048872710192578675, 0.034727385239362696, 0.02775996857725369, 0.02341493124634074]
ndcg : [0.08825093036248402, 0.08299295575619785, 0.07803278539865749, 0.07380896213975156]
46
46-0
Epoch 47 - loss=33.0225
46-1
Epoch 47 - loss=29.2254
46-2
Epoch 47 - loss=20.6795
46-3
Epoch 47 - loss=21.2888
46-4
Epoch 47 - loss=21.5072
46-5
Epoch 47 - loss=19.6714
46-6
Epoch 47 - loss=20.4780
46-7
Epoch 47 - loss=19.0716
46-8
Epoch 47 - loss=14.9134
46-9
Epoch 47 - loss=17.4817
46-10
Epoch 47 - loss=20.2598
46-11
Epoch 47 - loss=21.0871
46-12
Epoch 47 - loss=19.5524
46-13
Epoch 47 - loss=16.9798
46-14
Epoch 47 - loss=10.5628
precision : [0.0928135274776887, 0.08318459370596451, 0.07671833411617347, 0.07038515735086898]
recall : [0.023203381869422175, 0.041592296852982255, 0.05753875058712976, 0.07038515735086898]
MAP : [0.05080475966807577, 0.03553367330962445, 0.02817846054576914, 0.02363881894868368]
ndcg : [0.09164730884659289, 0.08540956437291065, 0.08056302519719166, 0.07566967785577233]
47
47-0
Epoch 48 - loss=31.9307
47-1
Epoch 48 - loss=27.4639
47-2
Epoch 48 - loss=20.6111
47-3
Epoch 48 - loss=18.2443
47-4
Epoch 48 - loss=20.0772
47-5
Epoch 48 - loss=20.4722
47-6
Epoch 48 - loss=19.2941
47-7
Epoch 48 - loss=17.2737
47-8
Epoch 48 - loss=16.1454
47-9
Epoch 48 - loss=14.5112
47-10
Epoch 48 - loss=20.6273
47-11
Epoch 48 - loss=20.5705
47-12
Epoch 48 - loss=19.0611
47-13
Epoch 48 - loss=16.7694
47-14
Epoch 48 - loss=11.1293
precision : [0.09431658055425043, 0.08341944574917735, 0.07665570690464998, 0.07047909816815412]
recall : [0.02357914513856261, 0.04170972287458868, 0.057491780178487176, 0.07047909816815412]
MAP : [0.055229372162204485, 0.03807609578981115, 0.02959783766500535, 0.02459168537754358]
ndcg : [0.09677934899008425, 0.08839407838277027, 0.08270877916354868, 0.07755102175152041]
48
48-0
Epoch 49 - loss=28.5434
48-1
Epoch 49 - loss=31.8716
48-2
Epoch 49 - loss=21.4690
48-3
Epoch 49 - loss=19.7980
48-4
Epoch 49 - loss=19.9022
48-5
Epoch 49 - loss=19.1307
48-6
Epoch 49 - loss=20.1943
48-7
Epoch 49 - loss=19.9345
48-8
Epoch 49 - loss=15.8638
48-9
Epoch 49 - loss=16.2120
48-10
Epoch 49 - loss=21.6250
48-11
Epoch 49 - loss=20.0801
48-12
Epoch 49 - loss=19.9233
48-13
Epoch 49 - loss=19.3154
48-14
Epoch 49 - loss=12.4422
precision : [0.09469234382339091, 0.08219821512447113, 0.07252231094410529, 0.06730859558478147]
recall : [0.023673085955847727, 0.041099107562235566, 0.0543917332080786, 0.06730859558478147]
MAP : [0.05657116016909347, 0.038357731851156, 0.0294684219977785, 0.024478333038800894]
ndcg : [0.09730307792683128, 0.08774286418206872, 0.0800130549448402, 0.07527068270592095]
49
49-0
Epoch 50 - loss=29.0723
49-1
Epoch 50 - loss=26.1760
49-2
Epoch 50 - loss=20.0364
49-3
Epoch 50 - loss=19.6363
49-4
Epoch 50 - loss=21.2898
49-5
Epoch 50 - loss=17.8474
49-6
Epoch 50 - loss=19.9874
49-7
Epoch 50 - loss=16.1134
49-8
Epoch 50 - loss=16.0344
49-9
Epoch 50 - loss=17.2172
49-10
Epoch 50 - loss=21.4752
49-11
Epoch 50 - loss=19.1697
49-12
Epoch 50 - loss=19.9056
49-13
Epoch 50 - loss=17.1157
49-14
Epoch 50 - loss=10.8116
precision : [0.08952559887270983, 0.07623297322686653, 0.06898387349303275, 0.06467825270079824]
recall : [0.022381399718177458, 0.03811648661343327, 0.0517379051197742, 0.06467825270079824]
MAP : [0.05405041490527634, 0.036040506385738885, 0.028057404210527742, 0.02339664892283565]
ndcg : [0.09391198326051303, 0.08301086867580156, 0.0766260967533029, 0.07245018996007553]
50
50-0
Epoch 51 - loss=33.9100
50-1
Epoch 51 - loss=27.6670
50-2
Epoch 51 - loss=19.4751
50-3
Epoch 51 - loss=18.4359
50-4
Epoch 51 - loss=20.2481
50-5
Epoch 51 - loss=19.0688
50-6
Epoch 51 - loss=21.1738
50-7
Epoch 51 - loss=15.6010
50-8
Epoch 51 - loss=16.5068
50-9
Epoch 51 - loss=19.6860
50-10
Epoch 51 - loss=19.7668
50-11
Epoch 51 - loss=18.3145
50-12
Epoch 51 - loss=18.8588
50-13
Epoch 51 - loss=16.5764
50-14
Epoch 51 - loss=10.5560
precision : [0.09018318459370563, 0.0767966181305772, 0.0700485360889307, 0.06514795678722382]
recall : [0.022545796148426406, 0.0383983090652886, 0.05253640206669766, 0.06514795678722382]
MAP : [0.0527133239392516, 0.03499703639088327, 0.027522722306658427, 0.023029729617687525]
ndcg : [0.0932704632245346, 0.08284588728120965, 0.07693177678137764, 0.07249861677438399]
51
51-0
Epoch 52 - loss=31.3829
51-1
Epoch 52 - loss=25.9607
51-2
Epoch 52 - loss=19.0365
51-3
Epoch 52 - loss=19.1903
51-4
Epoch 52 - loss=19.9823
51-5
Epoch 52 - loss=17.8661
51-6
Epoch 52 - loss=17.7706
51-7
Epoch 52 - loss=17.6179
51-8
Epoch 52 - loss=16.1648
51-9
Epoch 52 - loss=16.8958
51-10
Epoch 52 - loss=21.0527
51-11
Epoch 52 - loss=19.7310
51-12
Epoch 52 - loss=18.8366
51-13
Epoch 52 - loss=16.5327
51-14
Epoch 52 - loss=9.7857
precision : [0.08980742132456516, 0.08060122123062409, 0.07177078440582436, 0.06613433536871755]
recall : [0.02245185533114129, 0.040300610615312045, 0.053828088304367895, 0.06613433536871755]
MAP : [0.05116643181462345, 0.03522806742863107, 0.027692851830944835, 0.023066560425032075]
ndcg : [0.09151031001377777, 0.08448260048146848, 0.07765774096417954, 0.07290385442061827]
52
52-0
Epoch 53 - loss=33.5549
52-1
Epoch 53 - loss=26.3068
52-2
Epoch 53 - loss=17.5218
52-3
Epoch 53 - loss=18.6995
52-4
Epoch 53 - loss=18.0452
52-5
Epoch 53 - loss=19.2348
52-6
Epoch 53 - loss=17.4770
52-7
Epoch 53 - loss=15.3999
52-8
Epoch 53 - loss=15.2904
52-9
Epoch 53 - loss=15.9636
52-10
Epoch 53 - loss=20.3839
52-11
Epoch 53 - loss=20.2730
52-12
Epoch 53 - loss=17.6887
52-13
Epoch 53 - loss=17.0367
52-14
Epoch 53 - loss=10.2274
precision : [0.08914983560356947, 0.07806481916392605, 0.07058086738687955, 0.06634570220760908]
recall : [0.022287458900892367, 0.03903240958196302, 0.05293565054015932, 0.06634570220760908]
MAP : [0.05287615468921246, 0.03566446353083272, 0.027825198391191814, 0.023389542869669152]
ndcg : [0.09287535520462657, 0.08393343219181647, 0.07757663576933868, 0.07357875359887711]
53
53-0
Epoch 54 - loss=30.7194
53-1
Epoch 54 - loss=25.6774
53-2
Epoch 54 - loss=19.1072
53-3
Epoch 54 - loss=19.8711
53-4
Epoch 54 - loss=19.2885
53-5
Epoch 54 - loss=17.7762
53-6
Epoch 54 - loss=18.4455
53-7
Epoch 54 - loss=16.1896
53-8
Epoch 54 - loss=15.0365
53-9
Epoch 54 - loss=16.9257
53-10
Epoch 54 - loss=17.4125
53-11
Epoch 54 - loss=18.6865
53-12
Epoch 54 - loss=16.7241
53-13
Epoch 54 - loss=15.8400
53-14
Epoch 54 - loss=10.1940
precision : [0.09093471113198642, 0.07970878346641544, 0.071269766713637, 0.06505401596993889]
recall : [0.022733677782996606, 0.03985439173320772, 0.053452325035227434, 0.06505401596993889]
MAP : [0.05414122436198529, 0.03671257464939945, 0.02833942400170676, 0.02341895437336617]
ndcg : [0.09441270158453742, 0.08533544682276542, 0.07838513881710749, 0.07302079286802422]
54
54-0
Epoch 55 - loss=27.8138
54-1
Epoch 55 - loss=25.2779
54-2
Epoch 55 - loss=20.0691
54-3
Epoch 55 - loss=18.9521
54-4
Epoch 55 - loss=19.2255
54-5
Epoch 55 - loss=18.8162
54-6
Epoch 55 - loss=17.6609
54-7
Epoch 55 - loss=18.3984
54-8
Epoch 55 - loss=13.8270
54-9
Epoch 55 - loss=14.1997
54-10
Epoch 55 - loss=18.0136
54-11
Epoch 55 - loss=20.5849
54-12
Epoch 55 - loss=19.8364
54-13
Epoch 55 - loss=16.9899
54-14
Epoch 55 - loss=9.6484
precision : [0.09271958666040359, 0.08013151714419854, 0.07230311570377329, 0.06728511038046024]
recall : [0.023179896665100896, 0.04006575857209927, 0.054227336777829635, 0.06728511038046024]
MAP : [0.0557022076092062, 0.03688405391904687, 0.02869992653693922, 0.023971366806200014]
ndcg : [0.09535285335704827, 0.08566601512745597, 0.07918368056856412, 0.07467333444104556]
55
55-0
Epoch 56 - loss=30.0554
55-1
Epoch 56 - loss=26.8037
55-2
Epoch 56 - loss=19.7466
55-3
Epoch 56 - loss=18.1810
55-4
Epoch 56 - loss=17.9986
55-5
Epoch 56 - loss=16.7348
55-6
Epoch 56 - loss=14.6244
55-7
Epoch 56 - loss=16.6340
55-8
Epoch 56 - loss=15.2341
55-9
Epoch 56 - loss=14.2794
55-10
Epoch 56 - loss=16.4018
55-11
Epoch 56 - loss=15.7688
55-12
Epoch 56 - loss=16.9845
55-13
Epoch 56 - loss=18.0077
55-14
Epoch 56 - loss=10.6788
precision : [0.08896195396899911, 0.07670267731329199, 0.07051824017535628, 0.06665100986378568]
recall : [0.02224048849224978, 0.03835133865664599, 0.05288868013151682, 0.06665100986378568]
MAP : [0.05571786441208705, 0.036954174029091826, 0.028772068267136377, 0.024029423154445693]
ndcg : [0.0935812615677511, 0.08351707209837694, 0.07781391841911257, 0.07401040754274787]
56
56-0
Epoch 57 - loss=25.1247
56-1
Epoch 57 - loss=25.9667
56-2
Epoch 57 - loss=18.8376
56-3
Epoch 57 - loss=17.5956
56-4
Epoch 57 - loss=18.5957
56-5
Epoch 57 - loss=17.3161
56-6
Epoch 57 - loss=16.7911
56-7
Epoch 57 - loss=15.8307
56-8
Epoch 57 - loss=15.7764
56-9
Epoch 57 - loss=15.6141
56-10
Epoch 57 - loss=16.6479
56-11
Epoch 57 - loss=17.8698
56-12
Epoch 57 - loss=20.0678
56-13
Epoch 57 - loss=16.7508
56-14
Epoch 57 - loss=9.2816
precision : [0.09178017848755238, 0.08013151714419858, 0.07305464224205417, 0.06869422263973693]
recall : [0.022945044621888094, 0.04006575857209929, 0.05479098168154038, 0.06869422263973693]
MAP : [0.057012682010333486, 0.03821413660187733, 0.029809266373380976, 0.025020706769651024]
ndcg : [0.09683758970597303, 0.0869409684408763, 0.08065590333003043, 0.07647542082280076]
57
57-0
Epoch 58 - loss=27.2875
57-1
Epoch 58 - loss=22.7842
57-2
Epoch 58 - loss=16.9737
57-3
Epoch 58 - loss=17.9574
57-4
Epoch 58 - loss=18.1642
57-5
Epoch 58 - loss=18.0020
57-6
Epoch 58 - loss=15.9301
57-7
Epoch 58 - loss=16.9187
57-8
Epoch 58 - loss=15.9450
57-9
Epoch 58 - loss=15.2002
57-10
Epoch 58 - loss=18.9943
57-11
Epoch 58 - loss=18.5894
57-12
Epoch 58 - loss=17.8048
57-13
Epoch 58 - loss=17.2983
57-14
Epoch 58 - loss=9.3485
precision : [0.09008924377642041, 0.07613903240958138, 0.06929700955064974, 0.0653593236261154]
recall : [0.022522310944105103, 0.03806951620479069, 0.05197275716298707, 0.0653593236261154]
MAP : [0.056182871457648345, 0.036848546526799225, 0.028541368691673997, 0.023879311290955482]
ndcg : [0.09521230263247239, 0.08370358926228592, 0.0774149026221865, 0.07343579372649539]
58
58-0
Epoch 59 - loss=27.3674
58-1
Epoch 59 - loss=24.0383
58-2
Epoch 59 - loss=18.2016
58-3
Epoch 59 - loss=17.4901
58-4
Epoch 59 - loss=17.2555
58-5
Epoch 59 - loss=15.8574
58-6
Epoch 59 - loss=17.2204
58-7
Epoch 59 - loss=14.7263
58-8
Epoch 59 - loss=15.4423
58-9
Epoch 59 - loss=15.6387
58-10
Epoch 59 - loss=18.0264
58-11
Epoch 59 - loss=16.6040
58-12
Epoch 59 - loss=19.6820
58-13
Epoch 59 - loss=15.6250
58-14
Epoch 59 - loss=10.7359
precision : [0.093189290746829, 0.07900422733677717, 0.07227180209801158, 0.06794269610145603]
recall : [0.02329732268670725, 0.039502113668388586, 0.05420385157350834, 0.06794269610145603]
MAP : [0.057188038202599024, 0.03805870555518277, 0.029577125377970845, 0.024649848815993185]
ndcg : [0.09895417176447818, 0.08705570269987252, 0.08070866215644484, 0.0764024908860571]
59
59-0
Epoch 60 - loss=21.1292
59-1
Epoch 60 - loss=24.0207
59-2
Epoch 60 - loss=17.1098
59-3
Epoch 60 - loss=16.7266
59-4
Epoch 60 - loss=18.9163
59-5
Epoch 60 - loss=15.5024
59-6
Epoch 60 - loss=17.9535
59-7
Epoch 60 - loss=15.4580
59-8
Epoch 60 - loss=13.6326
59-9
Epoch 60 - loss=15.9429
59-10
Epoch 60 - loss=16.4607
59-11
Epoch 60 - loss=16.3167
59-12
Epoch 60 - loss=15.2043
59-13
Epoch 60 - loss=17.1139
59-14
Epoch 60 - loss=9.6451
precision : [0.09084077031470134, 0.079755753875058, 0.07227180209801154, 0.06766087364960054]
recall : [0.022710192578675334, 0.039877876937529, 0.054203851573508315, 0.06766087364960054]
MAP : [0.057134805072804135, 0.038544793367480075, 0.029840577024701026, 0.024940948674722616]
ndcg : [0.09689802141652729, 0.0871545648665597, 0.08043687997483329, 0.07598904343419688]
60
60-0
Epoch 61 - loss=25.3332
60-1
Epoch 61 - loss=21.8188
60-2
Epoch 61 - loss=17.3657
60-3
Epoch 61 - loss=18.0817
60-4
Epoch 61 - loss=17.6235
60-5
Epoch 61 - loss=17.1245
60-6
Epoch 61 - loss=15.9564
60-7
Epoch 61 - loss=15.2316
60-8
Epoch 61 - loss=15.2122
60-9
Epoch 61 - loss=14.7837
60-10
Epoch 61 - loss=16.0709
60-11
Epoch 61 - loss=17.6873
60-12
Epoch 61 - loss=16.0509
60-13
Epoch 61 - loss=14.7373
60-14
Epoch 61 - loss=7.5232
precision : [0.08961953968999492, 0.08050728041333884, 0.07480820416470954, 0.06996242367308585]
recall : [0.02240488492249873, 0.04025364020666942, 0.05610615312353179, 0.06996242367308585]
MAP : [0.05724596837325818, 0.038274676239683295, 0.030036788794421482, 0.025167285440689028]
ndcg : [0.09561506620771303, 0.08712580539777447, 0.08184240643856648, 0.07742101268687454]
61
61-0
Epoch 62 - loss=23.3919
61-1
Epoch 62 - loss=23.7142
61-2
Epoch 62 - loss=16.0891
61-3
Epoch 62 - loss=16.4288
61-4
Epoch 62 - loss=18.0214
61-5
Epoch 62 - loss=14.2893
61-6
Epoch 62 - loss=15.2894
61-7
Epoch 62 - loss=13.4758
61-8
Epoch 62 - loss=14.5416
61-9
Epoch 62 - loss=15.9500
61-10
Epoch 62 - loss=18.9642
61-11
Epoch 62 - loss=16.4824
61-12
Epoch 62 - loss=17.7881
61-13
Epoch 62 - loss=17.5817
61-14
Epoch 62 - loss=8.7671
precision : [0.08980742132456514, 0.07937999060591754, 0.07321121027086257, 0.06925786754344758]
recall : [0.022451855331141284, 0.03968999530295877, 0.05490840770314663, 0.06925786754344758]
MAP : [0.05501330828244873, 0.03720787015291478, 0.02925802013166973, 0.024572224238172655]
ndcg : [0.09263715026401756, 0.08443087076296854, 0.0791668637233644, 0.07553071052052833]
62
62-0
Epoch 63 - loss=20.4138
62-1
Epoch 63 - loss=22.7129
62-2
Epoch 63 - loss=15.6466
62-3
Epoch 63 - loss=13.9407
62-4
Epoch 63 - loss=16.0936
62-5
Epoch 63 - loss=15.5527
62-6
Epoch 63 - loss=15.2137
62-7
Epoch 63 - loss=13.4911
62-8
Epoch 63 - loss=18.7011
62-9
Epoch 63 - loss=15.5970
62-10
Epoch 63 - loss=17.8360
62-11
Epoch 63 - loss=16.4361
62-12
Epoch 63 - loss=15.3005
62-13
Epoch 63 - loss=15.5451
62-14
Epoch 63 - loss=8.1206
precision : [0.08708313762329703, 0.07778299671207076, 0.07227180209801151, 0.06726162517613894]
recall : [0.021770784405824258, 0.03889149835603538, 0.054203851573508224, 0.06726162517613894]
MAP : [0.054011272898074204, 0.03723730121452057, 0.029163895704525107, 0.02429811994843834]
ndcg : [0.09164338402487084, 0.08355894721689654, 0.07855099815038835, 0.07415270464697182]
63
63-0
Epoch 64 - loss=21.1620
63-1
Epoch 64 - loss=22.7019
63-2
Epoch 64 - loss=16.4030
63-3
Epoch 64 - loss=15.0750
63-4
Epoch 64 - loss=18.1630
63-5
Epoch 64 - loss=17.2921
63-6
Epoch 64 - loss=15.3530
63-7
Epoch 64 - loss=15.5375
63-8
Epoch 64 - loss=15.1202
63-9
Epoch 64 - loss=14.8497
63-10
Epoch 64 - loss=17.1354
63-11
Epoch 64 - loss=17.5599
63-12
Epoch 64 - loss=18.2238
63-13
Epoch 64 - loss=13.7302
63-14
Epoch 64 - loss=8.8960
precision : [0.0883983090652886, 0.07923907937999, 0.07277281979019867, 0.06815406294034757]
recall : [0.02209957726632215, 0.039619539689995, 0.05457961484264884, 0.06815406294034757]
MAP : [0.055827462032253014, 0.03807553661827969, 0.029885600630081603, 0.025017792985765674]
ndcg : [0.09263497539585812, 0.08479607426527747, 0.07920415459910107, 0.0750421328668419]
64
64-0
Epoch 65 - loss=24.6308
64-1
Epoch 65 - loss=21.6066
64-2
Epoch 65 - loss=17.4787
64-3
Epoch 65 - loss=15.7143
64-4
Epoch 65 - loss=16.9177
64-5
Epoch 65 - loss=15.8733
64-6
Epoch 65 - loss=15.3834
64-7
Epoch 65 - loss=15.1083
64-8
Epoch 65 - loss=14.7898
64-9
Epoch 65 - loss=13.8633
64-10
Epoch 65 - loss=15.6944
64-11
Epoch 65 - loss=17.2020
64-12
Epoch 65 - loss=15.4023
64-13
Epoch 65 - loss=12.6907
64-14
Epoch 65 - loss=8.4789
precision : [0.08990136214185034, 0.08027242837012621, 0.07314858305933916, 0.0674260216063879]
recall : [0.022475340535462584, 0.04013621418506311, 0.05486143729450412, 0.0674260216063879]
MAP : [0.05493345858775639, 0.03762176892050072, 0.029261391323392262, 0.02434174448428713]
ndcg : [0.09180436545729091, 0.08442074135644649, 0.07864951617298702, 0.07390578323663555]
65
65-0
Epoch 66 - loss=21.0502
65-1
Epoch 66 - loss=19.4201
65-2
Epoch 66 - loss=14.9924
65-3
Epoch 66 - loss=16.2090
65-4
Epoch 66 - loss=16.5838
65-5
Epoch 66 - loss=14.2217
65-6
Epoch 66 - loss=14.1212
65-7
Epoch 66 - loss=13.6959
65-8
Epoch 66 - loss=14.0387
65-9
Epoch 66 - loss=15.4786
65-10
Epoch 66 - loss=17.3229
65-11
Epoch 66 - loss=15.6976
65-12
Epoch 66 - loss=18.8301
65-13
Epoch 66 - loss=16.4200
65-14
Epoch 66 - loss=8.2163
precision : [0.0889619539689992, 0.08069516204790923, 0.0738687959918583, 0.06820103334899012]
recall : [0.0222404884922498, 0.040347581023954616, 0.055401596993893486, 0.06820103334899012]
MAP : [0.054230468138406145, 0.037861224809322504, 0.029555183348043846, 0.024547828532308847]
ndcg : [0.09084893920399331, 0.08453473031203212, 0.07909279558328598, 0.07443968354020879]
66
66-0
Epoch 67 - loss=19.6752
66-1
Epoch 67 - loss=20.2449
66-2
Epoch 67 - loss=16.0197
66-3
Epoch 67 - loss=16.1341
66-4
Epoch 67 - loss=14.9897
66-5
Epoch 67 - loss=14.4243
66-6
Epoch 67 - loss=14.0440
66-7
Epoch 67 - loss=12.1076
66-8
Epoch 67 - loss=12.8280
66-9
Epoch 67 - loss=15.1118
66-10
Epoch 67 - loss=15.5905
66-11
Epoch 67 - loss=16.7053
66-12
Epoch 67 - loss=17.4431
66-13
Epoch 67 - loss=15.0519
66-14
Epoch 67 - loss=8.3345
precision : [0.08717707844058221, 0.07778299671207091, 0.07080006262721147, 0.06580554250821964]
recall : [0.021794269610145554, 0.038891498356035455, 0.05310004697040832, 0.06580554250821964]
MAP : [0.05557851886644747, 0.038119729808316, 0.02976460155887117, 0.02465593802123601]
ndcg : [0.09171237909380321, 0.08361448419631909, 0.0776076034037048, 0.07314091815442726]
67
67-0
Epoch 68 - loss=20.8586
67-1
Epoch 68 - loss=19.4212
67-2
Epoch 68 - loss=18.4601
67-3
Epoch 68 - loss=17.2452
67-4
Epoch 68 - loss=16.7029
67-5
Epoch 68 - loss=14.4567
67-6
Epoch 68 - loss=16.8012
67-7
Epoch 68 - loss=12.8832
67-8
Epoch 68 - loss=13.3701
67-9
Epoch 68 - loss=12.8580
67-10
Epoch 68 - loss=17.0455
67-11
Epoch 68 - loss=15.4698
67-12
Epoch 68 - loss=14.0472
67-13
Epoch 68 - loss=15.2757
67-14
Epoch 68 - loss=9.2895
precision : [0.08219821512447151, 0.07458900892437716, 0.06885861906998592, 0.06420854861437277]
recall : [0.020549553781117877, 0.03729450446218858, 0.051643964302489166, 0.06420854861437277]
MAP : [0.050923751369970245, 0.03517805885466759, 0.02768200633630413, 0.02319282719220752]
ndcg : [0.08525719846224021, 0.07888020942360693, 0.07405647566379443, 0.07007039431490694]
68
68-0
Epoch 69 - loss=21.4331
68-1
Epoch 69 - loss=19.3001
68-2
Epoch 69 - loss=17.4565
68-3
Epoch 69 - loss=14.6358
68-4
Epoch 69 - loss=17.1886
68-5
Epoch 69 - loss=11.9981
68-6
Epoch 69 - loss=16.0466
68-7
Epoch 69 - loss=14.7417
68-8
Epoch 69 - loss=13.6856
68-9
Epoch 69 - loss=12.7720
68-10
Epoch 69 - loss=16.5777
68-11
Epoch 69 - loss=14.7762
68-12
Epoch 69 - loss=14.8773
68-13
Epoch 69 - loss=15.7521
68-14
Epoch 69 - loss=7.5329
precision : [0.08764678252700778, 0.07674964772193468, 0.06907781431031793, 0.06493658994833242]
recall : [0.021911695631751944, 0.03837482386096734, 0.05180836073273806, 0.06493658994833242]
MAP : [0.053497729763582275, 0.036507619644068685, 0.02831880929814232, 0.023734798323247385]
ndcg : [0.09028910226345761, 0.08164561510350311, 0.07540268447899641, 0.07158093194100992]
69
69-0
Epoch 70 - loss=19.8960
69-1
Epoch 70 - loss=18.6554
69-2
Epoch 70 - loss=15.2037
69-3
Epoch 70 - loss=14.0811
69-4
Epoch 70 - loss=16.9819
69-5
Epoch 70 - loss=15.2726
69-6
Epoch 70 - loss=14.8197
69-7
Epoch 70 - loss=13.3753
69-8
Epoch 70 - loss=12.8880
69-9
Epoch 70 - loss=12.0176
69-10
Epoch 70 - loss=15.6111
69-11
Epoch 70 - loss=14.5910
69-12
Epoch 70 - loss=13.2971
69-13
Epoch 70 - loss=15.1726
69-14
Epoch 70 - loss=8.8983
precision : [0.08914983560356948, 0.07895725692813484, 0.07033035854078605, 0.06561766087364941]
recall : [0.02228745890089237, 0.03947862846406742, 0.052747768905589174, 0.06561766087364941]
MAP : [0.0567793956474088, 0.03877489245267545, 0.02996383537482645, 0.024857431947396095]
ndcg : [0.09527568506173299, 0.08602518779704087, 0.07862037850201854, 0.07407412061552653]
70
70-0
Epoch 71 - loss=18.7311
70-1
Epoch 71 - loss=17.3917
70-2
Epoch 71 - loss=15.3820
70-3
Epoch 71 - loss=13.2404
70-4
Epoch 71 - loss=15.4669
70-5
Epoch 71 - loss=14.0690
70-6
Epoch 71 - loss=15.4359
70-7
Epoch 71 - loss=14.2560
70-8
Epoch 71 - loss=13.7903
70-9
Epoch 71 - loss=13.3273
70-10
Epoch 71 - loss=15.5957
70-11
Epoch 71 - loss=15.1511
70-12
Epoch 71 - loss=14.1684
70-13
Epoch 71 - loss=13.6964
70-14
Epoch 71 - loss=8.1316
precision : [0.08558008454673531, 0.07825270079849646, 0.07045561296383276, 0.0661108501643963]
recall : [0.021395021136683828, 0.03912635039924823, 0.052841709722874275, 0.0661108501643963]
MAP : [0.05500704556129639, 0.038145619450222545, 0.02980447374763955, 0.024994112230705304]
ndcg : [0.09233665979804445, 0.08483395900749185, 0.07807919605704837, 0.07390719982727142]
71
71-0
Epoch 72 - loss=19.9122
71-1
Epoch 72 - loss=20.7804
71-2
Epoch 72 - loss=15.7627
71-3
Epoch 72 - loss=15.6314
71-4
Epoch 72 - loss=15.3730
71-5
Epoch 72 - loss=13.7056
71-6
Epoch 72 - loss=12.7888
71-7
Epoch 72 - loss=13.8864
71-8
Epoch 72 - loss=12.9029
71-9
Epoch 72 - loss=12.4780
71-10
Epoch 72 - loss=15.2589
71-11
Epoch 72 - loss=15.6850
71-12
Epoch 72 - loss=13.7192
71-13
Epoch 72 - loss=11.3300
71-14
Epoch 72 - loss=8.3100
precision : [0.08586190699859066, 0.0763738844527943, 0.07073743541568807, 0.06554720526068558]
recall : [0.021465476749647664, 0.03818694222639715, 0.05305307656176577, 0.06554720526068558]
MAP : [0.0564944418349773, 0.037870003802366416, 0.02974762151370888, 0.024803393166622573]
ndcg : [0.09283321660895268, 0.0837164797616448, 0.07826102140415266, 0.07353872925136351]
72
72-0
Epoch 73 - loss=19.4306
72-1
Epoch 73 - loss=18.3905
72-2
Epoch 73 - loss=15.4421
72-3
Epoch 73 - loss=14.8394
72-4
Epoch 73 - loss=16.8969
72-5
Epoch 73 - loss=14.0908
72-6
Epoch 73 - loss=13.2302
72-7
Epoch 73 - loss=13.4620
72-8
Epoch 73 - loss=12.0135
72-9
Epoch 73 - loss=15.3013
72-10
Epoch 73 - loss=16.2968
72-11
Epoch 73 - loss=14.8751
72-12
Epoch 73 - loss=14.0443
72-13
Epoch 73 - loss=12.6245
72-14
Epoch 73 - loss=7.6902
precision : [0.08586190699859074, 0.0751996242367304, 0.06995459527164556, 0.06491310474401113]
recall : [0.021465476749647685, 0.0375998121183652, 0.052465946453733876, 0.06491310474401113]
MAP : [0.05641615782057305, 0.03764887010072543, 0.029682274999325253, 0.024721843104331467]
ndcg : [0.09225033870370959, 0.08263748184086302, 0.07744096103056415, 0.07282122613672519]
73
73-0
Epoch 74 - loss=18.7764
73-1
Epoch 74 - loss=17.8157
73-2
Epoch 74 - loss=14.8690
73-3
Epoch 74 - loss=13.6687
73-4
Epoch 74 - loss=13.3577
73-5
Epoch 74 - loss=14.5298
73-6
Epoch 74 - loss=13.1420
73-7
Epoch 74 - loss=13.4440
73-8
Epoch 74 - loss=11.9504
73-9
Epoch 74 - loss=13.0064
73-10
Epoch 74 - loss=15.5636
73-11
Epoch 74 - loss=14.8455
73-12
Epoch 74 - loss=15.0265
73-13
Epoch 74 - loss=13.2895
73-14
Epoch 74 - loss=7.9651
precision : [0.08576796618130564, 0.07595115077501127, 0.06845154219508384, 0.06352747768905566]
recall : [0.02144199154532641, 0.037975575387505636, 0.05133865664631253, 0.06352747768905566]
MAP : [0.05521214967903554, 0.037511537572599105, 0.029024907733221497, 0.023999887102449824]
ndcg : [0.09044379407917445, 0.08205039477910073, 0.07560961588680033, 0.07111590669735489]
74
74-0
Epoch 75 - loss=19.1593
74-1
Epoch 75 - loss=17.7009
74-2
Epoch 75 - loss=15.0107
74-3
Epoch 75 - loss=13.6764
74-4
Epoch 75 - loss=14.6044
74-5
Epoch 75 - loss=15.6614
74-6
Epoch 75 - loss=16.0736
74-7
Epoch 75 - loss=15.9295
74-8
Epoch 75 - loss=12.7937
74-9
Epoch 75 - loss=12.6261
74-10
Epoch 75 - loss=13.7675
74-11
Epoch 75 - loss=14.9402
74-12
Epoch 75 - loss=13.4708
74-13
Epoch 75 - loss=14.1141
74-14
Epoch 75 - loss=8.5240
precision : [0.08379520901831829, 0.07313292625645804, 0.06704242993580731, 0.062963832785345]
recall : [0.02094880225457957, 0.03656646312822902, 0.050281822451854995, 0.062963832785345]
MAP : [0.055024268044465315, 0.0363935300126, 0.028347238760578358, 0.023649012801125125]
ndcg : [0.0899478504232916, 0.08047569437979647, 0.07474816154707088, 0.07073739493338022]
75
75-0
Epoch 76 - loss=16.9472
75-1
Epoch 76 - loss=17.3557
75-2
Epoch 76 - loss=15.0754
75-3
Epoch 76 - loss=13.3828
75-4
Epoch 76 - loss=14.3582
75-5
Epoch 76 - loss=12.1760
75-6
Epoch 76 - loss=13.1950
75-7
Epoch 76 - loss=11.3661
75-8
Epoch 76 - loss=12.1812
75-9
Epoch 76 - loss=12.6500
75-10
Epoch 76 - loss=14.5739
75-11
Epoch 76 - loss=13.3707
75-12
Epoch 76 - loss=16.2489
75-13
Epoch 76 - loss=15.7981
75-14
Epoch 76 - loss=9.1335
precision : [0.087834664161578, 0.07548144668858575, 0.06954751839674346, 0.06561766087364952]
recall : [0.0219586660403945, 0.037740723344292876, 0.0521606387975572, 0.06561766087364952]
MAP : [0.056755910443087525, 0.037599551171650744, 0.029159792419538783, 0.02451326967734982]
ndcg : [0.09349276560525695, 0.08288331983803585, 0.07723783657826262, 0.073330282951494]
76
76-0
Epoch 77 - loss=16.6068
76-1
Epoch 77 - loss=16.0766
76-2
Epoch 77 - loss=12.6496
76-3
Epoch 77 - loss=16.5962
76-4
Epoch 77 - loss=15.3888
76-5
Epoch 77 - loss=12.1552
76-6
Epoch 77 - loss=14.4086
76-7
Epoch 77 - loss=13.0306
76-8
Epoch 77 - loss=11.8998
76-9
Epoch 77 - loss=13.6837
76-10
Epoch 77 - loss=13.1649
76-11
Epoch 77 - loss=12.8612
76-12
Epoch 77 - loss=14.1952
76-13
Epoch 77 - loss=12.1261
76-14
Epoch 77 - loss=7.2100
precision : [0.08717707844058223, 0.07623297322686656, 0.06976671363707544, 0.06498356035697496]
recall : [0.021794269610145557, 0.03811648661343328, 0.05232503522780614, 0.06498356035697496]
MAP : [0.05600594958509472, 0.03759675531399346, 0.0292457896121588, 0.024376788512667506]
ndcg : [0.09344614550141946, 0.08357764887370464, 0.0775379140423561, 0.07304870338831237]
77
77-0
Epoch 78 - loss=16.0239
77-1
Epoch 78 - loss=13.6255
77-2
Epoch 78 - loss=13.8926
77-3
Epoch 78 - loss=12.9607
77-4
Epoch 78 - loss=14.4460
77-5
Epoch 78 - loss=14.1541
77-6
Epoch 78 - loss=15.2146
77-7
Epoch 78 - loss=12.8751
77-8
Epoch 78 - loss=11.5893
77-9
Epoch 78 - loss=12.0401
77-10
Epoch 78 - loss=14.3575
77-11
Epoch 78 - loss=13.8928
77-12
Epoch 78 - loss=12.2017
77-13
Epoch 78 - loss=13.4933
77-14
Epoch 78 - loss=8.3269
precision : [0.0837952090183185, 0.07552841709722825, 0.06892124628150942, 0.06456082667919198]
recall : [0.020948802254579624, 0.03776420854861413, 0.051690934711131675, 0.06456082667919198]
MAP : [0.05479567872240489, 0.036797494165977024, 0.028740999706241607, 0.023975992587771618]
ndcg : [0.09077805690138391, 0.08252700897056464, 0.07651064588551908, 0.07233382802205977]
78
78-0
Epoch 79 - loss=17.3986
78-1
Epoch 79 - loss=14.5583
78-2
Epoch 79 - loss=13.7972
78-3
Epoch 79 - loss=14.1665
78-4
Epoch 79 - loss=14.2666
78-5
Epoch 79 - loss=12.2621
78-6
Epoch 79 - loss=11.5513
78-7
Epoch 79 - loss=14.3166
78-8
Epoch 79 - loss=13.7523
78-9
Epoch 79 - loss=12.0917
78-10
Epoch 79 - loss=13.1372
78-11
Epoch 79 - loss=14.2305
78-12
Epoch 79 - loss=12.2941
78-13
Epoch 79 - loss=13.9568
78-14
Epoch 79 - loss=7.8685
precision : [0.08285580084546726, 0.07482386096759007, 0.06857679661813067, 0.06460779708783457]
recall : [0.020713950211366815, 0.037411930483795035, 0.051432597463597664, 0.06460779708783457]
MAP : [0.05189134178800688, 0.03577624191997137, 0.02814890135698027, 0.023688245196163457]
ndcg : [0.08793330433569428, 0.08050956642056231, 0.07502243234195939, 0.07128736587384607]
79
79-0
Epoch 80 - loss=15.9523
79-1
Epoch 80 - loss=15.3309
79-2
Epoch 80 - loss=12.6650
79-3
Epoch 80 - loss=14.4937
79-4
Epoch 80 - loss=15.3643
79-5
Epoch 80 - loss=14.9440
79-6
Epoch 80 - loss=14.8930
79-7
Epoch 80 - loss=13.0816
79-8
Epoch 80 - loss=11.6150
79-9
Epoch 80 - loss=9.8027
79-10
Epoch 80 - loss=13.3439
79-11
Epoch 80 - loss=13.6506
79-12
Epoch 80 - loss=12.8593
79-13
Epoch 80 - loss=13.5804
79-14
Epoch 80 - loss=8.0332
precision : [0.08680131517144184, 0.07566932832315597, 0.07058086738687969, 0.06460779708783447]
recall : [0.02170032879286046, 0.037834664161577984, 0.05293565054015938, 0.06460779708783447]
MAP : [0.05533114138093002, 0.037182931102611706, 0.02942897802925985, 0.02435904266123598]
ndcg : [0.09206346605698623, 0.08255014410499516, 0.07758981024392234, 0.0724225896921399]
80
80-0
Epoch 81 - loss=13.9302
80-1
Epoch 81 - loss=13.6800
80-2
Epoch 81 - loss=14.4780
80-3
Epoch 81 - loss=11.0587
80-4
Epoch 81 - loss=13.2671
80-5
Epoch 81 - loss=13.3485
80-6
Epoch 81 - loss=15.2323
80-7
Epoch 81 - loss=13.4952
80-8
Epoch 81 - loss=12.4714
80-9
Epoch 81 - loss=12.7795
80-10
Epoch 81 - loss=13.5979
80-11
Epoch 81 - loss=15.6055
80-12
Epoch 81 - loss=12.1069
80-13
Epoch 81 - loss=13.4788
80-14
Epoch 81 - loss=8.4199
precision : [0.08069516204790975, 0.07332080789102817, 0.0666353530609051, 0.06275246594645359]
recall : [0.020173790511977437, 0.036660403945514085, 0.04997651479567839, 0.06275246594645359]
MAP : [0.05231094410521371, 0.035565918867938605, 0.027832993511715916, 0.023341622876454055]
ndcg : [0.08612436406347754, 0.07902361926294657, 0.07326199255711281, 0.06955233997460918]
81
81-0
Epoch 82 - loss=15.6319
81-1
Epoch 82 - loss=17.2896
81-2
Epoch 82 - loss=12.8586
81-3
Epoch 82 - loss=12.9820
81-4
Epoch 82 - loss=13.4380
81-5
Epoch 82 - loss=11.8575
81-6
Epoch 82 - loss=11.6808
81-7
Epoch 82 - loss=12.4680
81-8
Epoch 82 - loss=10.9308
81-9
Epoch 82 - loss=12.3435
81-10
Epoch 82 - loss=13.5120
81-11
Epoch 82 - loss=13.4460
81-12
Epoch 82 - loss=12.1208
81-13
Epoch 82 - loss=12.5411
81-14
Epoch 82 - loss=6.2252
precision : [0.08013151714419908, 0.0709253170502579, 0.06525755440739017, 0.062024424612493856]
recall : [0.02003287928604977, 0.03546265852512895, 0.04894316580554221, 0.062024424612493856]
MAP : [0.05110693596367622, 0.03453022135737025, 0.027128045310290498, 0.022939776767298848]
ndcg : [0.08473354382420219, 0.07672286457018676, 0.07162203306142596, 0.06840035769537173]
82
82-0
Epoch 83 - loss=15.7079
82-1
Epoch 83 - loss=15.8079
82-2
Epoch 83 - loss=14.1122
82-3
Epoch 83 - loss=13.2910
82-4
Epoch 83 - loss=13.1853
82-5
Epoch 83 - loss=12.4166
82-6
Epoch 83 - loss=13.1691
82-7
Epoch 83 - loss=11.8037
82-8
Epoch 83 - loss=11.3632
82-9
Epoch 83 - loss=12.1904
82-10
Epoch 83 - loss=13.1793
82-11
Epoch 83 - loss=13.1452
82-12
Epoch 83 - loss=13.3860
82-13
Epoch 83 - loss=13.0406
82-14
Epoch 83 - loss=7.3769
precision : [0.08435885392202894, 0.071441991545326, 0.06726162517613914, 0.06303428839830884]
recall : [0.021089713480507234, 0.035720995772663, 0.05044621888210392, 0.06303428839830884]
MAP : [0.05284327540316267, 0.03526586742415771, 0.02798989626138522, 0.023454946147796578]
ndcg : [0.08846819641357571, 0.07796207189124855, 0.07369986248522908, 0.06978909212641217]
83
83-0
Epoch 84 - loss=14.8794
83-1
Epoch 84 - loss=13.8170
83-2
Epoch 84 - loss=12.1922
83-3
Epoch 84 - loss=13.3615
83-4
Epoch 84 - loss=14.0955
83-5
Epoch 84 - loss=13.9567
83-6
Epoch 84 - loss=11.4339
83-7
Epoch 84 - loss=13.3613
83-8
Epoch 84 - loss=9.2968
83-9
Epoch 84 - loss=10.6813
83-10
Epoch 84 - loss=12.0799
83-11
Epoch 84 - loss=13.4977
83-12
Epoch 84 - loss=12.4475
83-13
Epoch 84 - loss=11.5285
83-14
Epoch 84 - loss=6.9204
precision : [0.08285580084546719, 0.07289807421324523, 0.06710505714733059, 0.06305777360263007]
recall : [0.020713950211366797, 0.03644903710662262, 0.05032879286049751, 0.06305777360263007]
MAP : [0.05285423516517927, 0.036038157865306765, 0.028255705987035248, 0.023631629757758937]
ndcg : [0.08805516620016858, 0.0792797995570717, 0.07393313236564293, 0.07008123445437499]
84
84-0
Epoch 85 - loss=15.7088
84-1
Epoch 85 - loss=15.2520
84-2
Epoch 85 - loss=12.8376
84-3
Epoch 85 - loss=13.1460
84-4
Epoch 85 - loss=13.4314
84-5
Epoch 85 - loss=13.1725
84-6
Epoch 85 - loss=12.5990
84-7
Epoch 85 - loss=11.2419
84-8
Epoch 85 - loss=10.0617
84-9
Epoch 85 - loss=11.9307
84-10
Epoch 85 - loss=14.2530
84-11
Epoch 85 - loss=13.0821
84-12
Epoch 85 - loss=12.2263
84-13
Epoch 85 - loss=11.5992
84-14
Epoch 85 - loss=7.6226
precision : [0.08492249882573953, 0.07219351808360694, 0.06547674964772213, 0.062118365429778895]
recall : [0.021230624706434883, 0.03609675904180347, 0.04910756223579112, 0.062118365429778895]
MAP : [0.05471113198684829, 0.03653643561698987, 0.028421907146660548, 0.023767325116388325]
ndcg : [0.09033877013159078, 0.07960641103397892, 0.07342701150659135, 0.06985268523884461]
85
85-0
Epoch 86 - loss=14.5019
85-1
Epoch 86 - loss=13.5035
85-2
Epoch 86 - loss=12.7974
85-3
Epoch 86 - loss=13.0088
85-4
Epoch 86 - loss=13.3779
85-5
Epoch 86 - loss=12.9184
85-6
Epoch 86 - loss=13.0552
85-7
Epoch 86 - loss=10.0638
85-8
Epoch 86 - loss=11.2318
85-9
Epoch 86 - loss=11.8425
85-10
Epoch 86 - loss=11.8200
85-11
Epoch 86 - loss=12.9670
85-12
Epoch 86 - loss=11.3399
85-13
Epoch 86 - loss=12.9865
85-14
Epoch 86 - loss=6.5743
precision : [0.0817285110380459, 0.07064349459840262, 0.0645686550806327, 0.061296383278534226]
recall : [0.020432127759511476, 0.03532174729920131, 0.048426491310474135, 0.061296383278534226]
MAP : [0.05324878659777673, 0.03566276737718729, 0.027829031084080403, 0.02326901241603052]
ndcg : [0.08694007361707373, 0.0773582738343938, 0.07176730489890831, 0.06839264892322258]
86
86-0
Epoch 87 - loss=13.6267
86-1
Epoch 87 - loss=13.8946
86-2
Epoch 87 - loss=13.6243
86-3
Epoch 87 - loss=11.6309
86-4
Epoch 87 - loss=16.0986
86-5
Epoch 87 - loss=12.1186
86-6
Epoch 87 - loss=13.4200
86-7
Epoch 87 - loss=11.0746
86-8
Epoch 87 - loss=11.7385
86-9
Epoch 87 - loss=10.6809
86-10
Epoch 87 - loss=12.5271
86-11
Epoch 87 - loss=13.8483
86-12
Epoch 87 - loss=12.1824
86-13
Epoch 87 - loss=12.4861
86-14
Epoch 87 - loss=6.3429
precision : [0.08154062940347569, 0.06946923438233875, 0.06597776733990926, 0.06204790981681506]
recall : [0.02038515735086892, 0.034734617191169374, 0.04948332550493154, 0.06204790981681506]
MAP : [0.05267574761233756, 0.035197853526881234, 0.02793968196269746, 0.02339121418096507]
ndcg : [0.08651249949736751, 0.0763610799635504, 0.07245753946133573, 0.06873710285632106]
87
87-0
Epoch 88 - loss=12.4682
87-1
Epoch 88 - loss=12.7904
87-2
Epoch 88 - loss=11.9860
87-3
Epoch 88 - loss=11.1614
87-4
Epoch 88 - loss=11.4253
87-5
Epoch 88 - loss=12.0259
87-6
Epoch 88 - loss=12.3874
87-7
Epoch 88 - loss=11.6462
87-8
Epoch 88 - loss=11.7646
87-9
Epoch 88 - loss=9.6963
87-10
Epoch 88 - loss=11.6380
87-11
Epoch 88 - loss=13.6177
87-12
Epoch 88 - loss=11.8448
87-13
Epoch 88 - loss=12.9091
87-14
Epoch 88 - loss=7.3026
precision : [0.07571629873179897, 0.0671676843588536, 0.06272115234069221, 0.05861906998590848]
recall : [0.018929074682949742, 0.0335838421794268, 0.047040864255518657, 0.05861906998590848]
MAP : [0.049484891185219974, 0.0336822004518106, 0.02641291358294646, 0.022016836524832398]
ndcg : [0.08098644031010171, 0.07326180720259119, 0.06890005756530358, 0.06511175728012786]
88
88-0
Epoch 89 - loss=13.8287
88-1
Epoch 89 - loss=11.9257
88-2
Epoch 89 - loss=11.9894
88-3
Epoch 89 - loss=12.6588
88-4
Epoch 89 - loss=13.1382
88-5
Epoch 89 - loss=10.4770
88-6
Epoch 89 - loss=11.3676
88-7
Epoch 89 - loss=10.9134
88-8
Epoch 89 - loss=11.7854
88-9
Epoch 89 - loss=11.8594
88-10
Epoch 89 - loss=11.8373
88-11
Epoch 89 - loss=13.2552
88-12
Epoch 89 - loss=12.1015
88-13
Epoch 89 - loss=13.2365
88-14
Epoch 89 - loss=6.8809
precision : [0.07881634570220752, 0.06777829967120672, 0.06203225301393469, 0.05934711131986805]
recall : [0.01970408642555188, 0.03388914983560336, 0.0465241897604506, 0.05934711131986805]
MAP : [0.05036323782683576, 0.033871069956086394, 0.026353870891212366, 0.022283742854946834]
ndcg : [0.08356819533051942, 0.07424622518979605, 0.06893319916881707, 0.06599298602300577]
89
89-0
Epoch 90 - loss=13.0729
89-1
Epoch 90 - loss=10.4357
89-2
Epoch 90 - loss=13.1759
89-3
Epoch 90 - loss=11.5793
89-4
Epoch 90 - loss=12.0705
89-5
Epoch 90 - loss=10.8255
89-6
Epoch 90 - loss=11.9509
89-7
Epoch 90 - loss=10.2062
89-8
Epoch 90 - loss=10.6497
89-9
Epoch 90 - loss=11.1202
89-10
Epoch 90 - loss=11.2615
89-11
Epoch 90 - loss=10.6485
89-12
Epoch 90 - loss=11.0414
89-13
Epoch 90 - loss=10.9748
89-14
Epoch 90 - loss=6.1399
precision : [0.08276186002818214, 0.06961014560826631, 0.06450602786910926, 0.06103804603100013]
recall : [0.020690465007045536, 0.034805072804133155, 0.048379520901831535, 0.06103804603100013]
MAP : [0.05254892750900266, 0.03474697488201481, 0.027263504983091644, 0.02295789947478646]
ndcg : [0.08734995091477532, 0.07651370724332678, 0.07153085130688398, 0.06802976889848854]
90
90-0
Epoch 91 - loss=13.7319
90-1
Epoch 91 - loss=11.3835
90-2
Epoch 91 - loss=12.5543
90-3
Epoch 91 - loss=11.4740
90-4
Epoch 91 - loss=13.5910
90-5
Epoch 91 - loss=10.4322
90-6
Epoch 91 - loss=13.7268
90-7
Epoch 91 - loss=12.6624
90-8
Epoch 91 - loss=10.8343
90-9
Epoch 91 - loss=11.5790
90-10
Epoch 91 - loss=12.9811
90-11
Epoch 91 - loss=12.1628
90-12
Epoch 91 - loss=11.6482
90-13
Epoch 91 - loss=10.4569
90-14
Epoch 91 - loss=6.6814
precision : [0.07787693752935648, 0.06848285580084504, 0.06328479724440286, 0.059957726632221306]
recall : [0.01946923438233912, 0.03424142790042252, 0.047463597933301765, 0.059957726632221306]
MAP : [0.04963676217316425, 0.033383956995981415, 0.026517178522814967, 0.0222974062739876]
ndcg : [0.0823431354611199, 0.07425585407466163, 0.06945909929394747, 0.06620622793383098]
91
91-0
Epoch 92 - loss=13.3062
91-1
Epoch 92 - loss=12.3378
91-2
Epoch 92 - loss=12.1990
91-3
Epoch 92 - loss=12.1521
91-4
Epoch 92 - loss=14.1049
91-5
Epoch 92 - loss=11.0214
91-6
Epoch 92 - loss=10.3553
91-7
Epoch 92 - loss=10.6065
91-8
Epoch 92 - loss=11.0561
91-9
Epoch 92 - loss=11.6306
91-10
Epoch 92 - loss=11.7456
91-11
Epoch 92 - loss=12.9244
91-12
Epoch 92 - loss=12.2493
91-13
Epoch 92 - loss=11.3187
91-14
Epoch 92 - loss=6.5613
precision : [0.07534053546265851, 0.0646782527007981, 0.06031000469704096, 0.05671676843588507]
recall : [0.018835133865664627, 0.03233912635039905, 0.045232503522780375, 0.05671676843588507]
MAP : [0.04702520745263817, 0.0315066690524652, 0.02494419972109028, 0.02081591153370263]
ndcg : [0.07883409734937642, 0.07017612591607404, 0.06603567400642461, 0.06267938084677085]
92
92-0
Epoch 93 - loss=11.1470
92-1
Epoch 93 - loss=11.1353
92-2
Epoch 93 - loss=11.9834
92-3
Epoch 93 - loss=12.7260
92-4
Epoch 93 - loss=11.0448
92-5
Epoch 93 - loss=11.7007
92-6
Epoch 93 - loss=11.0834
92-7
Epoch 93 - loss=13.3217
92-8
Epoch 93 - loss=9.8921
92-9
Epoch 93 - loss=9.5510
92-10
Epoch 93 - loss=12.3383
92-11
Epoch 93 - loss=12.5139
92-12
Epoch 93 - loss=12.4059
92-13
Epoch 93 - loss=10.9852
92-14
Epoch 93 - loss=6.4105
precision : [0.0745890089243776, 0.06524189760450883, 0.05962110537028353, 0.0569046500704553]
recall : [0.0186472522310944, 0.03262094880225441, 0.04471582902771232, 0.0569046500704553]
MAP : [0.0475606701111633, 0.03221950092076912, 0.02500296095880877, 0.020962242167633913]
ndcg : [0.0793617368118619, 0.07123054046308255, 0.06608593306953642, 0.06319218228689173]
93
93-0
Epoch 94 - loss=12.7001
93-1
Epoch 94 - loss=9.4794
93-2
Epoch 94 - loss=10.7737
93-3
Epoch 94 - loss=10.1610
93-4
Epoch 94 - loss=12.9403
93-5
Epoch 94 - loss=10.9069
93-6
Epoch 94 - loss=10.0660
93-7
Epoch 94 - loss=10.2308
93-8
Epoch 94 - loss=10.8194
93-9
Epoch 94 - loss=10.9738
93-10
Epoch 94 - loss=12.0051
93-11
Epoch 94 - loss=11.4148
93-12
Epoch 94 - loss=12.3146
93-13
Epoch 94 - loss=10.2269
93-14
Epoch 94 - loss=6.9595
precision : [0.0773132926256459, 0.06824800375763229, 0.06272115234069219, 0.058501643964302213]
recall : [0.019328323156411475, 0.034124001878816146, 0.04704086425551873, 0.058501643964302213]
MAP : [0.04806168780335055, 0.03300845467355566, 0.02605024066273479, 0.02167651529806832]
ndcg : [0.08099002102875728, 0.07350467047375644, 0.06861636379866679, 0.06479025612995287]
94
94-0
Epoch 95 - loss=13.4976
94-1
Epoch 95 - loss=10.3086
94-2
Epoch 95 - loss=10.1101
94-3
Epoch 95 - loss=10.2346
94-4
Epoch 95 - loss=11.7254
94-5
Epoch 95 - loss=11.4914
94-6
Epoch 95 - loss=12.3768
94-7
Epoch 95 - loss=10.6660
94-8
Epoch 95 - loss=10.2309
94-9
Epoch 95 - loss=12.8443
94-10
Epoch 95 - loss=11.3111
94-11
Epoch 95 - loss=12.1681
94-12
Epoch 95 - loss=10.3742
94-13
Epoch 95 - loss=12.2462
94-14
Epoch 95 - loss=6.1285
precision : [0.07224048849224994, 0.06430248943165769, 0.05905746046657292, 0.05544856740253609]
recall : [0.018060122123062485, 0.03215124471582884, 0.04429309534992931, 0.05544856740253609]
MAP : [0.044535775794582746, 0.030733316185406367, 0.024269945300945766, 0.020352191836559452]
ndcg : [0.07571554655100975, 0.06902341542221914, 0.06443754234867542, 0.06112259623141727]
95
95-0
Epoch 96 - loss=11.6616
95-1
Epoch 96 - loss=11.9674
95-2
Epoch 96 - loss=12.4413
95-3
Epoch 96 - loss=13.1118
95-4
Epoch 96 - loss=12.3893
95-5
Epoch 96 - loss=12.9405
95-6
Epoch 96 - loss=9.8941
95-7
Epoch 96 - loss=10.5191
95-8
Epoch 96 - loss=9.4678
95-9
Epoch 96 - loss=9.3447
95-10
Epoch 96 - loss=10.1955
95-11
Epoch 96 - loss=10.6692
95-12
Epoch 96 - loss=11.5561
95-13
Epoch 96 - loss=9.4647
95-14
Epoch 96 - loss=6.3632
precision : [0.06895255988727109, 0.061766087364959796, 0.05811805229372178, 0.054837952090182863]
recall : [0.01723813997181777, 0.030883043682479898, 0.04358853922029101, 0.054837952090182863]
MAP : [0.04255205886957883, 0.029177104535253903, 0.023385825680330142, 0.019693461365228006]
ndcg : [0.07299885590170511, 0.06654005579557085, 0.06301244443979193, 0.05999572298589766]
96
96-0
Epoch 97 - loss=11.6490
96-1
Epoch 97 - loss=10.2392
96-2
Epoch 97 - loss=10.2988
96-3
Epoch 97 - loss=10.8713
96-4
Epoch 97 - loss=11.2248
96-5
Epoch 97 - loss=12.1276
96-6
Epoch 97 - loss=11.3698
96-7
Epoch 97 - loss=10.4277
96-8
Epoch 97 - loss=10.5815
96-9
Epoch 97 - loss=8.6404
96-10
Epoch 97 - loss=10.2536
96-11
Epoch 97 - loss=10.2734
96-12
Epoch 97 - loss=12.1241
96-13
Epoch 97 - loss=9.3419
96-14
Epoch 97 - loss=6.2443
precision : [0.06782527007984987, 0.06068576796618103, 0.05783622984186654, 0.05457961484264882]
recall : [0.016956317519962467, 0.030342883983090516, 0.04337717238139949, 0.05457961484264882]
MAP : [0.040377328949428526, 0.027934327167535244, 0.022701315611132426, 0.019212979306349354]
ndcg : [0.07037060794009643, 0.06450370686339357, 0.061729195975978146, 0.058886505232987524]
97
97-0
Epoch 98 - loss=11.5752
97-1
Epoch 98 - loss=9.7380
97-2
Epoch 98 - loss=10.5889
97-3
Epoch 98 - loss=11.4657
97-4
Epoch 98 - loss=12.4627
97-5
Epoch 98 - loss=11.1574
97-6
Epoch 98 - loss=10.3689
97-7
Epoch 98 - loss=8.6124
97-8
Epoch 98 - loss=9.7055
97-9
Epoch 98 - loss=11.0682
97-10
Epoch 98 - loss=11.2989
97-11
Epoch 98 - loss=11.6119
97-12
Epoch 98 - loss=11.9827
97-13
Epoch 98 - loss=11.5627
97-14
Epoch 98 - loss=6.1166
precision : [0.07411930483795212, 0.06411460779708743, 0.05827462032253037, 0.054744011272897776]
recall : [0.01852982620948803, 0.032057303898543714, 0.043705965241897335, 0.054744011272897776]
MAP : [0.04579614842649131, 0.031058884490072842, 0.024309724337906582, 0.020366226719773388]
ndcg : [0.0771836423901911, 0.06912627825597518, 0.06405913543467517, 0.060726511381960155]
98
98-0
Epoch 99 - loss=12.7383
98-1
Epoch 99 - loss=11.4575
98-2
Epoch 99 - loss=9.9953
98-3
Epoch 99 - loss=10.8069
98-4
Epoch 99 - loss=13.0526
98-5
Epoch 99 - loss=11.3954
98-6
Epoch 99 - loss=10.9950
98-7
Epoch 99 - loss=10.1876
98-8
Epoch 99 - loss=8.7921
98-9
Epoch 99 - loss=10.2377
98-10
Epoch 99 - loss=13.1636
98-11
Epoch 99 - loss=9.6126
98-12
Epoch 99 - loss=10.5077
98-13
Epoch 99 - loss=11.8348
98-14
Epoch 99 - loss=5.8028
precision : [0.07712541099107555, 0.0641615782057301, 0.05858775638014734, 0.054861437294504156]
recall : [0.019281352747768887, 0.03208078910286505, 0.04394081728511013, 0.054861437294504156]
MAP : [0.05067167684358854, 0.03305365437234859, 0.02564787429747505, 0.021417658583785137]
ndcg : [0.0820799977301542, 0.07132697719088889, 0.06595447497094675, 0.06223720654633749]
99
99-0
Epoch 100 - loss=11.4867
99-1
Epoch 100 - loss=9.1462
99-2
Epoch 100 - loss=12.2338
99-3
Epoch 100 - loss=10.2687
99-4
Epoch 100 - loss=10.7331
99-5
Epoch 100 - loss=11.7895
99-6
Epoch 100 - loss=10.2036
99-7
Epoch 100 - loss=9.7152
99-8
Epoch 100 - loss=9.3876
99-9
Epoch 100 - loss=8.9078
99-10
Epoch 100 - loss=11.6751
99-11
Epoch 100 - loss=10.6178
99-12
Epoch 100 - loss=10.2436
99-13
Epoch 100 - loss=10.3937
99-14
Epoch 100 - loss=5.5074
precision : [0.08125880695162041, 0.06782527007984926, 0.061593862533270864, 0.057069046500704275]
recall : [0.020314701737905103, 0.03391263503992463, 0.046195396899952786, 0.057069046500704275]
MAP : [0.05376232973226867, 0.034892937290776645, 0.027151384878017097, 0.022513834210962872]
ndcg : [0.08762606387652228, 0.07608115909706506, 0.07001780726991405, 0.06559261109922071]

[siddhantpathakk]

@YangTakeshi Can you share your edited/modified script, which you used to adapt RETA GNN for ML-1m dataset?