Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reverse flag implementation #21

Closed
luffycodes opened this issue Feb 9, 2021 · 1 comment
Closed

Reverse flag implementation #21

luffycodes opened this issue Feb 9, 2021 · 1 comment

Comments

@luffycodes
Copy link

luffycodes commented Feb 9, 2021

Hey if I just change the line 194 (d = Data(data_dir=data_dir, reverse=True) in main.py file, and use reverse=False, and run the code for FB15k-237 with recommended settings, the MRR shoots up to 0.4067. Is it expected behaviour?

To replicate:

  1. Just change reverse=False in main.py
  2. CUDA_VISIBLE_DEVICES=0 python main.py --dataset FB15k-237 --num_iterations 500 --batch_size 128 --lr 0.0005 --dr 1.0 --edim 200 --rdim 200 --input_dropout 0.3 --hidden_dropout1 0.4 --hidden_dropout2 0.5 --label_smoothing 0.1

MRR keeps increasing.

Log for iteration 145:
145
21.162700176239014
0.001321860825107114
Test:
Number of data points: 20466
Hits @10: 0.6135053259063813
Hits @3: 0.4763998827323366
Hits @1: 0.3409557314570507
Mean rank: 147.47825662073683
Mean reciprocal rank: 0.4335430118109515

@luffycodes
Copy link
Author

Found a similar issue, so closing this !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant