feat: Add ComplEx KGE
#6898
feat: Add ComplEx KGE
#6898
Conversation
Co-authored-by: David Kuo <davidekuo@users.noreply.github.com>
for more information, see https://pre-commit.ci
Codecov Report
@@ Coverage Diff @@
## master #6898 +/- ##
==========================================
- Coverage 91.80% 91.51% -0.30%
==========================================
Files 428 429 +1
Lines 23254 23257 +3
==========================================
- Hits 21348 21283 -65
- Misses 1906 1974 +68
... and 38 files with indirect coverage changes 📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
Co-authored-by: David Kuo <davidekuo@users.noreply.github.com>
Co-authored-by: David Kuo <davidekuo@users.noreply.github.com>
for more information, see https://pre-commit.ci
Adagrad as suggested by the paper worked significantly better than Adam. Achieves Hits@10 of ~.37. Record on PapersWithCode for ComplEx Hits@10 for FB15k is .42.
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
Co-authored-by: David Kuo <davidekuo@users.noreply.github.com>
|
Hi Matthias! I think this is ready for review again. The PapersWithCode metric for ComplEx for Hits@10 on fb15k-237 is .42, and our current optimizer settings in the example are consistently about .36-37 (we didn't want to increase the hidden size when tuning though to keep it fast as an example). If you'd like us to find a better hyperparameter set please let us know! In the current set, we used Adagrad which ended up performing much better than Adam and which was the suggested optimizer in the paper, and we added some L2 weight regularization as also suggested by the paper. We have also updated the loss function to use BCELogits since that is more numerically stable |
Hello! we are hoping to add the ComplEx knowledge graph embedding to PyG as part of our CS224W final project at Stanford.
Our implementation largely follows that of TransE. We implemented complex vectors by breaking the real and imaginary components into separate vectors, but are open to other approaches.
We'd also like to seek input on whether an example is necessary like for TransE here, and if so, whether it would be preferred to be in the same file or a new one.