Must-read papers on Knowledge Graph Embedding (KGE)

Content

• Distance-based Models
• Tensor Factorization-based Models
• Neural Network-based Models
• Others

Distance-based Models

1. SE: Learning Structured Embeddings of Knowledge Bases. AAAI 2011. [Paper]
   Antoine Bordes, Jason Weston, Ronan Collobert, Yoshua Bengio.

2. TransE: Translating Embeddings for Modeling Multi-relational Data. NIPS 2013. [Paper]
   Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, Oksana Yakhnenko.

3. TransH: Knowledge Graph Embedding by Translating on Hyperplanes. AAAI 2014. [Paper]
   Zhen Wang, Jianwen Zhang, Jianlin Feng, Zheng Chen.

4. TransR: Learning Entity and Relation Embeddings for Knowledge Graph Completion. AAAI 2015. [Paper]
   Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, Xuan Zhu.

5. TransD: Knowledge Graph Embedding via Dynamic Mapping Matrix. ACL 2015. [Paper]
   Guoliang Ji, Shizhu He, Liheng Xu, Kang Liu, Jun Zhao.

6. KG2E: Learning to Represent Knowledge Graphs with Gaussian Embedding. CIKM 2015. [Paper]
   Shizhu He, Kang Liu, Guoliang Ji and Jun Zhao.

7. pTransE: Modeling Relation Paths for Representation Learning of Knowledge Bases. EMNLP 2015. [Paper]
   Yankai Lin, Zhiyuan Liu, Huanbo Luan, Maosong Sun, Siwei Rao, Song Liu.

8. RTransE: Composing Relationships with Translations. EMNLP 2015. [Paper]
   Alberto García-Durán, Antoine Bordes, Nicolas Usunier.

9. ManifoldE: From One Point to A Manifold: Knowledge Graph Embedding For Precise Link Prediction. IJCAI 2016. [Paper]
   Han Xiao, Minlie Huang, Xiaoyan Zhu.

10. TransG: A Generative Mixture Model for Knowledge Graph Embedding. ACL 2016. [Paper]
    Han Xiao, Minlie Huang, Xiaoyan Zhu.

11. TranSparse: Knowledge Graph Completion with Adaptive Sparse Transfer Matrix. AAAI 2016. [Paper]
    Guoliang Ji, Kang Liu, Shizhu He, Jun Zhao.

12. TorusE: Knowledge Graph Embedding on a Lie Group. AAAI 2018. [Paper]
    Takuma Ebisu, Ryutaro Ichise.

13. RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. ILCR 2019. [Paper] [Code]
    Zhiqing Sun, Zhi Hong Deng, Jian Yun Nie, Jian Tang.

14. DihEdral: Relation Embedding with Dihedral Group in Knowledge Graph. ACL 2019. [Paper]
    Canran Xu, Ruijiang Li.

15. MuRP: Multi-relational Poincaré Graph Embeddings. NeurIPS 2019. [Paper]
    Ivana Balaževic, Carl Allen, Timothy Hospedales.

16. QuatE: Quaternion Knowledge Graph Embeddings. NeurIPS 2019. [Paper]
    Shuai Zhang, Yi Tay, Lina Yao, Qi Liu.

17. HAKE: Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction. AAAI 2020. [Paper] [Code]
    Zhanqiu Zhang, Jianyu Cai, Yongdong Zhang, Jie Wang.

Tensor Factorization-based Models

1. RESCAL: A Three-Way Model for Collective Learning on Multi-Relational Data. ICML 2011. [Paper]
   Maximilian Nickel, Volker Tresp, Hans-Peter Kriegel.

2. LFM: A Latent Factor Model for Highly Multi-relational Data. NIPS 2012. [Paper]
   Rodolphe Jenatton, Nicolas L. Roux, Antoine Bordes, Guillaume R. Obozinski.

3. DistMult: Embedding Entities and Relations for Learning and Inference in Knowledge Bases. ICLR 2015. [Paper]
   Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng.

4. ComplEx: Complex Embeddings for Simple Link Prediction. ICML 2016. [Paper]
   Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier and Guillaume Bouchard.

5. ComplEx (JMLR version): Knowledge Graph Completion via Complex Tensor Factorization. JMLR 2017. [Paper]
   Théo Trouillon, Christopher R. Dance, Johannes Welbl, Sebastian Riedel, Éric Gaussier, Guillaume Bouchard.

6. HolE: Holographic Embeddings of Knowledge Graphs. AAAI 2016. [Paper]
   Maximilian Nickel, Lorenzo Rosasco, Tomaso A. Poggio.

7. ANALOGY: Analogical Inference for Multi-relational Embeddings. ICML 2017. [Paper]
   Hanxiao Liu, Yuexin Wu, Yiming Yang.

8. On Multi-Relational Link Prediction with Bilinear Models. AAAI 2018. [Paper]
   Yanjie Wang, Rainer Gemulla, Hui Li.

9. N3-Regularizer: Canonical Tensor Decomposition for Knowledge Base Completion. ICML 2018. [Paper] [Code]
   Timothée Lacroix, Nicolas Usunier, Guillaume Obozinski.

10. SimplE: Embedding for Link Prediction in Knowledge Graphs. NeurIPS 2018. [Paper]
    Seyed Mehran Kazemi, David Poole.

11. TuckER: Tensor Factorization for Knowledge Graph Completion. EMNLP-IJCNLP 2019. [Paper]
    Ivana Balazevic, Carl Allen, Timothy Hospedales.

Neural Network-based Models

1. NTN: Reasoning With Neural Tensor Networks for Knowledge Base Completion. NIPS 2013. [Paper]
   Richard Socher, Danqi Chen, Christopher D. Manning, Andrew Ng.

2. ProjE: Embedding Projection for Knowledge Graph Completion. AAAI 2017. [Paper]
   Baoxu Shi, Tim Weninger.

3. ConvE: Convolutional 2D Knowledge Graph Embeddings. AAAI 2018. [Paper] [Code]
   Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel.

4. ConvKB: A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network. NAACL-HLT 2018. [Paper] [Code]
   Dai Quoc Nguyen, Tu Dinh Nguyen, Dat Quoc Nguyen, Dinh Phung.

5. R-GCN: Modeling Relational Data with Graph Convolutional Networks. ESWC 2018. [Paper]
   Michael Schlichtkrull, Thomas N. Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, Max Welling.

6. KBGAT: Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs. ACL 2019. [Paper] [Code]
   Deepak Nathani, Jatin Chauhan, Charu Sharma, Manohar Kaul.

7. RSN: Learning to Exploit Long-term Relational Dependencies in Knowledge Graphs. ICML 2019. [Paper] [Code]
   Lingbing Guo, Zequn Sun, Wei Hu.

8. CapsE: A Capsule Network-based Embedding Model for Knowledge Graph Completion and Search Personalization. NAACL-HIT 2019. [Paper] [Code]
   Dai Quoc Nguyen, Thanh Vu, Tu Dinh Nguyen, Dat Quoc Nguyen, Dinh Q. Phung.

9. InteractE: InteractE: Improving Convolution-based Knowledge Graph Embeddings by Increasing Feature Interactions. AAAI 2020. [Paper]
   Shikhar Vashishth, Soumya Sanyal, Vikram Nitin, Nilesh Agrawal, Partha Talukdar.

Others

1. You CAN Teach an Old Dog New Tricks! On Training Knowledge Graph Embeddings. ICLR 2020. [Paper] [Code]
   Daniel Ruffinelli, Samuel Broscheit, Rainer Gemulla.

2. A Re-evaluation of Knowledge Graph Completion Methods. ACL 2020. [Paper] [Code]
   Zhiqing Sun, Shikhar Vashishth, Soumya Sanyal, Partha Talukdar, Yiming Yang.