Must-read papers on Knowledge Graph Embedding (KGE)
Content
Distance-based Models
-
SE: Learning Structured Embeddings of Knowledge Bases. AAAI 2011. [Paper]
Antoine Bordes, Jason Weston, Ronan Collobert, Yoshua Bengio. -
TransE: Translating Embeddings for Modeling Multi-relational Data. NIPS 2013. [Paper]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, Oksana Yakhnenko. -
TransH: Knowledge Graph Embedding by Translating on Hyperplanes. AAAI 2014. [Paper]
Zhen Wang, Jianwen Zhang, Jianlin Feng, Zheng Chen. -
TransR: Learning Entity and Relation Embeddings for Knowledge Graph Completion. AAAI 2015. [Paper]
Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, Xuan Zhu. -
TransD: Knowledge Graph Embedding via Dynamic Mapping Matrix. ACL 2015. [Paper]
Guoliang Ji, Shizhu He, Liheng Xu, Kang Liu, Jun Zhao. -
KG2E: Learning to Represent Knowledge Graphs with Gaussian Embedding. CIKM 2015. [Paper]
Shizhu He, Kang Liu, Guoliang Ji and Jun Zhao. -
pTransE: Modeling Relation Paths for Representation Learning of Knowledge Bases. EMNLP 2015. [Paper]
Yankai Lin, Zhiyuan Liu, Huanbo Luan, Maosong Sun, Siwei Rao, Song Liu. -
RTransE: Composing Relationships with Translations. EMNLP 2015. [Paper]
Alberto García-Durán, Antoine Bordes, Nicolas Usunier. -
ManifoldE: From One Point to A Manifold: Knowledge Graph Embedding For Precise Link Prediction. IJCAI 2016. [Paper]
Han Xiao, Minlie Huang, Xiaoyan Zhu. -
TransG: A Generative Mixture Model for Knowledge Graph Embedding. ACL 2016. [Paper]
Han Xiao, Minlie Huang, Xiaoyan Zhu. -
TranSparse: Knowledge Graph Completion with Adaptive Sparse Transfer Matrix. AAAI 2016. [Paper]
Guoliang Ji, Kang Liu, Shizhu He, Jun Zhao. -
TorusE: Knowledge Graph Embedding on a Lie Group. AAAI 2018. [Paper]
Takuma Ebisu, Ryutaro Ichise. -
RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. ILCR 2019. [Paper] [Code]
Zhiqing Sun, Zhi Hong Deng, Jian Yun Nie, Jian Tang. -
DihEdral: Relation Embedding with Dihedral Group in Knowledge Graph. ACL 2019. [Paper]
Canran Xu, Ruijiang Li. -
MuRP: Multi-relational Poincaré Graph Embeddings. NeurIPS 2019. [Paper]
Ivana Balaževic, Carl Allen, Timothy Hospedales. -
QuatE: Quaternion Knowledge Graph Embeddings. NeurIPS 2019. [Paper]
Shuai Zhang, Yi Tay, Lina Yao, Qi Liu. -
HAKE: Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction. AAAI 2020. [Paper] [Code]
Zhanqiu Zhang, Jianyu Cai, Yongdong Zhang, Jie Wang.
Tensor Factorization-based Models
-
RESCAL: A Three-Way Model for Collective Learning on Multi-Relational Data. ICML 2011. [Paper]
Maximilian Nickel, Volker Tresp, Hans-Peter Kriegel. -
LFM: A Latent Factor Model for Highly Multi-relational Data. NIPS 2012. [Paper]
Rodolphe Jenatton, Nicolas L. Roux, Antoine Bordes, Guillaume R. Obozinski. -
DistMult: Embedding Entities and Relations for Learning and Inference in Knowledge Bases. ICLR 2015. [Paper]
Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng. -
ComplEx: Complex Embeddings for Simple Link Prediction. ICML 2016. [Paper]
Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier and Guillaume Bouchard. -
ComplEx (JMLR version): Knowledge Graph Completion via Complex Tensor Factorization. JMLR 2017. [Paper]
Théo Trouillon, Christopher R. Dance, Johannes Welbl, Sebastian Riedel, Éric Gaussier, Guillaume Bouchard. -
HolE: Holographic Embeddings of Knowledge Graphs. AAAI 2016. [Paper]
Maximilian Nickel, Lorenzo Rosasco, Tomaso A. Poggio. -
ANALOGY: Analogical Inference for Multi-relational Embeddings. ICML 2017. [Paper]
Hanxiao Liu, Yuexin Wu, Yiming Yang. -
On Multi-Relational Link Prediction with Bilinear Models. AAAI 2018. [Paper]
Yanjie Wang, Rainer Gemulla, Hui Li. -
N3-Regularizer: Canonical Tensor Decomposition for Knowledge Base Completion. ICML 2018. [Paper] [Code]
Timothée Lacroix, Nicolas Usunier, Guillaume Obozinski. -
SimplE: Embedding for Link Prediction in Knowledge Graphs. NeurIPS 2018. [Paper]
Seyed Mehran Kazemi, David Poole. -
TuckER: Tensor Factorization for Knowledge Graph Completion. EMNLP-IJCNLP 2019. [Paper]
Ivana Balazevic, Carl Allen, Timothy Hospedales.
Neural Network-based Models
-
NTN: Reasoning With Neural Tensor Networks for Knowledge Base Completion. NIPS 2013. [Paper]
Richard Socher, Danqi Chen, Christopher D. Manning, Andrew Ng. -
ProjE: Embedding Projection for Knowledge Graph Completion. AAAI 2017. [Paper]
Baoxu Shi, Tim Weninger. -
ConvE: Convolutional 2D Knowledge Graph Embeddings. AAAI 2018. [Paper] [Code]
Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel. -
ConvKB: A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network. NAACL-HLT 2018. [Paper] [Code]
Dai Quoc Nguyen, Tu Dinh Nguyen, Dat Quoc Nguyen, Dinh Phung. -
R-GCN: Modeling Relational Data with Graph Convolutional Networks. ESWC 2018. [Paper]
Michael Schlichtkrull, Thomas N. Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, Max Welling. -
KBGAT: Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs. ACL 2019. [Paper] [Code]
Deepak Nathani, Jatin Chauhan, Charu Sharma, Manohar Kaul. -
RSN: Learning to Exploit Long-term Relational Dependencies in Knowledge Graphs. ICML 2019. [Paper] [Code]
Lingbing Guo, Zequn Sun, Wei Hu. -
CapsE: A Capsule Network-based Embedding Model for Knowledge Graph Completion and Search Personalization. NAACL-HIT 2019. [Paper] [Code]
Dai Quoc Nguyen, Thanh Vu, Tu Dinh Nguyen, Dat Quoc Nguyen, Dinh Q. Phung. -
InteractE: InteractE: Improving Convolution-based Knowledge Graph Embeddings by Increasing Feature Interactions. AAAI 2020. [Paper]
Shikhar Vashishth, Soumya Sanyal, Vikram Nitin, Nilesh Agrawal, Partha Talukdar.
Others
-
You CAN Teach an Old Dog New Tricks! On Training Knowledge Graph Embeddings. ICLR 2020. [Paper] [Code]
Daniel Ruffinelli, Samuel Broscheit, Rainer Gemulla. -
A Re-evaluation of Knowledge Graph Completion Methods. ACL 2020. [Paper] [Code]
Zhiqing Sun, Shikhar Vashishth, Soumya Sanyal, Partha Talukdar, Yiming Yang.