Resource List by category
[pdf]: paper PDF online link
[repo]: paper PDF repo link
[github]: github link
[web]: website link
| Year | Author |
Conf. |
Title | Links |
|---|---|---|---|---|
| 2015.11 | Zhu et al. | arXiv | Building a Large-scale Multimodal Knowledge Base System for Answering Visual Queries | [pdf] [repo] |
| 2017.08 | Xie et al. | IJCAI'17 | Image-embodied Knowledge Representation Learning | [pdf] [repo] |
| 2018.01 | Saha et al. | AAAI'18 | Towards Building Large Scale Multimodal Domain-Aware Conversation Systems | [pdf] [repo] |
| 2018.06 | Mousselly-Sergieh et al. | SEM'18 | A Multimodal Translation-Based Approach for Knowledge Graph Representation Learning | [pdf] [repo] |
| 2018.11 | Pezeshkpour et al. | EMNLP'18 | Embedding Multimodal Relational Data for Knowledge Base Completion | [pdf] [repo] |
| 2019.03 | Liu et al. | ESWC'19 | MMKG: Multi-Modal Knowledge Graphs | [pdf] [repo] |
| 2019.05 | Rubio et al. | AKBC'19 | Answering Visual-Relational Queries in Web-Extracted Knowledge Graphs | [pdf] [repo] |
| 2019.06 | Wang et al. | IJCNN'19 | Multimodal Data Enhanced Representation Learning for Knowledge Graphs | [pdf] [repo] |
| 2019.10 | Liu et al. | ACM-MM'19 | Knowledge-guided Pairwise Reconstruction Network for Weakly Supervised Referring Expression Grounding | [pdf] [repo] |
| 2019.10 | Zhang et al. | ACM-MM'19 | Multi-modal Knowledge-aware Hierarchical Attention Network for Explainable Medical Question Answering | [pdf] [repo] |
| 2020.07 | Li et al. | ACL'20 | GAIA: A Fine-grained Multimedia Knowledge Extraction System | [pdf] [repo] |
| 2020.08 | Chen et al. | KSEM'20 | MMEA: Entity Alignment for Multi-modal Knowledge Graph | [pdf] [repo] |
| 2020.08 | Xie et al. | EasyChair | Construction of Multi-modal Chinese Tourism Knowledge Graph | [pdf] [repo] |
| 2020.10 | Wang et al. | ICMR'20 | Fake News Detection via Knowledge-drive Multimodal Graph Convolutional Networks | [pdf] [repo] |
| 2020.10 | Kannan et al. | CIKM'20 | Multimodal Knowledge Graph for Deep Learning Papers and Code | [pdf] [repo] |
| 2020.10 | Sun et al. | CIKM'20 | Multi-modal Knowledge Graphs for Recommender Systems | [pdf] [repo] |
| 2020.11 | Wang et al. | EMNLP'20 | Incorporating Multimodal Information in Open-Domain Web Keyphrase Extraction | [pdf] [repo] [github] |
| 2021.02 | Liu et al. | AAAI'21 | Visual Pivoting for (Unsupervised) Entity Alignment | [pdf] [repo] |
| 2021.02 | Sun et al. | AAAI'21 | RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER | [pdf] [repo] [github] |
| 2021.10 | Wang et al. | ACM-MM'21 | Is Visual Context Really Helpful for Knowledge Graph? A Representation Learning Perspective | [pdf] [repo] |
| Year | Author |
Conf. |
Title | Links |
|---|---|---|---|---|
| 2016.03 | Vendrov et al. | ICLR'16 | Order-Embeddings of Image and Language | [pdf] [repo] [github] |
| 2018.09 | Huang et al. | ECCV'18 | Multimodal Unsupervised Image-to-Image Translation | [pdf] [repo] |
| 2018.11 | Wang et al. | EMNLP'18 | Associative Multichannel Autoencoder for Multimodal Word Representation | [pdf] [repo] |
| 2019.04 | Yang et al. | arXiv | Shared Predictive Cross-Modal Deep Quantization | [pdf] [repo] |
| 2019.10 | Guo et al. | ACM-MM'19 | Aligning Linguistic Words and Visual Semantic Units for Image Captioning | [pdf] [repo] [github] |
| 2019.10 | He et al. | ACM-MM'19 | A New Benchmark and Approach for Fine-grained Cross-media Retrieval | [pdf] [repo] [github] |
| 2019.10 | Huang et al. | ACM-MM'19 | Annotation Efficient Cross-Modal Retrieval with Adversarial Attentive Alignment | [pdf] [repo] |
| 2019.10 | Nie et al. | ACM-MM'19 | Multimodal Dialog System: Generating Responses via Adaptive Decoders | [pdf] [repo] |
| 2020.01 | Xi et al. | ICMLSC'20 | Multimodal Sentiment Analysis based on Multi-head Attention Mechanism | [pdf] [repo] |
| 2020.01 | Park et al. | WACV'20 | MHSAN: Multi-Head Self-Attention Network for Visual Semantic Embedding | [pdf] [repo] |
| 2020.02 | Kim et al. | AAAI'20 | MULE: Multimodal Universal Language Embedding | [pdf] [repo] |
| 2020.02 | Mai et al. | AAAI'20 | Modality to Modality Translation: An Adversarial Representation Learning and Graph Fusion Network for Multimodal Fusion | [pdf] [repo] |
| 2020.03 | Zhang et al. | JSTSP/IEEE | Multimodal Intelligence: Representation Learning, Information Fusion, and Applications | [pdf] [repo] |
| 2020.08 | Wang et al. | KDD'20 | Multimodal Learning with Incomplete Modalities by Knowledge Distillation | [pdf] [repo] |
| 2020.10 | Chiou et al. | arXiv | Visual Relationship Detection with Visual-Linguistic Knowledge from Multimodal Representations | [pdf] [repo] |
| 2020.11 | Tsai et al. | EMNLP'20 | Multimodal Routing: Improving Local and Global Interpretability of Multimodal Language Analysis | [pdf] [repo] [github] |
| 2020.12 | Wang et al. | NeurIPS'20 | Deep Multimodal Fusion by Channel Exchanging | [pdf] [repo] [github] |
| 2021.04 | Zhu et al. | EACL'21 | Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation | [pdf] [repo] [github] |
| 2021.04 | Sun et al. | EACL'21 | A New View of Multi-modal Language Analysis: Audio and Video Features as Text Styles | [pdf] [repo] |
| 2021.04 | Sahu et al. | EACL'21 | Adaptive Fusion Techniques for Multimodal Data | [pdf] [repo] [github] |
| 2021.06 | Xu et al. | ACL'21 | LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding | [pdf] [repo] |
| 2021.06 | Cao et al. | ACL'21 | Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases | [pdf] [repo] |
| 2021.06 | Xing et al. | ACL'21 | KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation | [pdf] [repo] |
| 2021.06 | Su et al. | ACL'21 | GEM: A General Evaluation Benchmark for Multimodal Tasks | [pdf] [repo] |
| Year | Author |
Conf. |
Title | Links |
|---|---|---|---|---|
| 2009.08 | Mintz et al. | ACL'09 | Distant Supervision for Relation Extraction without Labeled Data | [pdf] [repo] |
| 2013.12 | Bordes et al. | NIPS'13 | Translating Embeddings for Modeling Multi-relational Data | [pdf] [repo] |
| 2014.07 | Wang et al. | AAAI'14 | Knowledge Graph Embedding by Translating on Hyperplanes | [pdf] [repo] |
| 2014.08 | Zeng et al. | COLING'14 | Relation Classification via Convolutional Deep Neural Network | [pdf] [repo] |
| 2015.08 | Zeng et al. | EMNLP'15 | Distance Supervision for Relation Extraction via Piecewise Convolutional Neural Networks | [pdf] [repo] |
| 2015.10 | Ji et al. | ACL'15 | Knowledge Graph Embedding via Dynamic Mapping Matrix | [pdf] [repo] |
| 2016.02 | Ji et al. | AAAI'16 | Knowledge Graph Completion with Adaptive Sparse Transfer Matrix | [pdf] [repo] |
| 2016.08 | Lin et al. | ACL'16 | Neural Relation Extraction with Selective Attention over Instances | [pdf] [repo] |
| 2016.08 | Xiao et al. | ACL'16 | TransG: A Generative Model for Knowledge Graph Embedding | [pdf] [repo] |
| 2021.11 | Yuan et al. | EMNLP'21 | Interactive Machine Comprehension with Dynamic Knowledge Graphs | [pdf] [repo] |
| 2021.11 | Guo et al. | EMNLP'21 | BiQUE: Biquaternionic Embeddings of Knowledge Graphs | [pdf] [repo] |
| 2021.11 | Dash et al. | EMNLP'21 | Open Knowledge Graphs Canonicalization using Variational Autoencoders | [pdf] [repo] |
| 2021.11 | Meng et al. | EMNLP'21 | Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT | [pdf] [repo] |
| 2021.11 | Oliya et al. | EMNLP'21 | End-to-End Entity Resolution and Question Answering Using Differentiable Knowledge Graphs | [pdf] [repo] |
| Author | Conf. / Uni |
Title | Links |
|---|---|---|---|
| Shih-Fu Chang | CVPR'19 & Uni. Columbia | Multimodal Knowledge Graphs: Automatic Extraction & Applications | [pdf] [repo] |
| Dihong Gong | Uni. Florida | Towards Building Large-Scale Multimodal Knowledge Bases | [pdf] [repo] |
| Elias Karle & Umutcan Simsek | Uni Innsbruck | How To Build a Knowledge Graph | [pdf] [repo] |
| Jay Pujara & Sameer Singh | WSDM‘18 | Mining Knowledge Graphs from Text | [pdf] [repo1] [repo2A] [repo2B] [repo3] [repo4] [repo5] |
| Sameer Singh | Uni California, Irvine | Injecting Prior Information and Multiple Modalities into Knowledge Base Embeddings | [pdf] [repo] |