Awesome-Large-Language-Models-On-Graphs

This is a collection of awesome papers on the topic of Large Language Models (LLMs) on Graphs, which is organized by their published years. The repository will be be continuously updated, so stay tuned. If you found any error or any missed paper, please don't hesitate to open issues or pull requests. Any suggestions and comments are welcome (jianglinlu@outlook.com).

Year 2023 [Back to Top]

1. [arXiv 2023] SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learning [paper] [Author]

2. [arXiv 2023] Graph Neural Prompting with Large Language Models [paper]

3. [arXiv 2023] Train Your Own GNN Teacher: Graph-Aware Distillation on Textual Graphs [paper]

4. [ICLR 2023] Learning on Large-scale Text-attributed Graphs via Variational Inference [paper] [Code] [Author]

5. [arXiv 2023] Explanations as Features: LLM-Based Features for Text-Attributed Graphs [paper] [Code] [Author]

6. [arXiv 2023] Large Graph Models: A Perspective [paper]

7. [arXiv 2023] Planning with Logical Graph-based Language Model for Instruction Generation [paper]

8. [ACL 2023] BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Models [paper]

9. [arXiv 2023] Using Large Language Models for Zero-Shot Natural Language Generation from Knowledge Graphs [paper]

10. [arXiv 2023] Developing a Scalable Benchmark for Assessing Large Language Models in Knowledge Graph Engineering [paper] [Code]

11. [arXiv 2023] Optimal Scene Graph Planning with Large Language Model Guidance [paper]

12. [arXiv 2023] AutoAlign: Fully Automatic and Effective Knowledge Graph Alignment enabled by Large Language Models [paper]

13. [arXiv 2023] Boosting Logical Reasoning in Large Language Models through a New Framework: The Graph of Thought [paper]

14. [arXiv 2023] Natural Language is All a Graph Needs [paper]

15. [arXiv 2023] Head-to-Tail: How Knowledgeable are Large Language Models (LLM)? A.K.A. Will LLMs Replace Knowledge Graphs? [paper]

16. [arXiv 2023] SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Task Planning [paper]

17. [arXiv 2023] Enhancing Reasoning Capabilities of Large Language Models: A Graph-Based Verification Approach [paper]

18. [arXiv 2023] MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models [paper]

19. [arXiv 2023] Evaluating Large Language Models on Graphs: Performance Insights and Comparative Analysis [paper] [Code]

20. [arXiv 2023] Enhancing Recommender Systems with Large Language Model Reasoning Graphs [paper]

21. [arXiv 2023] Graph of Thoughts: Solving Elaborate Problems with Large Language Models [paper] [Code] [Author]

22. [arXiv 2023] GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text [paper]

23. [arXiv 2023] Think-on-Graph: Deep and Responsible Reasoning of Large Language Model with Knowledge Graph [paper]

24. [arXiv 2023] Exploring Large Language Model for Graph Data Understanding in Online Job Recommendations [paper]

25. [arXiv 2023] Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs [paper] [Code]

26. [arXiv 2023] GPT4Graph: Can Large Language Models Understand Graph Structured Data? An Empirical Evaluation and Benchmarking [paper]

27. [2023] **** [paper]

Survey

1. [arXiv 2023] Unifying Large Language Models and Knowledge Graphs: A Roadmap [paper]

2. [arXiv 2023] Large Language Models and Knowledge Graphs: Opportunities and Challenges [paper]

Year 2022 [Back to Top]

1. [NeurIPS 2022] Deep Bidirectional Language-Knowledge Graph Pretraining [paper]

2. [ICLR 2022] Greaselm: Graph Reasoning Enhanced Language Models [paper]

3. [AAAI 2022] Enhanced Story Comprehension for Large Language Models through Dynamic Document-Based Knowledge Graphs [paper]

4. [ACL 2022] SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models [paper]

5. [ACL 2022] A Framework for Adapting Pre-Trained Language Models to Knowledge Graph Completion [paper]

6. [EMNLP 2022] Empowering Language Models with Knowledge Graph Reasoning for Question Answering [paper]

7. [arXiv 2022] Endowing Language Models with Multimodal Knowledge Graph Representations [paper]

8. [NeurIPS 2022 Datasets and Benchmarks Track] A Comprehensive Study on Large-Scale Graph Training: Benchmarking and Rethinking [paper] [Author]

Year 2021 [Back to Top]

1. [Briefings in Bioinformatics 2021] Enriching Contextualized Language Model from Knowledge Graph for Biomedical Information Extraction [paper]

2. [NeurIPS Workshop 2021] Grapher: Multi-Stage Knowledge Graph Construction using Pretrained Language Models [paper]

3. [ACL 2021] Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Models [paper]

4. [ACL 2021] QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering [paper]

5. [ACL 2021] Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training [paper]

6. [ACL 2021] Investigating Pretrained Language Models for Graph-to-Text Generation [paper]

Year 2020 [Back to Top]

1. [EMNLP 2020] BERT-MK: Integrating Graph Contextualized Knowledge into Pre-trained Language Models [paper]

2. [AAAI 2020] KG-BERT: BERT for Knowledge Graph Completion [paper]

Others

1. Awesome-Graph-LLM [page]

2. KG-LLM-Papers [page]

3. [arXiv 2023] On the Origin of LLMs: An Evolutionary Tree and Graph for 15,821 Large Language Models [paper]

4. Knowledge Graphs + Large Language Models = The ability for users to ask their own questions? [page]