The official GitHub repository of the survey paper titled "A Systematic Review of Deep Learning-based Research on Radiology Report Generation".
We maintain this repository to summarize papers and resources related to the radiology report generation (RRG) task.
In reference.bib, we summarize the bibtex references of existing RRG papers, widely used datasets, and related toolkits.
If you have any suggestions about papers, code implementations, and other resources, please feel free to start a new issue or pull requests.
Papers involving large language models (LLMs) are in boldface.
If your research is related to our work, please cite the following paper:
@misc{liu2023systematic,
title={A Systematic Review of Deep Learning-based Research on Radiology Report Generation},
author={Chang Liu and Yuanhe Tian and Yan Song},
year={2023},
eprint={2311.14199},
archivePrefix={arXiv},
primaryClass={cs.CV}
}[2024 Jan. 9th] We have updated all accepted papers by EMNLP 2023.
[Dec. 9th] Our paper titled "Bootstrapping Large Language Models for Radiology Report Generation" is accepted by AAAI 2024! Refer to our GitHub repo for more details!
- Add AAAI 2024 papers.
[AAAI 2024] Bootstrapping Large Language Models for Radiology Report Generation [paper] [code]
[WACV 2024] Complex Organ Mask Guided Radiology Report Generation [paper] [code]
[arXiv 2024] ICON: Improving Inter-Report Consistency for Radiology Report Generation via Lesion-aware Mix-up Augmentation [paper] [code]
[arXiv 2023] LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation [paper] [code] [code]
[arXiv 2023] MAIRA-1: A Specialised Large Multimodal Model for Radiology Report Generation [paper] [project]
[arXiv 2023] MedXChat: Bridging CXR Modalities with a Unified Multimodal Large Model [paper]
[arXiv 2023] Pragmatic Radiology Report Generation [paper]
[arXiv 2023] RadLLM: A Comprehensive Healthcare Benchmark of Large Language Models for Radiology [paper] [project]
[arXiv 2023] RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance [paper] [code]
[arXiv 2023] Towards Generalist Biomedical AI [paper] [reproduced code]
[arXiv 2023] Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Data [paper] [project] [code]
[arXiv 2023] Cross-Modal Causal Intervention for Medical Report Generation [paper] [code]
[arXiv 2023] Medical Report Generation based on Segment-Enhanced Contrastive Representation Learning [paper]
[arXiv 2023] Radiology Report Generation Using Transformers Conditioned with Non-imaging Data [paper]
[ACL 2023] ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning [paper] [code]
[ACL 2023] Replace and Report: NLP Assisted Radiology Report Generation [paper]
[AMI 2023] Improving Chest X-ray Report Generation by Leveraging Warm Starting [paper] [code]
[CVPR 2023] Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generation [paper] [code]
[CVPR 2023] Interactive and Explainable Region-guided Radiology Report Generation [paper] [code]
[CVPR 2023] KiUT: Knowledge-injected U-Transformer for Radiology Report Generation [paper]
[CVPR 2023] METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokens [paper]
[EACL 2023] KGVL-BART: Knowledge Graph Augmented Visual Language BART for Radiology Report Generation [paper] [code]
[EMNLP 2023] Style-Aware Radiology Report Generation with RadGraph and Few-Shot Prompting [paper]
[EMNLP 2023] PhenotypeCLIP: Phenotype-based Contrastive Learning for Medical Imaging Report Generation [paper]
[EMNLP 2023] RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoning [paper] [code]
[ICASSP 2023] MvCo-DoT: Multi-View Contrastive Domain Transfer Network for Medical Report Generation [paper]
[ICCV 2023] Unify, Align and Refine: Multi-Level Semantic Alignment for Radiology Report Generation [paper]
[ICIP 2023] Self Adaptive Global-Local Feature Enhancement for Radiology Report Generation [paper]
[TMI 2023] Attributed Abnormality Graph Embedding for Clinically Accurate X-Ray Report Generation [paper]
[TMI 2023] SGT++: Improved Scene Graph-guided Transformer for Surgical Report Generation [paper]
[TMM 2024] From Observation to Concept: A Flexible Multi-view Paradigm for Medical Report Generation [paper]
[TMM 2023] Joint Embedding of Deep Visual and Semantic Features for Medical Image Report Generation [paper]
[TMM 2023] Semi-supervised Medical Report Generation via Graph-guided Hybrid Feature Consistency [paper]
[WWW 2023] Auxiliary Signal‑guided Knowledge Encoder‑decoder for Medical Report Generation [paper] [code]
[arXiv 2022] CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation [paper]
[arXiv 2022] Hybrid Reinforced Medical Report Generation with M-Linear Attention and Repetition Penalty [paper]
[arXiv 2022] DeltaNet: Conditional Medical Report Generation for COVID-19 Diagnosis [paper]
[AACL 2022] Multimodal Generation of Radiology Reports using Knowledge-Grounded Extraction of Entities and Relations [paper]
[ACL 2022] Reinforced Cross-modal Alignment for Radiology Report Generation [paper] [code]
[BMVC 2022] On the Importance of Image Encoding in Automated Chest X-Ray Report Generation [paper] [code]
[CVPR 2022] Cross-modal Clinical Graph Transformer for Ophthalmic Report Generation [paper]
[ECCV 2022] Cross-Modal Prototype Driven Network for Radiology Report Generation [paper]
[EMNLP 2022] Improving the Factual Correctness of Radiology Report Generation with Semantic Rewards [paper] [code]
[EMNLP 2022] Factual Accuracy is not Enough: Planning Consistent Description Order for Radiology Report Generation [paper]
[ICBB 2022] Clinically Coherent Radiology Report Generation with Imbalanced Chest X-rays [paper]
[MIA 2022] Knowledge Matters: Chest Radiology Report Generation with General and Specific Knowledge [paper] [code]
[MICCAI 2023] SGT: Scene Graph-Guided Transformer for Surgical Report Generation [paper] [code]
[MICCAI 2022] RepsNet: Combining Vision with Language for Automated Medical Reports [paper]
[MICCAI 2022] A Self-guided Framework for Radiology Report Generation [paper] [code]
[MICCAI 2022] A Medical Semantic-Assisted Transformer for Radiographic Report Generation [paper]
[MICCAI 2022] Lesion Guided Explainable Few Weak-Shot Medical Report Generation [paper]
[MICCAI 2022] TranSQ: Transformer-Based Semantic Query for Medical Report Generation [paper] [code]
[TMI 2022] Automated Radiographic Report Generation Purely on Transformer: A Multicriteria Supervised Approach [paper]
[ACL 2021] Cross-modal Memory Networks for Radiology Report Generation [paper] [code]
[COLING 2021] JPG - Jointly Learn to Align: Automated Disease Prediction and Radiology Report Generation [paper]
[CVPR 2021] Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation [paper]
[CVPR 2021] A Self-boosting Framework for Automated Radiographic Report Generation [paper]
[EMNLP 2021] Automated Generation of Accurate & Fluent Medical X-ray Reports [paper] [code]
[EMNLP 2021] Progressive Transformer-Based Generation of Radiology Reports [paper] [code]
[EMNLP 2021] Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation [paper] [code]
[ICCV 2021] Visual-Textual Attentive Semantic Consistency for Medical Report Generation [paper]
[NAACL 2021] Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation [paper] [code]
[MICCAI 2021] RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reporting [paper] [code]
[MICCAI 2021] Trust It or Not: Confidence-Guided Automatic Radiology Report Generation [paper]
[NeurIPS 2021] Auto-encoding Knowledge Graph for Unsupervised Medical Report Generation [paper]
[AAAI 2020] When Radiology Report Generation Meets Knowledge Graph [paper]
[ACCV 2020] Hierarchical X-Ray Report Generation via Pathology tags and Multi Head Attention [paper]
[EMNLP 2020] Generating Radiology Reports via Memory-driven Transformer [paper] [code]
[EMNLP 2020] Reinforcement Learning with Imbalanced Dataset for Data-to-Text Medical Report Generation [paper]
[AAAI 2019] Knowledge-Driven Encode, Retrieve, Paraphrase for Medical Image Report Generation [paper]
[ACL 2019] Show, Describe and Conclude: On Exploiting the Structure Information of Chest X-Ray Reports [paper]
[MICCAI 2019] Automatic Radiology Report Generation based on Multi-view Image Fusion and Medical Concept Enrichment [paper]
[BMVC 2019] Addressing Data Bias Problems for Chest X-ray Image Report Generation [paper]
[ACL 2018] On the Automatic Generation of Medical Imaging Reports [paper] [code]
[MICCAI 2018] Multimodal Recurrent Model with Attention for Automated Radiology Report Generation [paper] [code]
[NeurIPS 2018] Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generation [paper]
[J. Am. Medical Informatics Assoc.] Preparing A Collection of Radiology Examinations for Distribution and Retrieval [paper] [dataset]
[Scientific Data] MIMIC-CXR, A De-identified Publicly Available Database of Chest Radiographs with Free-text Reports [paper] [dataset]
[arXiv] MIMIC-CXR-JPG, A Large Publicly Available Database of Labeled Chest Radiographs [paper] [dataset]
[NeurIPS 2021 Datasets & Benchmark] FFA-IR: Towards an Explainable and Reliable Medical Report Generation Benchmark [paper] [dataset] [GitHub]
[NeurIPS 2021 Datasets & Benchmark] RadGraph: Extracting Clinical Entities and Relations from Radiology Reports [paper] [dataset]
[NeurIPS 2021 Datasets & Benchmark] RadGraph [paper] [project] [code]
[AAAI 2019] CheXpert [paper] [code]