Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

14 Commits
Β 
Β 

Repository files navigation

IterRF

Iterative and Interpretable Mutual Enhancement for Joint Multi-Modal Image Registration and Fusion

Paper Code Models License

Official repository for IterRF.


πŸ“Œ Overview

IterRF targets the challenging problem of unaligned multi-modal image fusion, where accurate spatial registration and high-quality image fusion must be optimized together rather than handled as isolated steps.

IterRF overview

Existing approaches commonly rely on a cascaded register-then-fuse pipeline, or introduce only limited one-step feedback between registration and fusion. These designs can restrict the mutual enhancement between spatial alignment and information integration.

IterRF formulates registration and fusion within a unified optimization framework and unfolds the optimization process into alternating registration-related and fusion-related subproblems. With iterative bidirectional refinement, the model progressively improves alignment accuracy and fusion quality.

✨ Highlights

  • Joint registration and fusion: optimizes spatial alignment and fused image generation in a unified framework.
  • Iterative mutual enhancement: alternates between registration-oriented and fusion-oriented refinement stages.
  • Optimization-inspired design: unfolds interpretable subproblems into a learnable end-to-end framework.
  • Broad multi-modal applicability: designed for infrared-visible and medical multi-modal image scenarios.
  • Research-friendly release plan: code, pretrained models, evaluation scripts, and visualization results will be released after paper acceptance.

🧩 Framework

image

The framework alternates between registration and fusion modules so that the two tasks can refine each other over multiple iterations. Registration benefits from progressively enhanced fused representations, while fusion benefits from increasingly reliable spatial correspondence.

πŸ—“οΈ Release Plan

The full project will be released upon paper acceptance. Planned materials include:

  • Source code for the official IterRF implementation
  • Pretrained model checkpoints
  • Testing and evaluation scripts
  • Training scripts and configuration files
  • Visualization tools and qualitative comparison results
  • Detailed usage instructions and reproducibility notes

πŸ› οΈ Installation

The installation guide will be provided together with the code release.

πŸ§ͺ Testing

Testing and evaluation instructions will be added after the official implementation is released.

πŸš€ Training

Training scripts, configuration files, and dataset preparation instructions will be released after paper acceptance.

πŸ“¦ Pretrained Models

Pretrained checkpoints will be made available after the paper is accepted.

πŸ“ˆ Results

Quantitative results, qualitative comparisons, and visualization examples will be added in the official release.

πŸ“„ License

The license will be announced before the public code release.

πŸ“š Citation

If you find this work useful for your research, please consider citing our paper. The BibTeX entry will be updated after publication.

πŸ“¬ Contact

For questions about IterRF, please open an issue in this repository.

About

IterRF: Iterative and Interpretable Mutual Enhancement for Jointly Improving Multi-modal Image Registration and Fusion

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors