Distribution-aware Interactive Attention Network and Large-scale Cloud Recognition Benchmark on FY-4A Satellite Image

Paper

⭐ our article ⭐

Citation

@misc{zhang2024multimodal,
      title={Multimodal Informative ViT: Information Aggregation and Distribution for Hyperspectral and LiDAR Classification}, 
      author={Jiaqing Zhang and Jie Lei and Weiying Xie and Geng Yang and Daixun Li and Yunsong Li and Karim Seghouane},
      year={2024},
      eprint={2401.03179},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Products

Prepare the dataset

Download the FY4A L1 dataset for FY4A

Download the Himawari dataset for Himawari

├── fydatahimawari
│   ├── Himawari
......
│   │   ├── 202005
│   │   │   ├── 05
│   │   │   │   ├── 05
│   │   │   │   │   ├──NC_H08_20200505_0500_L2CLP010_FLDK.02401_02401.nc
│   │   │   │   │   ├──NC_H08_20200505_0510_L2CLP010_FLDK.02401_02401.nc
│   │   │   │   │   ├──NC_H08_20200505_0520_L2CLP010_FLDK.02401_02401.nc
......

│   ├── FY4A
......

│   │   ├── 20200104
│   │   │   ├── FY4A-_AGRI--_N_REGC_1047E_L1-_FDI-_MULT_NOM_20200104003000_20200104003417_4000M_V0001.HDF
│   │   │   ├── FY4A-_AGRI--_N_REGC_1047E_L1-_FDI-_MULT_NOM_20200104003418_20200104003835_4000M_V0001.HDF
......

Split the dataset

python split.py

Train the model

python tools/train.py

Test the production

python tools/test_production.py