Skip to content
/ FSMR Public

The source code of paper "A Feature Swapping Multi-modal Reasoning Framework for PMR""

License

Notifications You must be signed in to change notification settings

THU-BPM/FSMR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

A Feature Swapping Multi-modal Reasoning Framework for PMR

Fold Structure

FSMR
├── a_transformers #code
├── clip #code
├── data_processing #code
├── local_transformers #code and the roberta-large checkpoint
├── modeling #code
├── utils #code
├── output #output path (generated after running)
│   └── checkpoint #checkpoints and log files
│   └── results #test result jsons
├── Checkpoints_and_Data #checkpoints and pre-processd PMR dataset
├── Multi-View-Reasoning-cold-start-1.pth #cold-start checkpoint
├── config.yaml #configuration
└── run_PMR_FSMR.py

Training

  1. modify config.yaml

    • set do_train to True

    • modify output_dir

    # modify config.yaml as this
    do_train: True
    output_dir: ./output/checkpoint/output1/
  2. run

    python run_PMR_FSMR.py

Testing

  1. modify config.yaml

    • set do_train to False

    • modify eval_model_dir

    • modify result_dir

    # modify config.yaml as this
    do_train: False
    eval_model_dir: ./output/checkpoint/output1/FSMR-2-0.6326397919375812-1600.pth
    result_dir: ./output/results/output1/
  2. run

    python run_PMR_FSMR.py

About

The source code of paper "A Feature Swapping Multi-modal Reasoning Framework for PMR""

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages