add multi model viz

[Sanster]

Motivation

Added a new tool script that can visually compare the result of different models in the command line.

Modification

• a new tool script: viz_multi_model.py
• new dependency package in requirements/runtime.txt:
  • rich: for beautiful formatting in the terminal
  • typer: make write cli tool easier

Use cases

Model configurations and outputs that can be used for testing: example_configs_and_outputs.zip

use case1: show summarizer of different models, the script will check if the dataset of the model is consistent.

python3 tools/viz_multi_model.py \
--cfg-paths ./configs/eval_model1.py \
--work-dirs ./outputs/model1/20231025_153230 \
--cfg-paths ./configs/eval_model2.py \
--work-dirs ./outputs/model2/20231025_110325

use case2: show metrics in a summary group by adding --group ceval

python3 tools/viz_multi_model.py \
--cfg-paths ./configs/eval_model1.py \
--work-dirs ./outputs/model1/20231025_153230 \
--cfg-paths ./configs/eval_model2.py \
--work-dirs ./outputs/model2/20231025_110325 \
--group ceval

[yingfhu]

Thanks a lot for your great work!!! I tested locally, it worked pretty well, except for some subtle enhancements for some corner cases.

[Sanster]

Thanks a lot for your great work!!! I tested locally, it worked pretty well, except for some subtle enhancements for some corner cases.

Thank you for your detailed review. I just started using OpenCompass and didn't consider some situations. I have made modifications according to the content of the review and pushed a new commit.

[yingfhu]

LGTM