Skip to content

Latest commit

 

History

History

action-recognition

Folders and files

NameName
Last commit message
Last commit date

parent directory

..

datasets

datasets

 
 

docs

docs

 
 

engines

engines

 
 

models

models

 
 

README.md

README.md

 
 

functional.py

functional.py

 
 

optim_factory.py

optim_factory.py

 
 

run_class_finetuning.py

run_class_finetuning.py

 
 

run_mae_pretraining.py

run_mae_pretraining.py

 
 

run_regression_finetuning.py

run_regression_finetuning.py

 
 

run_umt_pretraining.py

run_umt_pretraining.py

 
 

utils.py

utils.py

 
 

README.md

Video Mamba Suite: Action Recognition

Main Results

Kinetics-400

Method #Frame Top-1 Acc Top-5 Acc shell
ViViM-T (Ours) 16 77.51 93.27 script.sh
ViViM-S (Ours) 16 80.47 94.75 script.sh

Model ZOO

You can find all the models and the scripts in MODEL_ZOO.

Usage

For finetuning, you can simply run the fine-tuning scripts as follows:

bash ./exp/k400/vivim_tiny/run_f16x224.sh
bash ./exp/k400/vivim_small/run_f16x224.sh

Notes:

  1. Chage DATA_PATH And PREFIX to your data path before running the scripts.
  2. Set --finetune when using masked pretrained model.
  3. The best checkpoint will be automatically evaluated with --test_best.
  4. Set --test_num_segment and --test_num_crop for different evaluation strategies.
  5. To only run evaluation, just set --eval.