Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

results on ActionGenome dataset #7

Open
NingWang2049 opened this issue Dec 16, 2022 · 1 comment
Open

results on ActionGenome dataset #7

NingWang2049 opened this issue Dec 16, 2022 · 1 comment

Comments

@NingWang2049
Copy link

@gorjanradevski Dear author, I downloaded the STLT model on Action Genome Oracle and tried to run the following code, but the map is 58.75, slightly lower than 60.6 in the paper. Can you tell me why?
`(dp-env) wn@node01:~/temp/STLT$ python inference.py --test_dataset_path "data/ActionGenome/val_dataset.json" --batch_size 1 --dataset_type "layout" --model_name "stlt" --checkpoint_path "checkpoints/action_genome_gt_stlt.pt" --dataset_name "action_genome" --labels_path "data/ActionGenome/labels.json" --videoid2size_path "data/ActionGenome/videoid2size.json"
INFO:root:Preparing dataset...
INFO:root:Inference on 1814
INFO:root:Preparing model...
INFO:root:==================================
INFO:root:The model's configuration is:

  • Unique categories: 38
  • Number of classes: 157
  • Hidden size: 768
  • Hidden dropout probability: 0.1
  • Layer normalization epsilon: 1e-12
  • Number of attention heads: 12
  • Number of spatial layers: 4
  • Number of temporal layers: 8
  • Max number of layout frames: 256
  • The backbone path is: None
  • Freezing the backbone: False
    INFO:root:==================================
    INFO:root:Starting inference...
    100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1814/1814 [00:37<00:00, 48.10it/s]
    INFO:root:=================================
    INFO:root:The metrics are:
    INFO:root:map: 58.75
    INFO:root:=================================
    `
@gorjanradevski
Copy link
Owner

Hi @NingWang2049,

Thanks for you interest in our work. I'll have look these days to find the culprit and I'll let you know.

Best,
Gorjan

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants