Skip to content
No description, website, or topics provided.
Branch: master
Clone or download
Latest commit 46f3a2a Jun 30, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
MyConvLSTACell.py lsta-rgb Jun 13, 2019
README.md Update README.md Jun 29, 2019
attentionModel.py lsta-rgb Jun 13, 2019
gen_splits.py lsta-rgb Jun 13, 2019
main_rgb.py lsta-rgb Jun 13, 2019
makeDataset.py lsta-rgb Jun 13, 2019
resNetNew.py lsta-rgb Jun 13, 2019
spatial_transforms.py lsta-rgb Jun 13, 2019
test_rgb.py lsta-rgb Jun 13, 2019
test_rgb.sh lsta-rgb Jun 13, 2019
train_rgb.sh lsta-rgb Jun 13, 2019

README.md

LSTA: Long Short-Term Attention for Egocentric Action Recognition

We release the PyTorch code of LSTA

LSTA

Reference

Please cite our paper if you find the repo and the paper useful.

@InProceedings{Sudhakaran_2019_CVPR,
author = {Sudhakaran, Swathikiran and Escalera, Sergio and Lanz, Oswald},
title = {{LSTA: Long Short-Term Attention for Egocentric Action Recognition}},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019}
}

Prerequisites

  • Python 3.5
  • Pytorch 0.3.1

Training

  • RGB

To train the models, run the script train_rgb.sh, which contains:

python main_rgb.py --dataset gtea_61 --root_dir dataset --outDir experiments --stage 1 \
                   --seqLen 25 --trainBatchSize 32 --numEpochs 200 --lr 0.001 --stepSize 25 75 150 \
                   --decayRate 0.1 --memSize 512 --outPoolSize 100 --evalInterval 5 --split 2

Evaluation

Testing on the trained models can be done by running the script test_rgb.sh

Pretrained models

The pre-trained models can be downloaded from the following Google Drive link

TODO

  1. EPIC-KITCHENS code
  2. Flow and two stream codes
  3. Pre-trained models
You can’t perform that action at this time.