Skip to content


Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time

STPN - Weakly Supervised Action Localization by Sparse Temporal Pooling Network (reproduced)


This repository contains a reproduced code for the paper "Weakly Supervised Action Localization by Sparse Temporal Pooling Network" by Phuc Nguyen, Ting Liu, Gautam Prasad, and Bohyung Han, CVPR 2018.

Usage Guide

  • Hardware : TITAN X GPU


  • Python3
  • Tensorflow 1.6.0
  • numpy 1.15.0
  • OpenCV 3.4.2
  • Sonnet (to extract features from I3D model)
  • Pandas (to evaluate)
  • SciPy 1.1.0


  1. Subsample the video with the sampling ratio of 10 frames per second.
  2. After sampling the video frames, rescale them to make the smallest dimension of the frame equal to 256 while preserving the aspect ratio.
  3. Calculate the Optical Flow (TV-L1)
  4. Save the rgb frames to train_data/rgb and the flow frames to train_data/flows with the name of vid_num/{:06d}.png. (test_data/rgb, test_data/flows for the case of test data) I simply save the videos as 1,2,3,....200 for the convenience.
  1. Extract the feature vector of each video by using the code in the "feature_extraction" folder. The extracted features will be saved in the [train/test]_data/[rgb/flow]_features. Since I use the TITAN X GPU which has 12GB Memory, I extract the feature from 16*100 frames which means 100 segments at each time. If you have the GPU with smaller memory, you should extract the feature with the reduced number of segments. Please refer to the in the folder.

2.Train the Model

  • Run the code.
  • Please refer to the for more details.

3.Test and Extract the Result

  • Run the code.
  • Please refer to the for more details.
  • Note that I excluded two falsely annotated videos, 270, 1496, following the SSN paper.


  • Run the code.
  • Please refer to the for more details.
  • I used the evaluation code from the official ActivityNet repo, as the authors did.

Reproduced Result

With the provided sample checkpoint(files in the code/ckpt/ckpt001), I got the following result for the THUMOS14 test set, which is similar to the paper.

tIoU 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 mAP
STPN(paper) 52.0 44.7 35.5 25.8 16.9 9.9 4.3 1.2 0.1 21.2
Reproduced 52.1 44.2 34.7 26.1 17.7 10.1 4.9 1.3 0.1 21.3

Please note that the best result appears around 22k ~ 25k and sometimes the performance could be slightly different from the numbers above.


If you have any questions or comments, please contact me.


This work was supported by Institute for Information & communications Technology Promotion(IITP) grant funded by the Korea government(MSIT) (2017-0-01780, The technology development for event recognition/relational reasoning and learning knowledge based system for video understanding)




STPN - Weakly Supervised Action Localization by Sparse Temporal Pooling Network







No releases published


No packages published