A Layered Memory Network for MovieQA
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
img
model
README.md
mqa_video+subtitle+question.py
mqa_video+subtitle+update+question.py
mqa_video+subtitle.py
mqa_video+subtitlel+update.py
train_split.json

README.md

Layered Memory Network (LMN)

The LMN model ranked 1st place on MovieQA Video+Subtt-based Answering Challenge 2017 (The Joint Video and Language Understanding Workshop, ICCV 2017).

  • The flowchart of Layered Memory Network (LMN).

LMN

  • The framework of Dynamic Subtitle Memory module with update mechanism.

DSM

Train

python mqa_video+subtitle+update+question.py

Paper

Bo Wang, Youjiang Xu, Yahong Han, Richang Hong. "Movie Question Answering: Remembering the Textual Cues for Layered Visual Contents." AAAI, 2018. [Paper]

@inproceedings{Wang2018,
  author    = {Bo Wang and Youjiang Xu and Yahong Han and Richang Hong},
  title     = {Movie Question Answering: Remembering the Textual Cues for Layered Visual Contents},
  booktitle = {AAAI},
  year      = {2018},
}