Skip to content
Neural Sign Language Translation (CVPR'18)
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
BaseModel update download script Aug 21, 2018
BestModel Added best performing model Mar 8, 2019
Data NSLT Commit May 21, 2018
Mean Fix Mean and Base Model weight location and Added Mean Image Aug 21, 2018
ResizeImages
nslt Update nmt.py Dec 7, 2018
.gitignore Fix Mean and Base Model weight location and Added Mean Image Aug 21, 2018
LICENSE Initial commit Mar 28, 2018
README.md Update README.md Mar 8, 2019

README.md

Neural Sign Language Translation

This repo contains the training and evalution code of Sign2Text setup for translation sign langauge videos to spoken language sentences.

This code is based on an earlier version of Luong et al.'s Neural Machine Translation Tutorial.

Requirements

Usage

Training Sample Usage (From nslt folder)

python -m nmt --src=sign --tgt=de --train_prefix=../Data/phoenix2014T.train --dev_prefix=../Data/phoenix2014T.dev --test_prefix=../Data/phoenix2014T.test --out_dir=<your_output_dir> --vocab_prefix=../Data/phoenix2014T.vocab --source_reverse=True --num_units=1000 --num_layers=4 --num_train_steps=150000 --residual=True --attention=luong --base_gpu=<gpu_id> --unit_type=gru

Inference Sample Usage

python -m nmt --out_dir=<your_model_dir> --inference_input_file=<input_video_paths.sign> --inference_output_file=<predictions.de> --inference_ref_file=<ground_truth.de> --base_gpu=<gpu_id>

Reference

Please cite the paper below if you use this code in your research:

@inproceedings{camgoz2018neural,
  author = {Necati Cihan Camgoz and Simon Hadfield and Oscar Koller and Hermann Ney and Richard Bowden},
  title = {Neural Sign Language Translation},
  booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  year = {2018}
}
You can’t perform that action at this time.