Skip to content

MayankPalan2004/LipNet

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

LipNet: End-to-End Sentence-level Lipreading

Tensorflow implementation of the method described in the paper LipNet: End-to-End Sentence-level Lipreading by Yannis M. Assael, Brendan Shillingford, Shimon Whiteson, and Nando de Freitas (https://arxiv.org/abs/1611.01599).

I have made a few changes to the method used in the paper -

  • Instead of using all 32 speakers in the GRID Dataset, I have used only 1 so as to save training time and computational resources.
  • The paper uses dlib for extracting the lip region.I have done it statically myself so as to keep it straight forward

Model

163DC9D2-78EE-46A9-A135-30451741397C

Results

Sentence spoken

03CCAA0E-B144-44CB-A54C-B544017D5BC9 A679C56E-0CE4-4B78-820B-7484677111CA

Predictions

F2A63F44-3DD4-46E6-B1B0-FA45AA536481 0C4D2B74-7078-4873-9EEA-816D03761849

About

Tensorflow Implementation of LipNet

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published