Fail to reproduce result from demo video

[CompactSupport]

I tried to reproduce the result of the Mandarin lip reading from the following demo video:

https://youtu.be/FIau-6JA9Po?t=33

I've made a clip "demo_cn.mp4" from this video 0:33-0:41.

My code:

python main.py --config-filename configs/CMLR_V_WER8.0.ini --data-filename inputs/demo_cn.mp4

The output:

load a pre-trained model from: models/CMLR/CMLR_V_WER8.0/model.pth
face tracking speed: 4.90 fps.
hyp: 有一种种的人俗话说的大家人才能真的一年里的一个行

This is different from the one shown in the demo: 中青祝愿大家在新的一年里新春愉快身体健康

I also extracted mouth ROIs from the clip (link).

Would you please let me know if I missed anything?

[zhunge]

set video fps=25 maybe get correct result

[fantasyfw]

Same problem, not able to reproduce the result. Here is my output:

load a pre-trained model from: models/CMLR/CMLR_V_WER8.0/model.pth
face tracking speed: 5.98 fps.
hyp: 我们总结了祖国的大量餐饮新的一天也成了这样

25fps was set in "configs/CMLR_V_WER8.0.ini"

[mostafamdy]

same here. the visual only is not working well but the visual and audio are perfect.