OpenESL: Sign Language Translation/Recognition using Event Camera

🎯 Update Log:

• [Aug-19, 2024] Event-CSL Benchmark Dataset for Sign Language Translation is released.

🎯 VECSL Benchmark Dataset

[arXiv:2503.06484] Sign Language Translation using Frame and Event Stream: Benchmark Dataset and Algorithms, Xiao Wang, Yuehang Li, Fuling Wang, Bo Jiang, Yaowei Wang, Yonghong Tian, Jin Tang, Bin Luo, arXiv:2503.06484 [Paper] [Demo Video (1:23sec)]

vecsl_github_demo.mp4

🎯 Event-CSL Benchmark Dataset

[arXiv:2408.10488] Event Stream based Sign Language Translation: A High-Definition Benchmark Dataset and A New Algorithm, Xiao Wang, Yao Rong, Fuling Wang, Jianing Li, Lin Zhu, Bo Jiang, Yaowei Wang, arXiv 2024,
[Paper]

sign_demo.mp4

Other Materials

• [Paper with code]: https://paperswithcode.com/task/sign-language-recognition/codeless
• [Awesome-Sign-Language]: https://github.com/ZechengLi19/Awesome-Sign-Language

📰 Citation

If you find this work helps your research, please star this GitHub and cite the following papers:

@misc{wang2024EventCSL,
      title={Event Stream based Sign Language Translation: A High-Definition Benchmark Dataset and A New Algorithm}, 
      author={Xiao Wang and Yao Rong and Fuling Wang and Jianing Li and Lin Zhu and Bo Jiang and Yaowei Wang},
      year={2024},
      eprint={2408.10488},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2408.10488}, 
}

If you have any questions about these works, please feel free to leave an issue.