Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Help wanted] Exporting updated zipformer to ONNX #1094

Open
2 tasks
csukuangfj opened this issue May 24, 2023 · 3 comments
Open
2 tasks

[Help wanted] Exporting updated zipformer to ONNX #1094

csukuangfj opened this issue May 24, 2023 · 3 comments

Comments

@csukuangfj
Copy link
Collaborator

csukuangfj commented May 24, 2023

#1058 adds updated zipformer.

However, we only have torch.jit.script() support for it at present.

We need to export it to onnx so that it can be used in sherpa-onnx

Help from the community is highly appreciated.

The task

We need to support both streaming and non-streaming versions.
Specifically, for the streaming version, we need to add the following files:

Please also have a look at https://github.com/k2-fsa/icefall/blob/master/egs/librispeech/ASR/zipformer/export.py

For the non-streaming version, we need to do similar things.

The non-streaming version is easier since it does not need to consider the intermediate states of the model.

TODO

  • Support non-streaming zipformer
  • Support streaming zipformer
@kakashidan
Copy link
Contributor

I wanna have a try :)
Hope I could finish this task in half a month

@csukuangfj
Copy link
Collaborator Author

I wanna have a try :)

Hope I could finish this task in half a month

Thanks!

@kafan1986
Copy link

@kakashidan Thanks for trying. I hope you can complete the task successfully and earlier. All the best.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants