Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

simulate streaming by forwarding input chunk by chunk #13

Merged
merged 11 commits into from
Dec 17, 2020

Conversation

robin1001
Copy link
Collaborator

No description provided.

Change-Id: Ie7f0a2e3974db8dda923a3966fd514942bd7dcdb
Change-Id: If99555b7f35093a278a76b162637bad6f265f684
Change-Id: I40c7d09e1e50ad78dded92c893885382d79eec48
… still have some bug in conformer

Change-Id: I0ecf52946b1c1244d88141465d9df3156e682d83
@whiteshirt0429
Copy link
Collaborator

+1

whiteshirt0429
whiteshirt0429 previously approved these changes Dec 9, 2020
Change-Id: I81a34c9110fd6156fb30df54aaa116de25a5806c
Change-Id: Iec3cdf204cbc78717cb73b04871179bbf43c4367
Change-Id: I940d6f658ff4aaa159268cb77adf24914a1e8abb
Change-Id: I8c3ed15972794ee4c04370db544bb654c57ab305
Change-Id: I439532b81d2dc6d16c133fa05acc5ae109b7ab80
Change-Id: I7295f9f117f059d8e661581211d9444bebc91d02
wenet/transformer/embedding.py Show resolved Hide resolved
wenet/transformer/embedding.py Show resolved Hide resolved
wenet/transformer/encoder_layer.py Outdated Show resolved Hide resolved
wenet/transformer/encoder_layer.py Show resolved Hide resolved
wenet/transformer/encoder_layer.py Outdated Show resolved Hide resolved
wenet/transformer/encoder.py Show resolved Hide resolved
Change-Id: I065ee1354ee273db728f3192addbc55fbab20ff0
@placebokkk placebokkk merged commit 107b478 into main Dec 17, 2020
@placebokkk placebokkk deleted the binbin-simulate-streaming branch December 17, 2020 12:09
robin1001 added a commit that referenced this pull request Jan 13, 2021
* simple transformer demo works

Change-Id: Ie7f0a2e3974db8dda923a3966fd514942bd7dcdb

* remove embeding cache

Change-Id: If99555b7f35093a278a76b162637bad6f265f684

* support simulate streaming

Change-Id: I40c7d09e1e50ad78dded92c893885382d79eec48

* support conformer cnn cache, transformer works okay, export okay, but still have some bug in conformer

Change-Id: I0ecf52946b1c1244d88141465d9df3156e682d83

* remove position encoding cache again

Change-Id: I81a34c9110fd6156fb30df54aaa116de25a5806c

* export interface for c++ call

Change-Id: Iec3cdf204cbc78717cb73b04871179bbf43c4367

* refine style

Change-Id: I8c3ed15972794ee4c04370db544bb654c57ab305

* change attention_cache to elayers_output_cache

Change-Id: I439532b81d2dc6d16c133fa05acc5ae109b7ab80

* refine forward_attention_decoder to batch mode

Change-Id: I7295f9f117f059d8e661581211d9444bebc91d02

* refine comment

Change-Id: I065ee1354ee273db728f3192addbc55fbab20ff0
wantt referenced this pull request Apr 13, 2022
* [runtime] refactor decoder, asr_model to support more platforms

* fix topo error when rescoring

* support Copy for asr_model

* fix wrong check

* refine copy

* set inter-op thread
@bboyxu5928 bboyxu5928 mentioned this pull request Sep 3, 2022
@jangjun21 jangjun21 mentioned this pull request Oct 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants