This repository has been archived by the owner on Jan 15, 2024. It is now read-only.

[Decoding] Update incremental decoding implementation #1583

Draft

barry-jin wants to merge 1 commit into master from fix-incremental-decoding

Contributor

barry-jin commented Mar 15, 2022

Description

Try to fix #1582: Update incremental decoding caching mechanism.

Checklist

Essentials

PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
Changes are complete (i.e. I finished coding on this PR)
All changes have test coverage
Code is well-documented

Changes

Feature1, tests, (and when applicable, API doc)
Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

cc @dmlc/gluon-nlp-team


          [Decoding] Update incremental decoding implementation

386d7a7

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.