Skip to content

[FEA] Support eval mode in dynamicemb #35

@jiashuy

Description

@jiashuy

Is your feature request related to a problem? Please describe.
Under eval mode in pytorch, we shouldn't change the weight.
However, HKV may evict keys in the dynamicemb's forward, causing weigth changes.

Describe the solution you'd like
Identify the status(model.train() / model.eval()) and select different code paths in dynamicemb.
For eval mode, using find and not find_or_insert to lookup the HKV.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions