Skip to content

Conversation

james77777778
Copy link
Collaborator

This will reduce memory requirements for quantization due to the large size of the embedding layer in general.
Note that I have made this PR compatible with Keras from 3.4.0 to the latest.

BTW, once new version of Keras is released, I can propose a refactor of quantize in ReversibleEmbedding, also considering compatibility. IMO, it is quite ugly now :(

Copy link
Member

@mattdangerw mattdangerw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks!

@mattdangerw mattdangerw merged commit 2905468 into keras-team:master Jul 31, 2024
@james77777778 james77777778 deleted the add-to-numpy-support branch August 2, 2024 02:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants