Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A way to perform activation encoding freezing with aimet_tensorflow #2978

Open
tholmb opened this issue May 22, 2024 · 2 comments
Open

A way to perform activation encoding freezing with aimet_tensorflow #2978

tholmb opened this issue May 22, 2024 · 2 comments

Comments

@tholmb
Copy link

tholmb commented May 22, 2024

aimet_torch has feature to freeze activations with load_and_freeze_encodings() and it goes correctly after applying these changes: #2845.

aimet_tensorflow has just set_and_freeze_param_encodings() for parameter freezing but atleast I don't know the way to freeze activations. Sometimes it is beneficial to freeze input and output activations based on normalization and used bitwidth and it should be handled correctly during QAT. It would be great feature to have also in aimet_tensorflow!

@tholmb
Copy link
Author

tholmb commented May 24, 2024

And for my purposes aimet_tensorflow's keras implementation would be what I need but of course someone else would need it for original aimet_tensorflow.

@tholmb
Copy link
Author

tholmb commented Jun 14, 2024

Any plans to add this feature to new realases of AIMET?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant