Skip to content

convrot: add a hook to run post-quant custom setup when needed - #2891

Merged
bghira merged 1 commit into
mainfrom
feature/base-convrot-support
Jul 25, 2026
Merged

convrot: add a hook to run post-quant custom setup when needed#2891
bghira merged 1 commit into
mainfrom
feature/base-convrot-support

Conversation

@bghira

@bghira bghira commented Jul 25, 2026

Copy link
Copy Markdown
Owner

This pull request introduces a new extensibility hook to support additional setup steps after manual quantization of models. The main changes involve adding a post_quantization_setup method to the base model class and invoking this hook in the training process after quantization is applied.

Model extensibility improvements:

  • Added a post_quantization_setup method to the base model class in common.py as a hook for model families that require extra setup after manual quantization.

Training process integration:

  • Updated the training pipeline in trainer.py to call post_quantization_setup on the model after quantization is performed, ensuring any necessary post-quantization steps are executed.

@bghira
bghira merged commit 9ef9f1c into main Jul 25, 2026
2 checks passed
@bghira
bghira deleted the feature/base-convrot-support branch July 25, 2026 14:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant