Skip to content

Conversation

@Kaihui-intel
Copy link
Contributor

@Kaihui-intel Kaihui-intel commented Sep 12, 2025

Type of Change

feature or bug fix or documentation or validation or others
API changed or not

Description

        fp32_model = copy.deepcopy(self.gptj)
        quant_config = AutoRoundConfig(nsamples=32, seqlen=10, iters=10, amp=False ,scale_dtype="fp16", 
                                       scheme=scheme, export_format="llm_compressor")
        logger.info(f"Test AutoRound with config {quant_config}")

        # quantizer execute
        model = prepare(model=fp32_model, quant_config=quant_config)
        run_fn(model, self.dataloader)
        q_model = convert(model)

Expected Behavior & Potential Risk

the expected behavior that triggered by this PR

How has this PR been tested?

how to reproduce the test (including hardware information)

Dependency Change?

any library dependency introduced or removed

Kaihui-intel and others added 2 commits September 12, 2025 13:59
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
Signed-off-by: Kaihui-intel <kaihui.tang@intel.com>
@XuehaoSun XuehaoSun merged commit 75e1be0 into master Sep 18, 2025
16 of 22 checks passed
@XuehaoSun XuehaoSun deleted the kaihui/ar_v0.7 branch September 18, 2025 07:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants