Skip to content

Commit 35efed5

Browse files
authored
Change the GPT-J example configure setting (#343)
Signed-off-by: Cheng, Penghui <penghui.cheng@intel.com>
1 parent dec0bcb commit 35efed5

File tree

1 file changed

+3
-2
lines changed
  • examples/pytorch/nlp/huggingface_models/language-modeling/quantization/ptq_static/fx

1 file changed

+3
-2
lines changed

examples/pytorch/nlp/huggingface_models/language-modeling/quantization/ptq_static/fx/run_clm.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -555,9 +555,10 @@ def eval_func_for_nc(model_tuned):
555555
return eval_loss
556556

557557
if model_args.tune:
558-
from neural_compressor.config import PostTrainingQuantConfig
558+
from neural_compressor.config import AccuracyCriterion, PostTrainingQuantConfig
559559
from neural_compressor import quantization
560-
conf = PostTrainingQuantConfig()
560+
accuracy_criterion = AccuracyCriterion(higher_is_better=False, tolerable_loss=0.5)
561+
conf = PostTrainingQuantConfig(accuracy_criterion=accuracy_criterion)
561562
q_model = quantization.fit(model,
562563
conf,
563564
calib_dataloader=trainer.get_eval_dataloader(),

0 commit comments

Comments
 (0)