Skip to content

getBatch() was not called when doing int8 calibration #546

@le8888e

Description

@le8888e

Hello,
I tried to quantize an onnx model by int8 calibration. I used class BatchStream and Int8EntropyCalibrator2 and tried calibration data format of .batch and .ppm. In both cases, getBatchSize(), readCalibrationCache() and writeCalibrationCache() was called but getBatch() was not. So I can't get a right calibration table.
Could you please tell me what is probably going wrong? Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions