Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Channelwise Quantization Tests #2283

Merged
merged 19 commits into from
May 28, 2024
Merged

Channelwise Quantization Tests #2283

merged 19 commits into from
May 28, 2024

Conversation

Satrat
Copy link
Contributor

@Satrat Satrat commented May 14, 2024

  • Update e2e regression tests for channelwise scale and zero-point, added channelwise recipe
  • Refactored 1.1b test to run on a nightly cadence, 15M will run on commit

@Satrat Satrat marked this pull request as ready for review May 14, 2024 14:57
bfineran
bfineran previously approved these changes May 15, 2024
rahul-tuli
rahul-tuli previously approved these changes May 15, 2024
@Satrat Satrat dismissed stale reviews from rahul-tuli and bfineran via 6df5654 May 15, 2024 14:48
@dbogunowicz
Copy link
Contributor

LGTM, but the runner is now arguably not running any transformers jobs:

Requested labels: k8s-eng-gpu-64G-v100-32G
Job defined at: neuralmagic/sparseml/.github/workflows/test-check.yaml@refs/pull/2283/merge
Waiting for a runner to pick up this job...

bfineran
bfineran previously approved these changes May 20, 2024
@Satrat Satrat requested a review from dsikka May 20, 2024 20:04
bfineran
bfineran previously approved these changes May 20, 2024
dsikka
dsikka previously approved these changes May 22, 2024
Copy link
Contributor

@dsikka dsikka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good and applies the framework correctly

Only suggestion would be organizing test_quantization a little bit so that it's easier to follow (i.e private methods at the top, putting tearDown at the end, if the tests rely on inputs/outputs from a previous test, organized to follow that order and a quick comment/docstring to explain the flow)

@Satrat Satrat dismissed stale reviews from dsikka and bfineran via 598fb7e May 23, 2024 13:33
@Satrat Satrat requested review from dsikka and bfineran May 23, 2024 14:15
@bfineran bfineran merged commit c530bbf into main May 28, 2024
17 checks passed
@bfineran bfineran deleted the sa/channel_group_tests branch May 28, 2024 19:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants