Implement shard parallelism configuration and update documentation#1942
Merged
Conversation
Signed-off-by: Xin He <xin3.he@intel.com>
Signed-off-by: Xin He <xin3.he@intel.com>
Contributor
|
/azp run Unit-Test-CUDA-AutoRound |
|
Azure Pipelines successfully started running 1 pipeline(s). |
Signed-off-by: Xin He <xin3.he@intel.com>
Signed-off-by: Xin He <xin3.he@intel.com>
Signed-off-by: Xin He <xin3.he@intel.com>
…on config tests Signed-off-by: Xin He <xin3.he@intel.com>
Contributor
|
/azp run Unit-Test-CUDA-AutoRound |
|
Azure Pipelines successfully started running 1 pipeline(s). |
Signed-off-by: Xin He <xin3.he@intel.com>
Signed-off-by: Xin He <xin3.he@intel.com>
changwangss
approved these changes
Jun 24, 2026
wenhuach21
approved these changes
Jun 24, 2026
Contributor
|
/azp run Unit-Test-CUDA-AutoRound |
|
Azure Pipelines successfully started running 1 pipeline(s). |
wenhuach21
reviewed
Jun 24, 2026
Signed-off-by: Xin He <xin3.he@intel.com>
Contributor
|
/azp run Unit-Test-CUDA-AutoRound |
|
Azure Pipelines successfully started running 1 pipeline(s). |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This pull request introduces and documents a new environment variable,
AR_MODEL_FREE_SHARD_PARALLELISM, which controls the number of shards processed concurrently during model-free quantization. It also adds comprehensive tests for the new parallelism policy, updates documentation (both English and Chinese) to explain the variable and its effects (including benchmarks), and adds a new test for quantization config building. These changes improve configurability, transparency, and reliability of model-free quantization.Environment variable and configuration support:
AR_MODEL_FREE_SHARD_PARALLELISMenvironment variable toauto_round/envs.pyto control model-free quantization parallelism, including logic for auto-policy and environment override. [1] [2]Documentation updates:
AR_MODEL_FREE_SHARD_PARALLELISMin both English and Chinese environment variable guides, including description, default policy, usage, and examples. [1] [2]Testing and validation:
_build_quantization_configfunction in the test module.Parallelism Benefit Table (Using Rounded Minutes)
Type of Change
New feature
Related Issues
Fixes or relates to #
Checklist Before Submitting
/azp run Unit-Test-CUDA-AutoRound.