Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Options] Add option for controlling parallel build with number of jobs or memory reserved for each job #230

Merged
merged 10 commits into from May 24, 2023

Conversation

xinli-git
Copy link
Collaborator

Add a new option for parallel tune. When unset, this keeps the original behavior but can be further modified.

  • num_jobs: the maximum number of parallel jobs the user wishes to launch
  • mem_gb_per_job: the memory reserved for each job. This takes precedence if the number of jobs available to launch is less than num_jobs.

@xinli-git xinli-git changed the title Parallel build [Options] Add option for controlling parallel build with number of jobs or memory reserved for each job May 16, 2023
Copy link
Member

@yaoyaoding yaoyaoding left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @xinli-git, thanks for the PR.

I prefer the name max_parallel_jobs or max_num_workers to num_jobs. And leave some minor suggestions.

python/hidet/driver.py Outdated Show resolved Hide resolved
python/hidet/driver.py Outdated Show resolved Hide resolved
python/hidet/option.py Outdated Show resolved Hide resolved
python/hidet/option.py Outdated Show resolved Hide resolved
python/hidet/option.py Outdated Show resolved Hide resolved
python/hidet/option.py Outdated Show resolved Hide resolved
python/hidet/option.py Outdated Show resolved Hide resolved
@yaoyaoding
Copy link
Member

Thanks @xinli-git ! Looks good to me. Feel free to merge after passing the CI.

@xinli-git xinli-git merged commit 6152bc9 into hidet-org:main May 24, 2023
2 checks passed
@xinli-git xinli-git deleted the parallel_build branch May 24, 2023 00:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants