Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New PARAM compute Python benchmarks framework #34

Closed
wants to merge 1 commit into from

Conversation

louisfeng
Copy link
Contributor

Summary:
This is the initial version of the new compute benchmarks. It's completely self contained under the python directory and does not change any of the existing benchmarks and workloads. It added the following features:

  • Support a wide variety of PyTorch operators and workloads.
  • Decoupled workload configuration from Python code. It allows building tools in a pipeline to collect operator configuration from production runs, generate microbenchmark inputs, gather metrics.
  • Generates human readable and easy to parse output data format for downstream tools.
  • A library interface allowing external tools to run and collect data results from the microbenchmarks.

For the details, please see the README.md and development.md files.

Differential Revision: D32388812

Summary:
This is the initial version of the new compute benchmarks. It's completely self contained under the python directory and does not change any of the existing benchmarks and workloads. It added the following features:

- Support a wide variety of PyTorch operators and workloads.
- Decoupled workload configuration from Python code. It allows building tools in a pipeline to collect operator configuration from production runs, generate microbenchmark inputs, gather metrics.
- Generates human readable and easy to parse output data format for downstream tools.
- A library interface allowing external tools to run and collect data results from the microbenchmarks.

For the details, please see the README.md and development.md files.

Differential Revision: D32388812

fbshipit-source-id: 81f41e6dc262ee436540344c2a0e799cea6e5694
@facebook-github-bot facebook-github-bot added CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported labels Nov 12, 2021
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D32388812

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 1f0da96.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants