Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Availability definition #117

Open
wants to merge 7 commits into
base: master
Choose a base branch
from
Open

Availability definition #117

Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
97000f1
Update submission_rules.adoc
nv-rborkar Jan 13, 2022
77d060e
Merge branch 'mlcommons:master' into nv-rborkar-availability
nv-rborkar Jul 20, 2022
2fdd558
Update submission_rules.adoc
nv-rborkar Jul 20, 2022
2418bca
Update submission_rules.adoc
nv-rborkar Jul 20, 2022
97b1117
Update submission_rules.adoc
nv-rborkar Jul 28, 2022
f7789c4
Update submission_rules.adoc
nv-rborkar Jul 28, 2022
0fd6a8c
Update submission_rules.adoc
nv-rborkar Aug 4, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
5 changes: 2 additions & 3 deletions submission_rules.adoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -738,14 +738,13 @@ Results will be divided into categories based on the availability of the hardwar

#### Available Systems

_Available_ cloud systems must (1) have available pricing (either publicly advertised or available by request), (2) have been rented by at least one third party, (3) have public evidence of availability (web page saying product is available, statement by company, etc), and (4) be “reasonably available” for rent by additional third parties by the submission date.
_Available_ cloud systems must (1) have available pricing (either publicly advertised or available by request), (2) have been rented by at least one third party customer for use (eg: ML or compute use), (3) have public evidence of availability (web page saying product is available and public statement by company), and (4) be “reasonably available” for rent by additional third party customers by the submission date.

An on-premise system is _Available_ if all of its components that substantially determine ML performance are _Available_ either individually or in aggregate (development boards that meet the substantially determine clause are allowed). An _Available_ component or system must (1) have available pricing (either publicly advertised or available by request), (2) have been shipped to at least one third party, (3) have public evidence of availability (web page saying product is available, statement by company, etc), and (4) be “reasonably available” for purchase by additional third parties by the submission date. In addition, submissions for on-premise systems must describe the system and its components in sufficient detail to enable third parties to build a similar system.
An on-premise system is _Available_ if all of its components that substantially determine ML performance are _Available_ either individually or in aggregate (commercially available development boards that meet the substantially determine clause are allowed). An _Available_ component or system must (1) have available pricing (either publicly advertised or available by request), (2) have been shipped to at least one third party customer for use (eg: ML or compute use; System vendor partners do not qualify as customers), (3) have public evidence of availability (web page saying product is available and public statement by company), and (4) be “reasonably available” for purchase by additional third parties by the submission date. In addition, submissions for on-premise systems must describe the system and its components in sufficient detail to enable third parties to build a similar system.

In both cases, “reasonably available” means:



1. Supply and lead times are appropriate for system scale, i.e. on-demand and in quantity for the smallest systems and a few months and with limited supply for the largest systems.
2. Access to rent or purchase may be subject to conditions that are common to generally available products (such as financial qualifications, size of customer, support burden, export restrictions, etc.) but is not otherwise restricted (i.e. no “early access” approval requirements).

Expand Down