Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Comparable SCI Benchmark Proposal #359

Open
Henry-WattTime opened this issue Jun 8, 2023 · 0 comments
Open

Comparable SCI Benchmark Proposal #359

Henry-WattTime opened this issue Jun 8, 2023 · 0 comments

Comments

@Henry-WattTime
Copy link
Contributor

Henry-WattTime commented Jun 8, 2023

In the past the WG has discussed the challenges with calculating a SCI score that can be compared to other scores. The WG is discussing an approach where standardized hardware and workloads are defined that software can be tested on to make different software with the same core functionality comparable. We are scoping out what it would take to establish a standard like this.

The WG is actively working taking notes here:
https://docs.google.com/document/d/1rCNbwKiegUorrtuBuw-Ywdum1rHBWfAL-gsaOmGCcpc/edit#heading=h.3skgaml8cvuo

This addresses questions raised in:
#340 Define Letter (A to G) Based Energy Ratings for a Given Software Application
#233 Investigate a software procurement standard
#326 Repeatability of Energy measurements
#208 Software system boundary requirements for comparing scores
#308 Design Time versus Runtime - I as a constant
#348 Research project on Sustainable Computing
#260 Could we calculate the impact of Algorithm selection on overall carbon emission of the software?
#253 Using SCI to measure purchased software
#244 SCI depends on hardware and usage
#189 Consider how uncertainty from simplification will impact the goals of transferability and comparability

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant