Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make it possible to determine programmatically which instances.jsonis being used for a run #12

Closed
davidschlangen opened this issue Nov 1, 2023 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@davidschlangen
Copy link
Contributor

A version of the clembench benchmark is determined by a) the set of games that is run and b) the instances for each game. At the moment, this information is distributed over various places:

  • Which set of games is run is determined by the calls collected for example in pipeline_clembench.sh
  • The instances on which they are run is determined by whatever is placed in in/instances.json for each game at the time when the game is run.

Assuming that the set of games constitutes the major version number, and the set of instances the minor version number, it would be good if this information could be consolidated.

One way of doing this would be to make it possible for different instances.json to live in in/, and make them addressable via the version number. At the moment, AFAIK this is not exposed via the code.

@phisad
Copy link
Collaborator

phisad commented Feb 20, 2024

Duplicated of #12

@phisad phisad closed this as completed Feb 20, 2024
@davidschlangen
Copy link
Contributor Author

Duplicate of #36 , in a way...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants