Skip to content

feat(benchmarks): Implement the benchmarking system #44

@christian-pinto

Description

@christian-pinto

Description

Implement the benchmarking framework designed in #8.

Sub-issues:

  • Implementing the GitHub Runner, deploying it and connecting it to GitHub triggers as per test(benchmark): define benchmark contribution protocol #8
  • Extending Nexus Package YAML to allow specifying benchmarks
  • Extend Nexus CLI to list benchmarks
  • Update Nexus package management so benchmark experiment packages can be added and installed
  • Setup ado+ray execution environment (RayCluster)

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions