Skip to content

Conversation

@BACtaki
Copy link
Contributor

@BACtaki BACtaki commented Nov 23, 2022

This patch proposes a comparison of builtin functions based on a grouping by ML lifecycle phase and ML task. This patch presents only the basic outline- subsequent patches will do the actual comparison.

@j143
Copy link
Member

j143 commented Nov 23, 2022

Thanks Badrul! Although this is a good idea, try to be familiar with the end to end pipelines or a single phase of the cycle with SystemDS. A plenty of working examples are here:
https://github.com/damslab/reproducibility

Keep posting any updates here though!

@Baunsgaard
Copy link
Contributor

what i think would be really useful in this direction.

  • run experiments that evaluate performance over time of key algorithms and operations
  • automatically plot these, and provide graphs in GitHub actions.

This can also compare to other systems implementations automatically, to include in the graphs.
Optionally it can be an action we run weekly, or monthly?

@j143 j143 changed the title [SYSTEMDS-3468] Adding the outline for the survey of builtin functions [WIP][SYSTEMDS-3468] Adding the outline for the survey of builtin functions Feb 5, 2023
@j143 j143 added this to the next-release milestone Feb 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Unplanned

Development

Successfully merging this pull request may close these issues.

3 participants