-
Notifications
You must be signed in to change notification settings - Fork 74
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Create benchmarking tools for tracking run and measurement data in tt-metal model tests #9648
Closed
5 tasks done
Labels
Comments
skhorasganiTT
added
infra-ci
infrastructure and/or CI changes
falcon_7B
LLM_feature
LLMs on Metal
labels
Jun 24, 2024
skhorasganiTT
added a commit
that referenced
this issue
Jun 24, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 24, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 24, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 24, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 24, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 25, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 25, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 25, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 25, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 25, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 25, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 26, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
skhorasganiTT
added a commit
that referenced
this issue
Jun 26, 2024
…h Falcon7b example) and model-demo utilities for verifying tokens/perf Signed-off-by: Salar Hosseini <skhorasgani@tenstorrent.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Create a set of utility functions for logging info/statistics in model tests. These utility functions should create CSV artifacts that will be ingested by CI for tracking in subsequent infra tools. The tools should be initially tested on model demos as they are key deliverables.
cc @uaydonat
The text was updated successfully, but these errors were encountered: