Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BugReport] Confusion Matrix doesn't appear as output artifact #4386

Open
allinorcannon opened this issue Jan 23, 2024 · 0 comments
Open

[BugReport] Confusion Matrix doesn't appear as output artifact #4386

allinorcannon opened this issue Jan 23, 2024 · 0 comments
Labels
bug component: experiments Relates to the SageMaker Experiements Platform

Comments

@allinorcannon
Copy link

Describe the bug
After calling log_confusion_matrix only the test confusion matrix is shown in the charts section,while nothing is shown in the output artifacts section (Screenshots provided in the appropriate section).
When using aws-cli all three of the confusion matrices generated by the code are visible, as on the s3, so this is not a code issue. I believe this is a bug, since it clearly states in the documentation of the function that the 'is_output' argument ensures that the confusion_matrix is depicted as an output artifact.
To reproduce
Train a model in sagemaker within an experiments run context, use the log_confusion_matrix and wait for the results.
Expected behavior
Confusion matrices should be available as output artifacts via the Sagemaker Studio UI
Screenshots or logs
image
image
System information
A description of your system. Please provide:

  • SageMaker Python SDK version: 2.199.0
  • Framework name (eg. PyTorch) or algorithm (eg. KMeans): PyTorch
  • Framework version: 2.0.1
  • Python version: Python 3.10.6
  • CPU or GPU: GPU
  • Custom Docker image (Y/N): Y
    Additional context
    Another thing would be the possibility of seeing all confusion matrices - it would be very useful and a quick adjustment since they are generated to s3 either way.
@knikure knikure added the component: experiments Relates to the SageMaker Experiements Platform label Apr 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug component: experiments Relates to the SageMaker Experiements Platform
Projects
None yet
Development

No branches or pull requests

2 participants