Image plots show proper message and disable button if image is not available

[shcheklein]

This image doesn't exist at in the experiment, refresh doesn't make much sense here.

Might depend on plots error handing cc @mattseddon @pared

[mattseddon]

Depends on treeverse/dvc#7692 & #1649.

[shcheklein]

@shcheklein revisit this, try to reproduce.

We still need error messages, or a signal that plot doesn't exist in the commit.

[mattseddon]

The following is a more detailed example of the OP.

dvc.yaml contains a plots entry which is a directory. E.g:

plots:
    - mispredicted

Mispredicted is a directory of images that are produced by a stage:

  inference:
  ...
    outs:
    - mispredicted

Every time an experiment is run the contents of mispredicted can be completely different. Ideally, we would not show errors for missing files because we expect that the contents are different.

@skshetry we need to consider this scenario whilst working through plot errors. Is it possible to do this with the existing DVC code or do we need to add some indicator to the dvc.yaml entry? I think this situation differs from where there are templates missing from a directory between revisions but happy to be corrected. WDYT?

Original dvc.yaml is here.

[mattseddon]

Can we treat the directory more like a dataset and each image more like a datapoint?

[skshetry]

dvc plots diff does not know if there's an experiment running, and I don't think it should care. Displaying errors (or not) is contextual, so I think it's up to the extension to interpret.

[dberenbaum]

@skshetry I don't think it's related to whether an experiment is running. One revision contains the file mispredicted/6599-... and the other does not.

@mattseddon Is there an error returned here? I don't see one when testing this. I think we just need to show a different message here than 'No plot to display: refresh` (something like N/A or no image at this revision). I see an output like this:

edit: updated json output to reflect #9146

{
  "data": {
    "dir/img1.png": [
      {
        "type": "image",
        "revisions": [
          "workspace"
        ],
        "url": "/Users/dave/repo/dvc_plots/workspace_dir_img1.png"
      }
    ],
    "dir/img2.png": [
      {
        "type": "image",
        "revisions": [
          "workspace"
        ],
        "url": "/Users/dave/repo/dvc_plots/workspace_dir_img2.png"
      },
      {
        "type": "image",
        "revisions": [
          "main"
        ],
        "url": "/Users/dave/repo/dvc_plots/main_dir_img2.png"
      }
    ]
  }
}

@shcheklein What do you want to show in this scenario?

Some thoughts on what I'd expect:

• Grouping by directory paths. Seeing all cats, dogs, muffins, etc. together would help organize it.
• Showing the number of images per revision per directory. At least then I'd easily know whether there are more misclassified dogs or cats in each revision.

[skshetry]

@dberenbaum, this output does not seem like it's from my patch.