TensorBoardImageHandler for multiple branches

[OmarAshkar]

Is your feature request related to a problem? Please describe.
I have a problem using TensorBoardImageHandeler in 2 ways. I have have code snippet below. First, during each epoch, the index of the image is not fixed, so I always get new image and corresponding label and output.

Second, if I tried to add extra images, there is no way to point to with other labels. In case here, I want to change NC to NP branch.

        TensorBoardImageHandler(log_dir=log_dir, 
                                max_channels = 3,
                                batch_transform=from_engine(keys=["image", "label"]),
                                output_transform=from_engine_hovernet(keys=["pred"], nested_key=HoVerNetBranch.NC.value),
                               )

Describe the solution you'd like
Ideally , the image will be fixed to specific index, and I am able to point to different tag names for the handler, so extra branches can be incorporated.

Thanks A lot!

[OmarAshkar]

Hi @KumoLiu. If you may help me here. I used the TensorBoardImageHandler as above, but it seems to keep generating random patches. Also, I am not able to use it multiple times to capture multiple branches.

Thanks!

[KumoLiu]

Hi @omashkartrx, thanks for your interest here!

• For the first question, I think we already fix the index of which element to plot, default is the first element.

MONAI/monai/handlers/tensorboard_handlers.py

Line 364 in 10faf46

index: plot which element in a data batch, default is the first element.

But if you add TensorBoardImageHandler in the trainer, it may generate random patches since the data in the training dataset is shuffled every epoch.

• For the second one, seems we indeed hard-coded the tag name for image/label/output.

MONAI/monai/handlers/tensorboard_handlers.py

Line 424 in 10faf46

tag="input_0",

MONAI/monai/handlers/tensorboard_handlers.py

Line 444 in 10faf46

tag="input_1",

MONAI/monai/handlers/tensorboard_handlers.py

Line 464 in 10faf46

tag="output",

Maybe we could add more flexibility for this handler, such as adding a new flag called tag_names.
What do you think? @wyli @Nic-Ma