Skip to content

Metric is different in logger and progress bar #4199

@MohammedAljahdali

Description

@MohammedAljahdali

Hey
I am recording a metric called Character Error Rate, I was monitoring it through tensorboard logger, I also record some outputs with their CER every 100 batch, and I noticed that the CER is low on the recorded outputs, compared to the epoch CER I saw on tensorboard and I said this might be a lucky batches. Then when I looked on the epoch CER on my progress bar it was so different from the on in tensorboard, and the CER I saw on the examples started to make sense. I don't know how to re-produce this because it's happening during a very long experiment.

Progress bar val_cer_epoch = 0.291:

progress bar

Tensorboard val_cer_epoch = 0.687:
tensorboard

note:
Opening an issue on a project is new for me, so excuse me if I am doing it wrong.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinghelp wantedOpen to be worked on

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions