You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
However, doing this creates eval/other_accuracy due to the way rewrite_logs works. Ideally I'd like it to be other/accuracy.
My request is to have a clear way in the training_args to add any prefixes to the metrics, either for train or eval datasets.
Motivation
I want to train multiple models within the same wandb run. As things stand right now, the metrics clash
Your contribution
I've contributed to other OS projects but I'm not very familiar with the codebase to do the contribution directly. If someone guides me around with a high-level description, happy to do it myself
The text was updated successfully, but these errors were encountered:
Feature request
Today, if we create a
Trainer
as inand do
trainer.train()
:train
dataset metrics (at least that I'm aware of)eval/
into anything by changing the above intoHowever, doing this creates
eval/other_accuracy
due to the way rewrite_logs works. Ideally I'd like it to beother/accuracy
.My request is to have a clear way in the training_args to add any prefixes to the metrics, either for train or eval datasets.
Motivation
I want to train multiple models within the same wandb run. As things stand right now, the metrics clash
Your contribution
I've contributed to other OS projects but I'm not very familiar with the codebase to do the contribution directly. If someone guides me around with a high-level description, happy to do it myself
The text was updated successfully, but these errors were encountered: