Weights are not logged when model is watched

[stathius]

The gradients of the model are indeed logged but not the parameters.

Using:
pytorch-lightning==1.0.4
torch==1.7.0
torchvision==0.8.1
wandb==0.10.9

mac os x 10.15.7

        logger = pl.loggers.WandbLogger(project=hparams.project_name, save_dir=save_dir)
        logger.log_hyperparams(vars(hparams))
        logger.watch(model, log='all', log_freq=1)

[issue-label-bot]

Issue-Label Bot is automatically applying the label bug to this issue, with a confidence of 0.96. Please mark this comment with 👍 or 👎 to give our bot feedback!

Links: app homepage, dashboard and code for this bot.

[tyomhak]

Hi @stathius , thanks for reporting this issue. We're looking into this.

[tyomhak]

I believe by default it is supposed to log only gradients, but you can change it by using argument log.
Please see the documentation (here) for more details.

[stathius]

I am using the log='all' argument as per the snippet I provide above.

…

On Mon, Nov 9, 2020 at 9:51 AM Artyom Hakobyan ***@***.***> wrote: I believe by default it is supposed to log only gradients, but you can change it by using argument log. Please see the documentation (here <https://docs.wandb.com/library/integrations/pytorch#options>) for more details. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1471 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAPQ4BNOLJNXG76SKXAEQOTSO6NR3ANCNFSM4TMXLVWQ> .

[lukas]

Hm, I tried to replicate this by setting log='all' in https://github.com/wandb/examples/blob/master/examples/pytorch/pytorch-cnn-mnist/main.py and it seemed to work as intended, logging both parameters and gradients - could you try that with your setup

[ariG23498]

Hey @stathius
Did you happen to find the solution to the issue?
It would be great for us if we could close the stale threads if the solution has already been achieved. 😄

[stathius]

Hi @ariG23498 not really but it's fine to close it.

[sbos]

I'm experiencing the same problem. Gradients are logged fine, but parameters don't show up in wandb panels. Is there any way to tell why this is silently failing?

[KarlXing]

I'm having the same issue.

wandb: 0.15.5
torch: 2.1.0.dev20230627+cu121