Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Q]KeyError between pytorch lightning and wandb #6768

Open
hml1996-fight opened this issue Dec 23, 2023 · 2 comments
Open

[Q]KeyError between pytorch lightning and wandb #6768

hml1996-fight opened this issue Dec 23, 2023 · 2 comments
Labels
c:integration Component: Integration

Comments

@hml1996-fight
Copy link

I tried using WandbLogger in pytorch lightning.
I use WandbLogger to record metrics and ModelCheckpoint to save models.
There is no problems in training and the wandb project's state is Finished.
But it shows an KeyError during testing when i use model.load_from_checkpoint(checkpoint_path) to load.
This error is pointing step by step:
self.save_hyperparameters() -> wandb.sdk.service.server_sock.py
image
the key is 2oxzo496, but I can find it in web pages and local folders.

@rsanandres-wandb
Copy link
Contributor

Hello @hml1996-fight !

Could you provide the code snippet that you are using to load the checkpoint? It seems that your multithreading is attempting to create multiple threads but it is running issues at that step. How are you using multithreading in your code?

Also, it looks like the KeyError is referring to the run id 2oxzo496. Can you verify that this run exists?

Copy link

Raphael San Andres commented:
Hi, since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!

@kptkin kptkin added the c:integration Component: Integration label Mar 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
c:integration Component: Integration
Projects
None yet
Development

No branches or pull requests

3 participants