Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please publish train_state_unpadded_shape_dtype_struct #41

Open
sdmorrey opened this issue May 18, 2024 · 4 comments
Open

Please publish train_state_unpadded_shape_dtype_struct #41

sdmorrey opened this issue May 18, 2024 · 4 comments

Comments

@sdmorrey
Copy link

We really need this file very soon the model will not run at all

Restored checkpoint in 6.29 seconds. Jitting decoding. ERROR:absl:For checkpoint version > 1.0, we require users to provide train_state_unpadded_shape_dtype_struct during checkpoint saving/restoring, to avoid potential silent bugs when loading checkpoints to incompatible unpadded shapes of TrainState.

@rajatsen91
Copy link
Collaborator

I just checked in a fresh install. Model loading and inference still works despite of that error message. Please verify whether you can run inference. If so, for now please treat this ERROR:absl as a warning not an error.

@sf19881108
Copy link

I have downloaded the model locally and encountered an error while running the code:
Constructed model weights in 1.72 seconds.
Restoring checkpoint from model/timesfm-1.0-200m/checkpoints/.
WARNING:absl:No registered CheckpointArgs found for handler type: <class 'paxml.checkpoints.FlaxCheckpointHandler'>
WARNING:absl:Configured CheckpointManager using deprecated legacy API. Please follow the instructions at https://orbax.readthedocs.io/en/latest/api_refactor.html to migrate by May 1st, 2024.
WARNING:absl:train_state_unpadded_shape_dtype_struct is not provided. We assume train_state is unpadded.
ERROR:absl:For checkpoint version > 1.0, we require users to provide
train_state_unpadded_shape_dtype_struct during checkpoint
saving/restoring, to avoid potential silent bugs when loading
checkpoints to incompatible unpadded shapes of TrainState.
Restored checkpoint in 0.95 seconds.
Jitting decoding.
Does anyone knows how to deal it?

@godcrying
Copy link

It has been 23 July. Maybe no one knows how to deal it.

@HuangY0
Copy link

HuangY0 commented Aug 18, 2024

Just wait for the jitting to end

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants