Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

latte模型的pos_embed没有被正确初始化 #255

Open
WeYeYeYeYe opened this issue Sep 6, 2024 · 2 comments
Open

latte模型的pos_embed没有被正确初始化 #255

WeYeYeYeYe opened this issue Sep 6, 2024 · 2 comments

Comments

@WeYeYeYeYe
Copy link

在运行latte模型时,出现如下报错,检查 pos_embed的确没有被正确初始化,返回为none
Traceback (most recent call last):
File "/xDiT/./examples/latte_example.py", line 78, in
main()
File "/xDiT/./examples/latte_example.py", line 39, in main
output = pipe(
File "/miniconda3/envs/xdit/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "/xDiT/xfuser/model_executor/pipelines/base_pipeline.py", line 133, in data_parallel_fn
return func(self, *args, **kwargs)
File "/xDiT/xfuser/model_executor/pipelines/base_pipeline.py", line 149, in check_naive_forward_fn
return func(self, *args, **kwargs)
File "/xDiT/xfuser/model_executor/pipelines/pipeline_latte.py", line 298, in call
noise_pred = self.transformer(
File "/miniconda3/envs/xdit/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/miniconda3/envs/xdit/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
File "/xDiT/xfuser/model_executor/models/transformers/latte_transformer_3d.py", line 111, in forward
hidden_states = self.pos_embed(
TypeError: 'NoneType' object is not callable

@dannyxiaocn
Copy link
Contributor

我没太遇到这个问题,你试着回退一下diffusers版本看一下?

@feifeibear
Copy link
Collaborator

Could you please report the diffusers version you used?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants