Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

RuntimeError: memory format option is only supported by strided tensors #105

Closed
xuhzyy opened this issue Mar 18, 2024 · 10 comments
Closed

RuntimeError: memory format option is only supported by strided tensors #105

xuhzyy opened this issue Mar 18, 2024 · 10 comments

Comments

@xuhzyy
Copy link

xuhzyy commented Mar 18, 2024

No description provided.

@tanghaom
Copy link

不要使用apex就可以了，配置文件里把enable_layernorm_kernel设为False

@lyc6749
Copy link

lyc6749 commented Mar 19, 2024

不要使用apex就可以了，配置文件里把enable_layernorm_kernel设为False

设置为False，依然报错

@wileewang
Copy link

Same issue

@WillDreamer
Copy link

不要使用apex就可以了，配置文件里把enable_layernorm_kernel设为False

设置为False，依然报错

@WillDreamer
Copy link

兄弟们，只要把modelng_t5.py的264-275行注释掉就infer起来了

@ipp1215
Copy link

ipp1215 commented Mar 20, 2024

这些方法都试了，还是没法解决我的问题

@ipp1215
Copy link

ipp1215 commented Mar 20, 2024

对不起我的疏忽，要结合两个人的一起搞

@w815526955
Copy link

whati is modelng_t5.py ？
Could you please show me the path of the modelng_t5.py?

@w815526955
Copy link

whati is modelng_t5.py ？ Could you please show me the path of the modelng_t5.py?
anaconda3/envs/opensora/lib/python3.10/site-packages/transformers/models/t5/modeling_t5.py

@MqLeet
Copy link
Contributor

MqLeet commented Apr 8, 2024

兄弟们，只要把modelng_t5.py的264-275行注释掉就infer起来了

我之前尝试把FusedRMSNorm替换成nn.LayerNorm，结果sample的输出全是nan🤡

FrankLeeeee pushed a commit that referenced this issue Jun 17, 2024
@zhengzangw @xyupeng
Dev/load batch (#105)
e3f8ed7 
* add train_load_batch

* update train_load_batch

---------

Co-authored-by: pxy <pexure@gmail.com>
odb9402 pushed a commit to odb9402/Open-Sora that referenced this issue Jul 18, 2024
@LinB203
Merge pull request hpcaitech#105 from sennnnn/einops_bug
ad54bd8 
Fix einops bug: module 'keras.backend' has no attribute 'is_tensor'

Former-commit-id: c4f3a3a1172b68a4a34ddfac8ea69be34d11038b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
10 participants
@zhengzangw @lyc6749 @xuhzyy @wileewang @WillDreamer @tanghaom @w815526955 @MqLeet @ipp1215 and others