Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bug：BN导致正常计算溢出 #14

Open
BTboay opened this issue Jul 23, 2023 · 2 comments
Open

Bug：BN导致正常计算溢出 #14

BTboay opened this issue Jul 23, 2023 · 2 comments
Assignees
@BTboay
Labels
bug Something isn't working

Comments

@BTboay
Copy link
Member

BTboay commented Jul 23, 2023

BN层导致正常计算溢出，可能存在内存未对齐
@BTboay BTboay added the bug Something isn't working label Jul 23, 2023
@BTboay BTboay self-assigned this Jul 23, 2023
@BTboay
Copy link
Member Author

BTboay commented Jul 27, 2023

batchnorma x size 创建后未使用，疑似反向传播时直接使用output值，导致数值修改后影响梯度计算

@BTboay
Copy link
Member Author

BTboay commented Jul 30, 2023

bn层权重和其他权重在内存分配上是一体的，可能存在内存未对齐

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@BTboay BTboay

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@BTboay