Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update weight-decay.md #1308

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions chapter_multilayer-perceptrons/weight-decay.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ ${k - 1 + d} \choose {k - 1}$,即$C^{k-1}_{k-1+d} = \frac{(k-1+d)!}{(d)!(k-1)!
因此即使是阶数上的微小变化,比如从$2$到$3$,也会显著增加我们模型的复杂性。
仅仅通过简单的限制特征数量(在多项式回归中体现为限制阶数),可能仍然使模型在过简单和过复杂中徘徊,
我们需要一个更细粒度的工具来调整函数的复杂性,使其达到一个合适的平衡位置。

## 范数与权重衰减

在 :numref:`subsec_lin-algebra-norms`中,
Expand Down
Loading