Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CNN Why-conv #581

Merged
merged 15 commits into from Dec 14, 2020
Merged

CNN Why-conv #581

merged 15 commits into from Dec 14, 2020

Conversation

goldmermaid
Copy link
Member

No description provided.

@mli
Copy link
Member

mli commented Oct 25, 2020

Job d2l-zh/PR-581/1 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Oct 25, 2020

Job d2l-zh/PR-581/2 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Oct 28, 2020

Job d2l-zh/PR-581/3 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 7, 2020

Job d2l-zh/PR-581/4 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 12, 2020

Job d2l-zh/PR-581/5 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 12, 2020

Job d2l-zh/PR-581/6 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 14, 2020

Job d2l-zh/PR-581/7 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 18, 2020

Job d2l-zh/PR-581/8 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 21, 2020

Job d2l-zh/PR-581/9 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 22, 2020

Job d2l-zh/PR-581/10 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 22, 2020

Job d2l-zh/PR-581/11 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@goldmermaid goldmermaid changed the title [WIP] CNN Why-conv.md CNN Why-conv Nov 23, 2020
@mli
Copy link
Member

mli commented Nov 23, 2020

Job d2l-zh/PR-581/12 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 25, 2020

Job d2l-zh/PR-581/13 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 26, 2020

Job d2l-zh/PR-581/14 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 29, 2020

Job d2l-zh/PR-581/15 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 29, 2020

Job d2l-zh/PR-581/16 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Nov 30, 2020

Job d2l-zh/PR-581/17 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Dec 1, 2020

Job d2l-zh/PR-581/18 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

chapter_convolutional-neural-networks/why-conv.md Outdated Show resolved Hide resolved
chapter_convolutional-neural-networks/why-conv.md Outdated Show resolved Hide resolved

例如,让我们回到我们区分猫和狗的运行例子。假设我们做一个彻底的工作,在数据收集,收集一百万像素照片的注释数据集。这意味着网络的每个输入都有一百万个维度。即使大幅缩小到千个隐藏尺寸,也需要一个以 $10^6 \times 10^3 = 10^9$ 参数为特征的完全连接层。除非我们拥有大量的 GPU、分布式优化的天赋以及极大的耐心,否则学习这个网络的参数可能会被证明是不可行的。
例如,在之前区分猫和狗的例子中,假设我们收集了一个照片数据集,每张照片具有百万级像素,这意味着MLP的每个输入都有一百万个维度。然而即使MLP只有 $1000$ 个隐藏层,这个神经网络将有 $10^6 \times 10^3 = 10^9$ 个参数。除非我们有大量的GPU,分布式优化训练的经验以及超乎常人的耐心,否则很难学习这个网络。
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • 第一句可以拆成两个短句。
  • “然而即使MLP只有 $1000$ 个隐藏层”意思不对。应该是“即使将隐藏层维度降低到1000”
  • “然而……这个神经网络也将有”
  • “除非我们有大量的GPU,分布式优化训练的经验以及超乎常人的耐心,否则很难学习这个网络。”中间表示并列的逗号改成顿号
  • “否则很难学习这个网络。”听起来像是我们在学啥

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LOL, any suggestion to translate the last sentence?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

想要使这个模型学习良好是很难的事情,需要有大量的GPU、分布式优化训练的经验和超乎常人的耐心。

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

MLP这种不要放英文缩写,用中文全称:多层感知机

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about "想要训练这个模型很难,需要有大量的GPU、分布式优化训练的经验和超乎常人的耐心。"?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

MLP这种不要放英文缩写,用中文全称:多层感知机

Fixed!

chapter_convolutional-neural-networks/why-conv.md Outdated Show resolved Hide resolved
chapter_convolutional-neural-networks/why-conv.md Outdated Show resolved Hide resolved
chapter_convolutional-neural-networks/why-conv.md Outdated Show resolved Hide resolved
chapter_convolutional-neural-networks/why-conv.md Outdated Show resolved Hide resolved
chapter_convolutional-neural-networks/why-conv.md Outdated Show resolved Hide resolved
chapter_convolutional-neural-networks/why-conv.md Outdated Show resolved Hide resolved
chapter_convolutional-neural-networks/why-conv.md Outdated Show resolved Hide resolved
@mli
Copy link
Member

mli commented Dec 1, 2020

Job d2l-zh/PR-581/19 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Dec 2, 2020

Job d2l-zh/PR-581/20 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Dec 2, 2020

Job d2l-zh/PR-581/21 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@mli
Copy link
Member

mli commented Dec 3, 2020

Job d2l-zh/PR-581/22 is complete.
Check the results at http://preview.d2l.ai/d2l-zh/PR-581/

@xiaotinghe xiaotinghe merged commit 2b8550c into d2l-ai:v2 Dec 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants