Skip to content
This repository has been archived by the owner on Nov 22, 2022. It is now read-only.

(Easy) Add eps to Adam #858

Closed
wants to merge 1 commit into from

Conversation

kmalik22
Copy link

Summary: The Adam optimizer has a parameter called epsilon which is useful for numeric stability. It's useful to explicitly set epsilon especially for unit-tests. This diff adds epsilon to Adam's config

Differential Revision: D16573250

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Jul 30, 2019
kmalik22 pushed a commit to kmalik22/pytext that referenced this pull request Aug 2, 2019
Summary:
Pull Request resolved: facebookresearch#858

The Adam optimizer has a parameter called epsilon which is useful for numeric stability. It's useful to explicitly set epsilon especially for unit-tests. This diff adds epsilon to Adam's config

Differential Revision: D16573250

fbshipit-source-id: adc1eca53d190ac4f851c1bc57b71852f499df61
Summary:
Pull Request resolved: facebookresearch#858

The Adam optimizer has a parameter called epsilon which is useful for numeric stability. It's useful to explicitly set epsilon especially for unit-tests. This diff adds epsilon to Adam's config

Differential Revision: D16573250

fbshipit-source-id: 3bff655beb1d8bd0d72730ebfebc72e57ad02d0d
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 45f3304.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants