Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Swish-1 and GELU activation for transformers #229

Merged
merged 3 commits into from
Dec 6, 2017
Merged

Swish-1 and GELU activation for transformers #229

merged 3 commits into from
Dec 6, 2017

Commits on Nov 30, 2017

  1. Added Swish-1 activation for transformer models.

    @mjdenkowski
    mjdenkowski committed Nov 30, 2017
    Configuration menu
    Copy the full SHA
    2814986 View commit details
    Browse the repository at this point in the history

  2. Added GELU activation for transformer models.

    @mjdenkowski
    mjdenkowski committed Nov 30, 2017
    Configuration menu
    Copy the full SHA
    55f1dae View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2017

  1. Merge branch 'master' of github.com:awslabs/sockeye into swish1

    @mjdenkowski
    mjdenkowski committed Dec 5, 2017
    Configuration menu
    Copy the full SHA
    0d48c6a View commit details
    Browse the repository at this point in the history