Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix layer normalization's reference outputs #4263

Merged
merged 4 commits into from
Jun 10, 2022
Merged

Fix layer normalization's reference outputs #4263

merged 4 commits into from
Jun 10, 2022

Conversation

wschin
Copy link
Contributor

@wschin wschin commented Jun 10, 2022

Existing outputs are always generated using default epsilon, so the reference outputs with non-default epsilon are incorrect. This PR fixes this problem. This change is tested with ONNXRuntime (commit: aceaa0a1f7ebc8919999c7b0e88bb565373c1e6d) and the tests are passing.

etiotto and others added 3 commits June 10, 2022 01:23
* Update requirements.txt (#4223)

* Upgrade python syntax with pyupgrade (#4212)

Signed-off-by: Eduardo <eduardomoreno2594@gmail.com>

* Update requirements.txt

Signed-off-by: Eduardo <eduardomoreno2594@gmail.com>

* include the previous restriction as well

Signed-off-by: Eduardo <eduardomoreno2594@gmail.com>

Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com>

* Change version number to 1.12.0rc1 for testing

Signed-off-by: Ettore Tiotto <etiotto@ca.ibm.com>

Co-authored-by: EduMoreno <eduardomoreno2594@gmail.com>
Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com>
Co-authored-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Ettore Tiotto <etiotto@ca.ibm.com>

Co-authored-by: Chun-Wei Chen <jacky82226@gmail.com>
Signed-off-by: Ettore Tiotto <etiotto@ca.ibm.com>
@wschin wschin requested review from a team as code owners June 10, 2022 01:27
Signed-off-by: Wei-Sheng Chin <wschin@outlook.com>
@wschin wschin merged commit 4beb71f into main Jun 10, 2022
@wschin wschin deleted the fix-ln-ref-output branch June 10, 2022 15:38
wschin added a commit that referenced this pull request Jun 10, 2022
wschin added a commit that referenced this pull request Jun 10, 2022
This reverts commit 4beb71f.

Signed-off-by: Wei-Sheng Chin <wschin@outlook.com>
jcwchen pushed a commit that referenced this pull request Jun 10, 2022
* Revert "Fix layer normalization's reference outputs (#4263)"

This reverts commit 4beb71f.

Signed-off-by: Wei-Sheng Chin <wschin@outlook.com>

* Feed epsilon to ref implementation

Signed-off-by: Wei-Sheng Chin <wschin@outlook.com>
Copy link
Contributor

@garymm garymm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@@ -1 +1 @@
1.12.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops :-)
I'll send a fix.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! This is fixed in main branch but I didn't touch release branch.

jcwchen pushed a commit to jcwchen/onnx that referenced this pull request Jun 10, 2022
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
jcwchen added a commit that referenced this pull request Jun 10, 2022
* Use op name rather than hard-coding Hann in window op doc strings. (#4248)

And strip trailing spaces.

Signed-off-by: Gary Miguel <garymiguel@microsoft.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* Fix: Window functions generate incorrect shape for with symmetric attribute (#4256)

* fix symmetric function definition, and add shape inference test

Signed-off-by: Sheil Kumar <smk2007@gmail.com>

* whitespace...

Signed-off-by: Sheil Kumar <smk2007@gmail.com>

* whitespace...

Signed-off-by: Sheil Kumar <smk2007@gmail.com>

* flake8 whitespace error

Signed-off-by: Sheil Kumar <smk2007@gmail.com>

* fix stft test

Signed-off-by: Sheil Kumar <smk2007@gmail.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* support truncation & fix big-endian support (#4238)

Signed-off-by: Ian Bearman <ianb@microsoft.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* Fix layer normalization's reference outputs (#4263)

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* handle raw types correctly in helper.make_tensor (#4262)

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* bump to 1.12.0rc4 for cherry-picks

Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

* Fix sub-graph generation for LN (#4268)

Signed-off-by: Wei-Sheng Chin <wschin@outlook.com>
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>

Co-authored-by: Gary Miguel <garymiguel@microsoft.com>
Co-authored-by: Sheil Kumar <smk2007@gmail.com>
Co-authored-by: Ian Bearman <ianb@microsoft.com>
Co-authored-by: Wei-Sheng Chin <wschin@outlook.com>
broune pushed a commit to broune/onnx that referenced this pull request May 6, 2023
broune pushed a commit to broune/onnx that referenced this pull request May 6, 2023
* Revert "Fix layer normalization's reference outputs (onnx#4263)"

This reverts commit 4beb71f.

Signed-off-by: Wei-Sheng Chin <wschin@outlook.com>

* Feed epsilon to ref implementation

Signed-off-by: Wei-Sheng Chin <wschin@outlook.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants