Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Increase the tolerance #7926

Closed
wants to merge 1 commit into from
Closed

Increase the tolerance #7926

wants to merge 1 commit into from

Conversation

goswamig
Copy link
Contributor


test = mx.symbol.BatchNorm(data, fix_gamma=False, use_global_stats=True, axis=chaxis)
check_numeric_gradient(test, in_location, xmean_std, numeric_eps=1e-2, rtol=0.2, atol=0.01)
check_numeric_gradient(test, in_location, xmean_std, numeric_eps=1e-2, rtol=0.2, atol=1e-4)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks like a decrease to me.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah it is an increase :)

@cjolivier01
Copy link
Member

Is this newly failing? That's a pretty bad tolerance. Are the c++ unit tests being run? Do they pass?

@cjolivier01
Copy link
Member

What I mean is, did it just recently start failing or it's been failing periodically? I didn't see it on the list of failing tests before. What's the failure rate now?

Are the cpp unit tests running? Are they passing? Batch norm operator is tested exhaustingly in the cpp unit tests.

@goswamig
Copy link
Contributor Author

@cjolivier01 I have seen this failing since last week >75%, we are not running CPP test :(

@cjolivier01
Copy link
Member

cjolivier01 commented Sep 18, 2017 via email

@goswamig
Copy link
Contributor Author

@cjolivier01 I saw the failure since last two weeks, haven't noticed before.

@goswamig
Copy link
Contributor Author

The test has been failing continuously here is another instance today
https://builds.apache.org/blue/organizations/jenkins/incubator-mxnet/detail/master/395/pipeline

@goswamig
Copy link
Contributor Author

Whops wrong test fix.

@goswamig goswamig closed this Sep 18, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants