Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ORC-148: Move ORC PPD failure messages from WARN to DEBUG level #99

Closed
wants to merge 1 commit into from

Conversation

prasanthj
Copy link
Contributor

No description provided.

@@ -468,16 +470,15 @@ static TruthValue evaluatePredicateRange(PredicateLeaf predicate, Object min,
}
// in case failed conversion, return the default YES_NO_NULL truth value
} catch (Exception e) {
if (LOG.isWarnEnabled()) {
if (LOG.isDebugEnabled()) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This isn't ok. We can't take exceptions and make them invisible. We need to avoid the exception.

@omalley
Copy link
Contributor

omalley commented Mar 7, 2017

Here's a more complete solution.

https://github.com/omalley/orc/tree/orc-148

It will still get 1 log line per a stripe, but that is much better than 1 per a row group. It also downgrades the expected exceptions to info. I considered downgrading it further to debug,
but we really should even fix those via schema evolution.

@prasanthj
Copy link
Contributor Author

lgtm, +1.

omalley added a commit to omalley/orc that referenced this pull request Apr 25, 2017
Fixes apache#99

Signed-off-by: Owen O'Malley <omalley@apache.org>
omalley added a commit to omalley/orc that referenced this pull request Apr 25, 2017
Fixes apache#99

Signed-off-by: Owen O'Malley <omalley@apache.org>
@omalley
Copy link
Contributor

omalley commented Apr 25, 2017

I realized that we really shouldn't be using the variable, but rather the sarg leaf as the thing we are caching the exceptional results for. (So that we avoid excessive logging)

@asfgit asfgit closed this in 9175b3e Apr 25, 2017
asfgit pushed a commit that referenced this pull request Apr 25, 2017
Fixes #99

Signed-off-by: Owen O'Malley <omalley@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants