-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HBASE-25562 ReplicationSourceWALReader log and handle exception immed… #2966
Conversation
🎊 +1 overall
This message was automatically generated. |
🎊 +1 overall
This message was automatically generated. |
🎊 +1 overall
This message was automatically generated. |
} else { | ||
LOG.error("Failed to read stream of replication entries", e); | ||
handleEofException(e); | ||
if (!handleEofException(e)) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
let's reset the sleep multiplier it EOF was handled, something like.
if (handleEofException(e))
{
sleepMultiplier = 1;
}
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank @sandeepvinayak for reviewing.
How about keeping resetting sleepMultiplier
only in there where read WAL successfully? What I'm thinking is that handleEofException
just deals with exceptions and we still need to retry to get back to the correct logic. We reset sleepMultiplier
only after the logic getting back correct?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yeah, but in handleEofException, we deque the bad(or empty) log file and do the repair work. So if we did the repair work why not reset the sleep multiplier?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OK, I modified the code as your comments.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
minor change requested to reset the sleepmultiplier, otherwise+1
…iately without retrying
e7e463e
to
a6f7c39
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks @ddupg . LGTM
🎊 +1 overall
This message was automatically generated. |
🎊 +1 overall
This message was automatically generated. |
🎊 +1 overall
This message was automatically generated. |
…iately without retrying