We recently encountered a situation:
- When starting a new consuming segment, we try to create the stream consumer. This is in LLRealtimeSegmentDataManager constructor, the call to makeStreamConsumer
- If we encounter an exception in makeStreamConsumer, the entire state transition fails
- The segment goes into ERROR state.
Only ways to recover:
- Restart
We should be able to gracefully recover from this. Some solutions:
- Catch this as a transient exception, and call handleTransientException. This method will retry creating streamConsumer after a 1s sleep. The retry will happen 5 times.
cc: @mcvsubbu
We recently encountered a situation:
Only ways to recover:
We should be able to gracefully recover from this. Some solutions:
cc: @mcvsubbu