Enables auto reset of error segments by default#15736
Enables auto reset of error segments by default#15736Jackie-Jiang merged 1 commit intoapache:masterfrom
Conversation
|
This was discussed here: #15652 (comment) as well |
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #15736 +/- ##
============================================
+ Coverage 62.90% 63.26% +0.36%
- Complexity 1386 1388 +2
============================================
Files 2867 2884 +17
Lines 163354 164953 +1599
Branches 24952 25202 +250
============================================
+ Hits 102755 104359 +1604
+ Misses 52847 52724 -123
- Partials 7752 7870 +118
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
This feature is relatively new (introduced after |
|
@Jackie-Jiang I think we can enable it by default. I don't see any downside here. The case for pauseless is separately handled. This will only be a concern for dedup and partial upsert tables in case an ONLINE segment is in ERROR state on one of the servers and we have incorrect metadata due to this on the failed server. In case all the servers have it in ERROR, that most likely would happen for a CONSUMING segment having bad data or build issues. The ingestion will pause for this case and would require further debugging. @Jackie-Jiang What concerns do we see with the OFFLINE tables ? |
No major concern. Since we have already tested out, agree we can enable it by default |
Small change to always reset error segments in Realtime Segment Validation Manager.
I have asked the reason of keeping this feature behind the flag here #14217 (comment) which I feel should always be enabled without any config.