Skip to content

Conversation

@gortiz
Copy link
Contributor

@gortiz gortiz commented Feb 6, 2026

In #17576 we detected an issue that proves we cannot downgrade from 1.4 or 1.5 to 1.3 without downtime, as MSE queries may be broken due to an incompatibility in the stage stats. It is important to know the issue is not introduced by #17576 but detected by it.

The main issue is that in 1.4 we introduced a cluster listener that detects whether the cluster is homogeneous or not, and in case it is not, MSE doesn't send stage stats. We did that because in 1.3 we detected a bug and the only way to fix it was to change the stats in 1.4 in a way that 1.3 fails when they are received. This worked fine during the system upgrade, but the listener is based on a version-specific Helix property we started setting in 1.4. When rolling back to 1.3, that property is not changed (as it is unknown to 1.3), so the other nodes see the old value, which means they think the cluster is homogeneous.

Fixing this issue may be complex and given we don't expect people to downgrade from 1.5 to 1.3, we think it is just better to remove that check here. As always, it is recommended to upgrade one version at a time, so in case you need to downgrade from 1.5, you should go to 1.4, which is still tested.

Release noted

Apache Pinot 1.5 can be rolled back to 1.4 without downtime, but not to earlier versions. It is recommended to upgrade one version at a time.

@gortiz gortiz added the release-notes Referenced by PRs that need attention when compiling the next release notes label Feb 6, 2026
@codecov-commenter
Copy link

codecov-commenter commented Feb 6, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 63.24%. Comparing base (a5eae57) to head (f9896f0).
✅ All tests successful. No failed tests found.

Additional details and impacted files
@@             Coverage Diff              @@
##             master   #17649      +/-   ##
============================================
+ Coverage     63.22%   63.24%   +0.01%     
  Complexity     1499     1499              
============================================
  Files          3174     3174              
  Lines        190319   190319              
  Branches      29080    29080              
============================================
+ Hits         120338   120364      +26     
+ Misses        60643    60621      -22     
+ Partials       9338     9334       -4     
Flag Coverage Δ
custom-integration1 100.00% <ø> (ø)
integration 100.00% <ø> (ø)
integration1 100.00% <ø> (ø)
integration2 0.00% <ø> (ø)
java-11 63.21% <ø> (+7.62%) ⬆️
java-21 55.59% <ø> (-7.62%) ⬇️
temurin 63.24% <ø> (+0.01%) ⬆️
unittests 63.24% <ø> (+0.01%) ⬆️
unittests1 55.63% <ø> (+0.02%) ⬆️
unittests2 34.05% <ø> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@gortiz gortiz merged commit 3a536f3 into apache:master Feb 9, 2026
18 of 19 checks passed
@gortiz gortiz deleted the disable-1.3-comp-check branch February 9, 2026 13:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release-notes Referenced by PRs that need attention when compiling the next release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants