Skip to content

Commit

Permalink
Revert "[ISSUE-173][FOLLOWUP] The size of single buffer flush should …
Browse files Browse the repository at this point in the history
…reach rss.server.flush.cold.storage.threshold.size (#178)" (#179)

This reverts commit ab6be6e.
  • Loading branch information
jerqi committed Aug 22, 2022
1 parent ab6be6e commit e9fd373
Showing 1 changed file with 1 addition and 3 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -165,9 +165,7 @@ public ShuffleDataResult getShuffleData(

void flushSingleBufferIfNecessary(ShuffleBuffer buffer, String appId,
int shuffleId, int startPartition, int endPartition) {
// When we use multistorage and trigger single buffer flush, the buffer size should be bigger
// than rss.server.flush.cold.storage.threshold.size, otherwise cold storage will be useless.
if (this.bufferFlushEnabled && buffer.getSize() > this.bufferFlushThreshold) {
if (this.bufferFlushEnabled && buffer.getSize() >= this.bufferFlushThreshold) {
flushBuffer(buffer, appId, shuffleId, startPartition, endPartition);
}
}
Expand Down

0 comments on commit e9fd373

Please sign in to comment.