Improve stability for heavy random write workload #664

davies · 2021-07-20T05:42:59Z

fio --group_reporting --time_based --iodepth=32 --norandommap --name=4k-file-single-randwrite --directory=/jfs-ce3/tmp --rw=randwrite --bs=4k --size=10G --runtime=300 --numjobs=1 --output 4k-random-write.txt

2. flush the slices earlier when there are more than 800 3. stop compacting when use 150% of buffer size 4. increase limit of compaction to 1000 slices 5. increase the trigger to compaction to 100 slices

davies added 2 commits July 20, 2021 13:42

alloc memory from buffer pool

7351f44

1. slow down write when there are more than 1000 pending slices

51873b6

2. flush the slices earlier when there are more than 800 3. stop compacting when use 150% of buffer size 4. increase limit of compaction to 1000 slices 5. increase the trigger to compaction to 100 slices

davies requested a review from SandyXSD July 20, 2021 05:43

SandyXSD approved these changes Jul 20, 2021

View reviewed changes

davies merged commit 63e305a into main Jul 20, 2021

davies deleted the buffer_pool branch July 20, 2021 06:21

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Improve stability for heavy random write workload #664

Improve stability for heavy random write workload #664

davies commented Jul 20, 2021 •

edited

Improve stability for heavy random write workload #664

Improve stability for heavy random write workload #664

Conversation

davies commented Jul 20, 2021 • edited

davies commented Jul 20, 2021 •

edited