Skip to content

Same merge planned twice #5588

Open
@fulmicoton

Description

@fulmicoton
Collaborator

As observed on airmail.

Dec 12 15:00:26 quickwit-indexer-29 quickwit-indexer INFO quickwit_indexing::actors::merge_planner: schedule merge operation merge_operation=Merge(operation_type=Merge, merged_split_id=01JEXP5BGMW85PCJM3W3KM4SV5,splits=[01JEXKJNK92ZP3EVEA2WDEDMMT,01JEXKVTXSKEBZ3VCZKN06TR4A,01JEXM50363F6ABM918PSR4F0F,01JEXME4RYXB8HNMD4NVZ3Q8AM,01JEXMQ9D0QXEXSSVKVTJY04SE,01JEXN0E8MDCVKFTSEV7BTB2RT,01JEXN9K9R02V6AKBAAZQEX5FF,01JEXNJRQ4CDHSQD7G3EJM8CR4,01JEXNVXKDEV9B7WFV9WF12GDR,01JEXP52DZ69MZSVWWDFKGGV9B,])
Dec 12 15:01:13 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP5BGMW85PCJM3W3KM4SV5 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_split_downloader: quickwit_indexing::actors::merge_split_downloader: download-merge-splits dir=/quickwit/qwdata/indexing/logline.22eb58a473.2024-12-12.quickwit%01JEW2NGTW9E9JKTCG2EQVWWX1%_ingest-source%01JEW2NSJECEPX1CCSW21Z71AH%Id3UTF/merge%xLVh5t
Dec 12 15:01:19 quickwit-indexer-29 quickwit-indexer INFO quickwit_indexing::actors::merge_planner: schedule merge operation merge_operation=Merge(operation_type=Merge, merged_split_id=01JEXP6Z72ZKXM2WTFCVV4KG82,splits=[01JEXKJNK92ZP3EVEA2WDEDMMT,01JEXKVTXSKEBZ3VCZKN06TR4A,01JEXM50363F6ABM918PSR4F0F,01JEXME4RYXB8HNMD4NVZ3Q8AM,01JEXMQ9D0QXEXSSVKVTJY04SE,01JEXN0E8MDCVKFTSEV7BTB2RT,01JEXN9K9R02V6AKBAAZQEX5FF,01JEXNJRQ4CDHSQD7G3EJM8CR4,01JEXNVXKDEV9B7WFV9WF12GDR,01JEXP52DZ69MZSVWWDFKGGV9B,])
Dec 12 15:01:43 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP5BGMW85PCJM3W3KM4SV5 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_executor: quickwit_indexing::actors::merge_executor: merge-operation-success merged_num_docs=2395845 elapsed_secs=25.355473 operation_type=Merge
Dec 12 15:01:47 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP6Z72ZKXM2WTFCVV4KG82 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_split_downloader: quickwit_indexing::actors::merge_split_downloader: download-merge-splits dir=/quickwit/qwdata/indexing/logline.22eb58a473.2024-12-12.quickwit%01JEW2NGTW9E9JKTCG2EQVWWX1%_ingest-source%01JEXP6Z4WMMA93DB58KVG8H06%zudwAi/merge%FYWnwJ
Dec 12 15:01:48 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP5BGMW85PCJM3W3KM4SV5 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:publisher{split_update=SplitsUpdate { index_id: "logline.22eb58a473.2024-12-12.quickwit", new_splits: "01JEXP5BGMW85PCJM3W3KM4SV5", checkpoint_delta: None }}: quickwit_indexing::actors::publisher: publish-new-splits
Dec 12 15:02:19 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP6Z72ZKXM2WTFCVV4KG82 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_executor: quickwit_indexing::actors::merge_executor: merge-operation-success merged_num_docs=2395845 elapsed_secs=22.732815 operation_type=Merge
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion exit_status=Failure(failed to publish splits
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion)
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion)
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion)

It is possible to track other occurence by searching for "splits are not marked for deletion"

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

    Development

    Participants

    @fulmicoton@trinity-1686a

    Issue actions

      Same merge planned twice · Issue #5588 · quickwit-oss/quickwit