Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Broker load failure due to mismatched row count: 512 vs 4096 #13053

Closed
rickif opened this issue Nov 7, 2022 · 0 comments · Fixed by #13078 or #13629
Closed

Broker load failure due to mismatched row count: 512 vs 4096 #13053

rickif opened this issue Nov 7, 2022 · 0 comments · Fixed by #13078 or #13629
Labels
type/bug Something isn't working

Comments

@rickif
Copy link
Contributor

rickif commented Nov 7, 2022

Steps to reproduce the behavior (Required)

  1. Create table with primary key/aggregate key/unique key
 CREATE TABLE `tbl_test` (
  `key1` int(11) NOT NULL COMMENT "",
  `key2` datetime NULL COMMENT ""
) ENGINE=OLAP
PRIMARY KEY(`key1`)
COMMENT "OLAP"
DISTRIBUTED BY HASH(`key1`) BUCKETS 3
PROPERTIES (
"replication_num" = "3",
"in_memory" = "false",
"storage_format" = "DEFAULT",
"enable_persistent_index" = "false"
);
  1. Do broker load
LOAD LABEL db0.label_test13 ( DATA INFILE("hdfs://xxx/4097.csv") INTO TABLE tbl_test COLUMNS TERMINATED BY "," FORMAT AS "csv" (key1,key2) SET(key1=key1,key2=key2) ) WITH BROKER 'hdfs_broker';

Expected behavior (Required)

Load success.

Real behavior (Required)

  1. The load gets failure.
*************************** 107. row ***************************
         JobId: 69389
         Label: 64ods_label1665708739638
         State: CANCELLED
      Progress: ETL:N/A; LOAD:N/A
          Type: BROKER
      Priority: NORMAL
       EtlInfo: NULL
      TaskInfo: resource:N/A; timeout(s):14400; max_filter_ratio:0.0
      ErrorMsg: type:LOAD_RUN_FAIL; msg:mismatched row count: 512 vs 4096
    CreateTime: 2022-11-07 14:58:50
  EtlStartTime: 2022-11-07 14:58:51
 EtlFinishTime: 2022-11-07 14:58:51
 LoadStartTime: 2022-11-07 14:58:51
LoadFinishTime: 2022-11-07 14:58:51
           URL: NULL
    JobDetails: {"Unfinished backends":{"a45f449e-f297-4374-89cc-aa59b2cdf857":[]},"ScannedRows":0,"TaskNumber":1,"All backends":{"a45f449e-f297-4374-89cc-aa59b2cdf857":[10002]},"FileNumber":1,"FileSize":10029385}
  1. The coordinator BE crashes.
*************************** 78. row ***************************
         JobId: 69416
         Label: label_test14
         State: CANCELLED
      Progress: ETL:N/A; LOAD:N/A
          Type: BROKER
      Priority: NORMAL
       EtlInfo: NULL
      TaskInfo: resource:N/A; timeout(s):14400; max_filter_ratio:0.0
      ErrorMsg: type:LOAD_RUN_FAIL; msg:backend 10002 is down
    CreateTime: 2022-11-07 16:16:21
  EtlStartTime: 2022-11-07 16:16:21
 EtlFinishTime: 2022-11-07 16:16:21
 LoadStartTime: 2022-11-07 16:16:21
LoadFinishTime: 2022-11-07 16:16:51
           URL: NULL
    JobDetails: {"Unfinished backends":{"d9fe469e-264e-41d7-ae48-a9eedab0dd60":[10002]},"ScannedRows":0,"TaskNumber":1,"All backends":{"d9fe469e-264e-41d7-ae48-a9eedab0dd60":[10002]},"FileNumber":1,"FileSize":90115}
78 rows in set (0.01 sec)
*** Aborted at 1667808981 (unix time) try "date -d @1667808981" if you are using GNU date ***
PC: @          0x24014a3 strings::memcpy_inlined()
*** SIGSEGV (@0x0) received by PID 168026 (TID 0x7f3c1c420700) from PID 0; stack trace: ***
    @          0x507f842 google::(anonymous namespace)::FailureSignalHandler()
    @     0x7f3e683c4630 (unknown)
    @          0x24014a3 strings::memcpy_inlined()
    @          0x361cee3 starrocks::ColumnVisitorMutableAdapter<>::visit()
    @          0x2c30b4f starrocks::vectorized::ColumnFactory<>::accept_mutable()
    @          0x361ddc8 starrocks::serde::ColumnArraySerde::deserialize()
    @          0x46ec15f starrocks::serde::ProtobufChunkDeserializer::deserialize()
    @          0x3e3be18 starrocks::DataStreamRecvr::SenderQueue::_deserialize_chunk()
    @          0x3e4257c starrocks::DataStreamRecvr::NonPipelineSenderQueue::add_chunks<>()
    @          0x3e3c282 starrocks::DataStreamRecvr::NonPipelineSenderQueue::add_chunks()
    @          0x3dbf073 starrocks::DataStreamRecvr::add_chunks()
    @          0x3d604b6 starrocks::DataStreamMgr::transmit_chunk()
    @          0x4729c3c starrocks::PInternalServiceImplBase<>::transmit_chunk()
    @          0x51b115e brpc::policy::ProcessRpcRequest()
    @          0x51a7b67 brpc::ProcessInputMessage()
    @          0x51a8a13 brpc::InputMessenger::OnNewMessages()
    @          0x524f75e brpc::Socket::ProcessEvent()
    @          0x515d6af bthread::TaskGroup::task_runner()
    @          0x52e60a1 bthread_make_fcontext

StarRocks version (Required)

2.4.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/bug Something isn't working
Projects
None yet
1 participant