Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Broker load failure type:LOAD_RUN_FAIL; msg:mismatched row count: 512 vs 4096 #22342

Closed
rickif opened this issue Apr 24, 2023 · 1 comment · Fixed by #22336
Closed

Broker load failure type:LOAD_RUN_FAIL; msg:mismatched row count: 512 vs 4096 #22342

rickif opened this issue Apr 24, 2023 · 1 comment · Fixed by #22336
Labels
type/bug Something isn't working

Comments

@rickif
Copy link
Contributor

rickif commented Apr 24, 2023

Steps to reproduce the behavior (Required)

  1. Create a table in PRIMARY KEY with datetime key
CREATE TABLE `tbl_simple_pk` ( `key1` datetime not NULL COMMENT "", `key2` int NULL COMMENT "" ) ENGINE = OLAP PRIMARY KEY(`key1`) COMMENT "OLAP" DISTRIBUTED BY HASH(`key1`) BUCKETS 1 PROPERTIES ( "replication_num" = "3");
  1. Load file via broker load
LOAD LABEL label10 ( DATA INFILE("hdfs://127.0.0.1:9000/4096_null/a.csv") INTO TABLE tbl_simple_pk COLUMNS TERMINATED BY "," FORMAT AS "csv" (key1,key2) SET (key1=key1,key2=key2)) WITH BROKER 'sr_broker' ;

The file includes records whose field is null, but the corresponding table columns is not null.

Expected behavior (Required)

type:ETL_QUALITY_UNSATISFIED; msg:quality not good enough to cancel is returned. You can check the error detail in error URL Error: NULL value in non-nullable column 'key1'. Row: [NULL, 3, 0].

         JobId: 12020
         Label: label10
         State: CANCELLED
      Progress: ETL:N/A; LOAD:N/A
          Type: BROKER
      Priority: NORMAL
       EtlInfo: unselected.rows=0; dpp.abnorm.ALL=1; dpp.norm.ALL=4097
      TaskInfo: resource:N/A; timeout(s):14400; max_filter_ratio:0.0
      ErrorMsg: type:ETL_QUALITY_UNSATISFIED; msg:quality not good enough to cancel
    CreateTime: 2023-04-24 10:48:42
  EtlStartTime: 2023-04-24 10:48:43
 EtlFinishTime: 2023-04-24 10:48:43
 LoadStartTime: 2023-04-24 10:48:43
LoadFinishTime: 2023-04-24 10:48:43
           URL: http://127.0.0.1:8064/api/_load_error_log?file=error_log_b2f2dacd78884185_a41f521e8b6e4b0a
    JobDetails: {"Unfinished backends":{"b2f2dacd-7888-4185-a41f-521e8b6e4b08":[]},"ScannedRows":4098,"TaskNumber":1,"All backends":{"b2f2dacd-7888-4185-a41f-521e8b6e4b08":[10002]},"FileNumber":1,"FileSize":16394}

Real behavior (Required)

type:LOAD_RUN_FAIL; msg:mismatched row count: 512 vs 4096 is retuned. And the error URL is NULL.

         JobId: 12043
         Label: label10
         State: CANCELLED
      Progress: ETL:N/A; LOAD:N/A
          Type: BROKER
      Priority: NORMAL
       EtlInfo: NULL
      TaskInfo: resource:N/A; timeout(s):14400; max_filter_ratio:0.0
      ErrorMsg: type:LOAD_RUN_FAIL; msg:mismatched row count: 512 vs 4096
    CreateTime: 2023-04-24 10:57:14
  EtlStartTime: 2023-04-24 10:57:18
 EtlFinishTime: 2023-04-24 10:57:18
 LoadStartTime: 2023-04-24 10:57:18
LoadFinishTime: 2023-04-24 10:57:18
           URL: NULL
    JobDetails: {"Unfinished backends":{"a1550bfc-e398-4d24-be77-7a27b2720947":[]},"ScannedRows":0,"TaskNumber":1,"All backends":{"a1550bfc-e398-4d24-be77-7a27b2720947":[10002]},"FileNumber":1,"FileSize":188491}

StarRocks version (Required)

2.4.4

@rickif rickif added the type/bug Something isn't working label Apr 24, 2023
@rickif rickif changed the title Broker load failure type:LOAD_RUN_FAIL; msg:mismatched row count: 1024 vs 4096 Broker load failure type:LOAD_RUN_FAIL; msg:mismatched row count: 512 vs 4096 Apr 24, 2023
@rickif
Copy link
Contributor Author

rickif commented Apr 24, 2023

a.csv

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/bug Something isn't working
Projects
None yet
1 participant