Skip to content

[fix](broker-load) fix error in broker-load with read_json_by_line#41788

Merged
liaoxin01 merged 1 commit intoapache:masterfrom
wyxxxcat:read_json_by_line
Oct 17, 2024
Merged

[fix](broker-load) fix error in broker-load with read_json_by_line#41788
liaoxin01 merged 1 commit intoapache:masterfrom
wyxxxcat:read_json_by_line

Conversation

@wyxxxcat
Copy link
Contributor

@wyxxxcat wyxxxcat commented Oct 14, 2024

Proposed changes

Issue Number: close #xxx

before:

mysql> select * from user_info;
Empty set (0.00 sec)

mysql> LOAD LABEL local_load_label (
    ->     DATA INFILE("s3://wyxxxcardoris/test/data_by_line.json")
    ->     INTO TABLE user_info
    ->     (id, name, age)
    ->     PROPERTIES
    ->     (
    ->         "read_json_by_line" = "true"
    ->     )
    -> )
    -> WITH s3
    -> (
    ->     "AWS_ACCESS_KEY" = "xxx",
    ->     "AWS_SECRET_KEY" = "xxx",
    ->     "AWS_ENDPOINT" = "xxx",
    ->     "AWS_REGION" = "xxx"
    -> )
    -> PROPERTIES
    -> (
    ->     "timeout" = "3600"
    -> );
Query OK, 0 rows affected (0.15 sec)

mysql> select * from user_info;
+------+-------+------+
| id   | name  | age  |
+------+-------+------+
|    1 | Alice |   25 |
+------+-------+------+
1 row in set (0.04 sec)

now:

mysql> select * from user_info;
Empty set (0.01 sec)

mysql> LOAD LABEL local_load_label (
    ->     DATA INFILE("s3://wyxxxcardoris/test/data_by_line.json")
    ->     INTO TABLE user_info
    ->     (id, name, age)
    ->     PROPERTIES
    ->     (
    ->         "read_json_by_line" = "true"
    ->     )
    -> )
    -> WITH s3
    -> (
    ->     "AWS_ACCESS_KEY" = "xxx",
    ->     "AWS_SECRET_KEY" = "xxx",
    ->     "AWS_ENDPOINT" = "xxx",
    ->     "AWS_REGION" = "xxx"
    -> )
    -> PROPERTIES
    -> (
    ->     "timeout" = "3600"
    -> );
Query OK, 0 rows affected (0.62 sec)

mysql> select * from user_info;
+------+---------+------+
| id   | name    | age  |
+------+---------+------+
|    2 | Bob     |   30 |
|    4 | John    |   29 |
|    5 | Mars    |   17 |
|    1 | Alice   |   25 |
|    3 | Charlie |   35 |
+------+---------+------+
5 rows in set (0.10 sec)

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@wyxxxcat
Copy link
Contributor Author

run buildall

@wyxxxcat wyxxxcat force-pushed the read_json_by_line branch 2 times, most recently from 477e9f0 to 22d40ac Compare October 15, 2024 06:18
@wyxxxcat
Copy link
Contributor Author

run buildall

@wyxxxcat
Copy link
Contributor Author

run buildall

Copy link
Contributor

@liaoxin01 liaoxin01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 17, 2024
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@sollhui sollhui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@liaoxin01 liaoxin01 merged commit 6801e06 into apache:master Oct 17, 2024
liaoxin01 pushed a commit that referenced this pull request Jan 21, 2025
### What problem does this PR solve?

Issue Number: DORIS-17985

Related PR: #41788 #43989 #44285

Problem Summary:

Fix test_s3_load_properties, which was incorrectly changed previously.
github-actions bot pushed a commit that referenced this pull request Jan 21, 2025
### What problem does this PR solve?

Issue Number: DORIS-17985

Related PR: #41788 #43989 #44285

Problem Summary:

Fix test_s3_load_properties, which was incorrectly changed previously.
lzyy2024 pushed a commit to lzyy2024/doris that referenced this pull request Feb 21, 2025
### What problem does this PR solve?

Issue Number: DORIS-17985

Related PR: apache#41788 apache#43989 apache#44285

Problem Summary:

Fix test_s3_load_properties, which was incorrectly changed previously.
hubgeter pushed a commit to hubgeter/doris that referenced this pull request Mar 12, 2025
### What problem does this PR solve?

Issue Number: DORIS-17985

Related PR: apache#41788 apache#43989 apache#44285

Problem Summary:

Fix test_s3_load_properties, which was incorrectly changed previously.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.x dev/3.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants