Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Direct IO does not work with PREWHERE when there are multiple threads #11539

Closed
alexey-milovidov opened this issue Jun 9, 2020 · 1 comment · Fixed by #11540
Closed

Direct IO does not work with PREWHERE when there are multiple threads #11539

alexey-milovidov opened this issue Jun 9, 2020 · 1 comment · Fixed by #11540
Assignees
Labels
bug Confirmed user-visible misbehaviour in official release major

Comments

@alexey-milovidov
Copy link
Member

CREATE TABLE bug (UserID UInt64, Date Date) ENGINE = MergeTree ORDER BY Date;
INSERT INTO bug SELECT rand64(), '2020-06-07' FROM numbers(153656686);
clickhouse-benchmark --max_threads 16 --min_bytes_to_use_direct_io 1 <<< "SELECT UserID FROM geo_bug_2 PREWHERE NOT ignore(Date)"
Data compressed with different methods, given method byte 0x40, previous method byte 0x82: (while reading column UserID): (while reading from part ./data/default/geo_bug_2/all_1_142_3/ from mark 1720 with max_rows_to_read = 65536): While executing MergeTreeThread.
@alexey-milovidov alexey-milovidov added the bug Confirmed user-visible misbehaviour in official release label Jun 9, 2020
@alexey-milovidov alexey-milovidov changed the title Direct io does not work with PREWHERE when there are multiple threads Direct IO does not work with PREWHERE when there are multiple threads Jun 9, 2020
alexey-milovidov added a commit that referenced this issue Jun 9, 2020
@alexey-milovidov alexey-milovidov self-assigned this Jun 9, 2020
@alexey-milovidov
Copy link
Member Author

alexey-milovidov commented Jun 9, 2020

Affected versions:

master
20.4
20.3
20.1.12
19.14 (difficult to reproduce, only after 52 queries)
19.1.16 (with another error message: "Can't adjust last granule because it has 8192rows, but try to subtract 49152 rows.")
18.16 (the same error message as 19.1)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Confirmed user-visible misbehaviour in official release major
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants