Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

00534_functions_bad_arguments tests are flaky #50619

Closed
Algunenano opened this issue Jun 6, 2023 · 0 comments · Fixed by #51310
Closed

00534_functions_bad_arguments tests are flaky #50619

Algunenano opened this issue Jun 6, 2023 · 0 comments · Fixed by #51310
Assignees
Labels
fuzz Problem found by one of the fuzzers

Comments

@Algunenano
Copy link
Member

It seems it's mostly related with MSAN (too slow? too many things at once?)

SELECT
  check_name,
  test_name,
  toStartOfDay(check_start_time) as t,
  count() as runs,
  100 * (countIf(test_status != 'OK' AND test_status != 'SKIPPED') AS f) / runs as failure_percentage
FROM checks
WHERE
    test_name LIKE '00534_functions_bad_arguments%'
    AND pull_request_number = 0
    AND check_start_time > today() - interval 30 day
GROUP BY check_name, test_name, t
HAVING f > 0
ORDER by check_name, test_name, t
check_name test_name t runs failure_percentage
1 Stateless tests (msan) [3/6] 00534_functions_bad_arguments12 2023-06-02 00:00:00 32 3.125
2 Stateless tests (msan) [3/6] 00534_functions_bad_arguments12 2023-06-05 00:00:00 33 24.242424242424242
3 Stateless tests (msan) [3/6] 00534_functions_bad_arguments4_long 2023-06-05 00:00:00 33 15.151515151515152
4 Stateless tests (msan) [4/6] 00534_functions_bad_arguments10 2023-06-02 00:00:00 30 20
5 Stateless tests (msan) [4/6] 00534_functions_bad_arguments10 2023-06-03 00:00:00 9 11.11111111111111
6 Stateless tests (msan) [4/6] 00534_functions_bad_arguments5 2023-06-02 00:00:00 30 20
7 Stateless tests (msan) [4/6] 00534_functions_bad_arguments5 2023-06-03 00:00:00 9 11.11111111111111
8 Stateless tests (msan) [4/6] 00534_functions_bad_arguments6 2023-06-02 00:00:00 30 20
9 Stateless tests (msan) [4/6] 00534_functions_bad_arguments6 2023-06-03 00:00:00 9 11.11111111111111
10 Stateless tests (msan) [4/6] 00534_functions_bad_arguments9 2023-06-02 00:00:00 30 20
11 Stateless tests (msan) [4/6] 00534_functions_bad_arguments9 2023-06-03 00:00:00 9 11.11111111111111

Example run:
https://s3.amazonaws.com/clickhouse-test-reports/50594/29e886fdf4e90a48b303e49f15c276e04f3cc7d2/stateless_tests__msan__[3_6].html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
fuzz Problem found by one of the fuzzers
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants