Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: Make test_lfc_resize more robust #9117

Merged
merged 3 commits into from
Sep 24, 2024
Merged

Conversation

hlinnaka
Copy link
Contributor

@hlinnaka hlinnaka commented Sep 23, 2024

  1. Increase statement_timeout. It defaults to 120 s, which is not quite enough on slow or busy systems with debug build. On my laptop, the index creation takes about 100 s. On buildfarm, we've seen failures, e.g: https://neon-github-public-dev.s3.amazonaws.com/reports/pr-9084/10997888708/index.html#suites/821f97908a487f1d7d3a2a4dd1571e99/db1834bddfe8c5b9/

  2. Keep twiddling the LFC size through the whole test. Before, we would do it for the first 10 seconds, but that only covers a small part of the pgbench initialization phase. Change the loop so that the pgbench run time determines how long the test runs, and we keep changing the LFC for the whole time.

In the passing, also fix bogus test description, copy-pasted from a completely unrelated test.

@hlinnaka hlinnaka force-pushed the make-test_lfc_resize-more-robust branch 3 times, most recently from 63cc819 to dc32668 Compare September 23, 2024 20:04
hlinnaka added a commit that referenced this pull request Sep 23, 2024
1. Increase statement_timeout. It defaults to 120 s, which is not
   quite enough on slow or busy systems with debug build. On my
   laptop, the index creation takes about 100 s. On buildfarm, we've
   seen failures, e.g:
   https://neon-github-public-dev.s3.amazonaws.com/reports/pr-9084/10997888708/index.html#suites/821f97908a487f1d7d3a2a4dd1571e99/db1834bddfe8c5b9/

2. Keep twiddling the LFC size through the whole test. Before, we
   would do it for the first 10 seconds, but that only covers a small
   part of the pgbench initialization phase. Change the loop so that
   the pgbench run time determines how long the test runs, and we keep
   changing the LFC for the whole time.

In the passing, also fix bogus test description, copy-pasted from a
completely unrelated test.
Copy link

github-actions bot commented Sep 23, 2024

4986 tests run: 4822 passed, 0 failed, 164 skipped (full report)


Flaky tests (2)

Postgres 16

Postgres 14

Code coverage* (full report)

  • functions: 32.1% (7476 of 23255 functions)
  • lines: 50.0% (60237 of 120574 lines)

* collected from Rust tests only


The comment gets automatically updated with the latest test results
71c410f at 2024-09-24T20:10:46.952Z :recycle:

1. Increase statement_timeout. It defaults to 120 s, which is not
   quite enough on slow or busy systems with debug build. On my
   laptop, the index creation takes about 100 s. On buildfarm, we've
   seen failures, e.g:
   https://neon-github-public-dev.s3.amazonaws.com/reports/pr-9084/10997888708/index.html#suites/821f97908a487f1d7d3a2a4dd1571e99/db1834bddfe8c5b9/

2. Keep twiddling the LFC size through the whole test. Before, we
   would do it for the first 10 seconds, but that only covers a small
   part of the pgbench initialization phase. Change the loop so that
   the pgbench run time determines how long the test runs, and we keep
   changing the LFC for the whole time.

In the passing, also fix bogus test description, copy-pasted from a
completely unrelated test.
@hlinnaka hlinnaka force-pushed the make-test_lfc_resize-more-robust branch from dc32668 to 3af7845 Compare September 24, 2024 13:55
The CI failed on a few runs, but not all, on the last assertion. I
think that's because it might take a while for the system to react to
changing the setting. To fix, retry for up to 10 s
@hlinnaka hlinnaka force-pushed the make-test_lfc_resize-more-robust branch from 3af7845 to 5c45f1d Compare September 24, 2024 18:21
@hlinnaka hlinnaka merged commit af5c54e into main Sep 24, 2024
79 checks passed
@hlinnaka hlinnaka deleted the make-test_lfc_resize-more-robust branch September 24, 2024 20:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants