Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(core): allow server to perform graceful shutdown under heavy ILP load #3361

Merged
merged 7 commits into from May 18, 2023

Conversation

bluestreak01
Copy link
Member

@bluestreak01 bluestreak01 commented May 17, 2023

ILP jobs were in greedy mode never releasing thread unless socket is empty. This could lead to bad user experience on smaller instances where ILP jobs run from shared pool.

The fix is to re-queue socket after every measurement. There is no notable impact on performance.

In Summary:

  • fix O3 test failure when sync is enabled
  • fix O3 commit() hanging when sync fails
  • fix graceful shutdown under heavy ingest load
  • fix graceful shutdown after catastrophic disk failure

@bluestreak01 bluestreak01 marked this pull request as draft May 17, 2023 16:18
@bluestreak01 bluestreak01 marked this pull request as ready for review May 17, 2023 18:44
@bluestreak01
Copy link
Member Author

failed #2774 on Mac

@ideoma
Copy link
Collaborator

ideoma commented May 18, 2023

[PR Coverage check]

😍 pass : 23 / 23 (100.00%)

file detail

path covered line new line coverage
🔵 io/questdb/cairo/O3CopyJob.java 20 20 100.00%
🔵 io/questdb/cutlass/line/tcp/LineTcpConnectionContext.java 3 3 100.00%

@bluestreak01 bluestreak01 merged commit 8eebcea into master May 18, 2023
20 checks passed
@bluestreak01 bluestreak01 deleted the vi_graceful_shutdown branch May 18, 2023 21:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants