Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upgrade to postgres 12 with jit off #4390

Merged
merged 7 commits into from Aug 11, 2021
Merged

Conversation

denis-yuen
Copy link
Member

@denis-yuen denis-yuen commented Aug 5, 2021

companion for #4388

comparable performance to postgres 11 if we turn off jit
background at https://severalnines.com/database-blog/overview-just-time-compilation-jit-postgresql or hhttps://dba.stackexchange.com/questions/257759/recursive-cte-based-on-function-values-significantly-slower-on-postgres-12-than/258493#258493
guessing this might be a testing only issue since llvm should be available in the docker image, but we are inserting and dropping data rapidly which may be throwing off the query planner

@denis-yuen denis-yuen self-assigned this Aug 5, 2021
@denis-yuen denis-yuen changed the title test this out for some binary search action test postgres 12.7 out for some binary search action Aug 5, 2021
@codecov
Copy link

codecov bot commented Aug 5, 2021

Codecov Report

Merging #4390 (b68f28d) into develop (6f701da) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##             develop    #4390   +/-   ##
==========================================
  Coverage      69.23%   69.23%           
  Complexity      3694     3694           
==========================================
  Files            267      267           
  Lines          15205    15205           
  Branches        1653     1653           
==========================================
  Hits           10527    10527           
  Misses          3909     3909           
  Partials         769      769           
Flag Coverage Δ
integrationtests 57.61% <ø> (ø)
languageparsingtests 0.57% <ø> (ø)
toolintegrationtests 30.22% <ø> (ø)
workflowintegrationtests 42.55% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6f701da...b68f28d. Read the comment docs.

@denis-yuen
Copy link
Member Author

[INFO] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 846.903 s - in io.dockstore.webservice.WebhookIT
[INFO] testGithubDirDockstoreYml(io.dockstore.webservice.WebhookIT)  Time elapsed: 26.859 s
[INFO] testTestParameterPaths(io.dockstore.webservice.WebhookIT)  Time elapsed: 24.65 s
[INFO] testDescriptorChange(io.dockstore.webservice.WebhookIT)  Time elapsed: 61.915 s
[INFO] testTools(io.dockstore.webservice.WebhookIT)  Time elapsed: 69.005 s
[INFO] testGitHubReleaseNoWorkflowOnDockstore(io.dockstore.webservice.WebhookIT)  Time elapsed: 128.18 s
[INFO] testWorkflowMigration(io.dockstore.webservice.WebhookIT)  Time elapsed: 89.227 s
[INFO] testGitHubReleaseNoWorkflowOnDockstoreNoUser(io.dockstore.webservice.WebhookIT)  Time elapsed: 25.132 s
[INFO] testDockstoreYmlFilters(io.dockstore.webservice.WebhookIT)  Time elapsed: 129.888 s
[INFO] testDockstoreYmlAuthors(io.dockstore.webservice.WebhookIT)  Time elapsed: 86.305 s
[INFO] testInvalidDockstoreYmlFiles(io.dockstore.webservice.WebhookIT)  Time elapsed: 48.153 s
[INFO] testManualRefreshWorkflowWithGitHubApp(io.dockstore.webservice.WebhookIT)  Time elapsed: 30.555 s
[INFO] testDockstoreYmlPublish(io.dockstore.webservice.WebhookIT)  Time elapsed: 36.618 s
[INFO] testDeleteDefaultWorkflowVersion(io.dockstore.webservice.WebhookIT)  Time elapsed: 78.215 s

No good

@denis-yuen
Copy link
Member Author

[INFO] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 885.169 s - in io.dockstore.webservice.WebhookIT
[INFO] testGithubDirDockstoreYml(io.dockstore.webservice.WebhookIT)  Time elapsed: 28.049 s
[INFO] testTestParameterPaths(io.dockstore.webservice.WebhookIT)  Time elapsed: 25.924 s
[INFO] testDescriptorChange(io.dockstore.webservice.WebhookIT)  Time elapsed: 63.284 s
[INFO] testTools(io.dockstore.webservice.WebhookIT)  Time elapsed: 69.913 s
[INFO] testGitHubReleaseNoWorkflowOnDockstore(io.dockstore.webservice.WebhookIT)  Time elapsed: 171.052 s
[INFO] testWorkflowMigration(io.dockstore.webservice.WebhookIT)  Time elapsed: 109.252 s
[INFO] testGitHubReleaseNoWorkflowOnDockstoreNoUser(io.dockstore.webservice.WebhookIT)  Time elapsed: 26.693 s
[INFO] testDockstoreYmlFilters(io.dockstore.webservice.WebhookIT)  Time elapsed: 123.056 s
[INFO] testDockstoreYmlAuthors(io.dockstore.webservice.WebhookIT)  Time elapsed: 77.394 s
[INFO] testInvalidDockstoreYmlFiles(io.dockstore.webservice.WebhookIT)  Time elapsed: 43.372 s
[INFO] testManualRefreshWorkflowWithGitHubApp(io.dockstore.webservice.WebhookIT)  Time elapsed: 27.933 s
[INFO] testDockstoreYmlPublish(io.dockstore.webservice.WebhookIT)  Time elapsed: 34.45 s
[INFO] testDeleteDefaultWorkflowVersion(io.dockstore.webservice.WebhookIT)  Time elapsed: 72.553 s

nope, 12.0 is slow too

Merge branch 'develop' into feature/what_about_12
@denis-yuen
Copy link
Member Author

denis-yuen commented Aug 9, 2021

Notes on factors to rule out via local testing:

@sonarcloud
Copy link

sonarcloud bot commented Aug 9, 2021

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

@denis-yuen denis-yuen marked this pull request as ready for review August 9, 2021 18:18
@denis-yuen denis-yuen changed the title test postgres 12.7 out for some binary search action upgrade to postgres 12 with jit off Aug 9, 2021
Copy link
Contributor

@coverbeck coverbeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you closing this PR in favor of the 13.x one?

@@ -42,7 +42,7 @@ services:
# networks:
# - elastic
postgres_db:
image: postgres:11.12
image: postgres:12.7
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add command here as well?

@denis-yuen
Copy link
Member Author

denis-yuen commented Aug 10, 2021

Are you closing this PR in favor of the 13.x one?

No, the performance is slightly different and just in case of other issues we discover, I think I'll squash this one before the postgres 13 one so we can pick and choose whether to revert to 12 or 11 "next" time.

Add command here as well?

Undecided, I think I'll create a ticket to investigate when we get the performance testing back up. We're second guessing the query planner here and while that pays off in our tests, I'm not sure that is the case for "real".

https://ucsc-cgl.atlassian.net/browse/SEAB-3226

Copy link
Contributor

@coverbeck coverbeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI, I made this comment on https://ucsc-cgl.atlassian.net/browse/SEAB-3226, but I believe JIT is off by default in RDS.

@denis-yuen denis-yuen merged commit 4012b88 into develop Aug 11, 2021
@denis-yuen denis-yuen deleted the feature/what_about_12 branch August 11, 2021 16:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants