Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bugfix] Fix persisting of vep, logistic regression, poisson regression #5416

Merged
merged 1 commit into from
Feb 22, 2019

Conversation

tpoterba
Copy link
Contributor

None of these methods were appropriately persisting, since the call was
in Scala. Since the Python IR was evaluated each time, the a new RVD
would be created and persisted on each call to backend.execute, and
the previous persisted RVDs would only be used once.

We need to be on the lookout for this pattern as we convert more
operations to MatrixToTableFunctions and friends

@tpoterba tpoterba assigned cseed and chrisvittal and unassigned cseed Feb 22, 2019
None of these methods were appropriately persisting, since the call was
in Scala. Since the Python IR was evaluated each time, the a new RVD
would be created and persisted on each call to backend.execute, and
the previous persisted RVDs would only be used once.

We need to be on the lookout for this pattern as we convert more
operations to MatrixToTableFunctions and friends
@cseed
Copy link
Collaborator

cseed commented Feb 22, 2019

Oh, good catch. This is something we can also test for in the performance test suite: compute and use twice.

@cseed cseed assigned cseed and unassigned chrisvittal Feb 22, 2019
@tpoterba tpoterba changed the title Fix persisting of vep, logistic regression, poisson regression [bugfix] Fix persisting of vep, logistic regression, poisson regression Feb 22, 2019
@danking danking merged commit fda6041 into hail-is:master Feb 22, 2019
@tpoterba tpoterba deleted the fix-vep-persisting branch February 22, 2019 18:23
@tpoterba tpoterba restored the fix-vep-persisting branch November 7, 2019 17:03
@johnc1231 johnc1231 mentioned this pull request Feb 25, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants