Skip to content

[query] removes unnecessary serialization in is.hail.rvd.RVD.localSort - #13313

Merged
danking merged 1 commit into
hail-is:mainfrom
iris-garden:query/not-serializable
Jul 27, 2023
Merged

[query] removes unnecessary serialization in is.hail.rvd.RVD.localSort#13313
danking merged 1 commit into
hail-is:mainfrom
iris-garden:query/not-serializable

Conversation

@iris-garden

Copy link
Copy Markdown
Contributor

On the current release (0.2.119), is.hail.rvd.RVD.localSort attempts to serialize an entire is.hail.rvd.RVD object when called, which causes some operations, like reading a set of VCF files, to fail. That particular operation no longer fails due to some combination of the changes made to reading VCF files in #13206 and #13229, but the serialization could still cause issues if is.hail.rvd.RVD.localSort is called in another context.

See https://hail.zulipchat.com/#narrow/stream/123011-Hail-Query-Dev/topic/Possible.20bug.20in.20Hail.200.2E2.2E119/near/378610151 for more information.

@iris-garden
iris-garden force-pushed the query/not-serializable branch from 27a409e to f2b2a68 Compare July 27, 2023 13:54
@iris-garden iris-garden removed the WIP label Jul 27, 2023
@danking
danking merged commit c74530d into hail-is:main Jul 27, 2023
@danking danking mentioned this pull request Jul 27, 2023
danking pushed a commit to danking/hail that referenced this pull request Jul 27, 2023
tommyli added a commit to bioinfomethods/seqr-loading-pipelines that referenced this pull request Dec 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants