Skip to content

[query] Use EType encodings instead of JSON to send data to Python - #10971

Merged
danking merged 45 commits into
hail-is:mainfrom
johnc1231:johnc-etypes-python
Oct 19, 2021
Merged

[query] Use EType encodings instead of JSON to send data to Python#10971
danking merged 45 commits into
hail-is:mainfrom
johnc1231:johnc-etypes-python

Conversation

@johnc1231

@johnc1231 johnc1231 commented Oct 12, 2021

Copy link
Copy Markdown
Contributor

Timings: https://gist.github.com/johnc1231/253aed65af131c2f67af2576c350d6a7

Basically the benchmark designed for this to fix got 3x better, and most other things didn't change. That's about what I expected.

… of int structs is slightly faster than JSON equivalent
…depath that correctly handles HailUserErrors
@johnc1231
johnc1231 force-pushed the johnc-etypes-python branch from e6bce79 to 871985c Compare October 18, 2021 17:22
@danking
danking merged commit 7ce6c7b into hail-is:main Oct 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants