Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ingesting lots of data into Nix: builtins.fromCBOR / builtins.fromBSON #7826

Open
Ericson2314 opened this issue Feb 13, 2023 · 0 comments
Open
Labels
feature Feature request or proposal language The Nix expression language; parser, interpreter, primops, evaluation, etc

Comments

@Ericson2314
Copy link
Member

Is your feature request related to a problem? Please describe.

Multiple third-party tools are known rely on reading large amounts of data into Nix expressions with builtins.fromJSON. This is a performance consideration, especially for CI use cases. Adding a way to read in structured data in a compact representation would solve that problem for those cases.

Describe the solution you'd like

Allowing ingesting data from a 3rd-party-standardized binary format that is easy to parse very quickly.

Describe alternatives you've considered

#7825, which has stability and expressive power challenges, but on the other hand supports lazy loading and random access.

Additional context
As proposed by @Ericson2314 and @edolstra and discussed by the Nix team.

Priorities

Add 👍 to issues you find important.

@Ericson2314 Ericson2314 added the feature Feature request or proposal label Feb 13, 2023
@roberth roberth added the language The Nix expression language; parser, interpreter, primops, evaluation, etc label Mar 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Feature request or proposal language The Nix expression language; parser, interpreter, primops, evaluation, etc
Projects
None yet
Development

No branches or pull requests

2 participants