Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expand section on "Serializing Large Datasets" #29

Open
gkellogg opened this issue Jan 22, 2021 · 0 comments
Open

Expand section on "Serializing Large Datasets" #29

gkellogg opened this issue Jan 22, 2021 · 0 comments
Labels
advanced topic help wanted Extra attention is needed

Comments

@gkellogg
Copy link
Member

Of note are discussions in w3c/json-ld-syntax#366 and rubensworks/jsonld-streaming-parser.js#65. Best practices should include the principles of JSON-LD streaming, where keys come in a strict order, as well as the use of the streaming document profile so that clients understand the considerations for order of processing when expanding JSON-LD and turning into RDF.

Alternatively, serializations can be limited to a flattened representation so that state does not need to be managed over a large set of embedded nodes (this is probably the most natural way to blindly serialize a large dataset, in any case.

The core JSON-LD API algorithms are intended to work in memory, which is incompatible with the needs of medium to large datasets.

cc/ @wouterbeek @rubensworks

@gkellogg gkellogg added help wanted Extra attention is needed advanced topic labels Jan 22, 2021
@gkellogg gkellogg added this to Non TR Work in JSON-LD Management DEPRECATED Jun 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
advanced topic help wanted Extra attention is needed
Projects
Status: Non TR Work
Development

No branches or pull requests

1 participant