Skip to content
This repository has been archived by the owner on Jul 31, 2023. It is now read-only.

Build a cache internal to pull spec evaluation in order to deduplicate subframe evaluation #61

Open
tylerwilding-wk opened this issue Jul 8, 2019 · 0 comments
Labels
enhancement New feature or request

Comments

@tylerwilding-wk
Copy link
Contributor

tylerwilding-wk commented Jul 8, 2019

Internally, during a pull evaluation, generated subframes may be duplicated an arbitrary number of times. Consider the spec [{:ref [*]}] being evaluated on 10000 distinct entities which all have a :ref to the same single entity. There will be 10000 distinct subframes generated for that entity, 9999 of which could be eliminated and the single output simply repeated in the construction of the pull's final output.

An internal cache of [eid spec], (or perhaps even something more granular, like [eid attr]) which could greatly reduce the total amount of IO required of pull in many cases.

@tylerwilding-wk tylerwilding-wk added the enhancement New feature or request label Jul 8, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant