A work-stealing data loader designed around optimal load batching and connection utilization. Loads are batched via thread local queues and task handlers are spawned to meet capacity. As field resolvers within the same request will already be scheduled, subsequent loads within the same request will be scheduled prior to the load task handler taking a task assignment and upon connection acquisition, all load requests will have been captured and loads by separate requests can be opportunistically batched together without introducing timeout overhead.
work stealing data loader
License
Bajix/deque-loader-rs
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
work stealing data loader
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published