Skip to content
This repository has been archived by the owner on Apr 18, 2024. It is now read-only.

Adaptive Pool #116

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Adaptive Pool #116

wants to merge 7 commits into from

Conversation

willscott
Copy link
Contributor

@willscott willscott commented Jul 8, 2023

Working on reflecting the design described in "Caboose Adaptive Pool"

  • This moves tracking / statistics updates within a Node object, rather than spread across the code as it exists now.
  • Refactors code for some clearer division of responsibilities
  • Uses the FetchResourceWith code path for all requests - blocks are redirected to a standard car request, which the block is then read out of.

willscott and others added 7 commits July 8, 2023 13:59
* feat: modify pool tests

* fix: top n node selection from heap

* feat: add more comprehensive tests

* enhancement: add refresh no to tests

* go fmt

* remove unused metrics

* put back trace

* response size does not include header

* reset retry counter only if progress is made

* update go-car

* dont drain response body

* send verification errors to Saturn

* pool tier promotion

* otel and send trace id to Saturn

* stabilize dynamics tests

* mirroring parallel

* pool-target-size through config to better test dynamics

* down to flakiness

* add substitution (rough)

* use new orchestrator API

* fix: top N selection

* enhancement: increase test size

* feat: Add tests for affinity

* test cache affinity

* test cache affinity

* remove assert

* fix test

* address review

* feat: port compliance cids

* fix: remove unused code

* modify harness

* feat: add core attr to trace span

* fix CI

* improve error classification (#165)

---------

Co-authored-by: Aarsh Shah <aarshkshah1992@gmail.com>
Co-authored-by: Will Scott <will.scott@protocol.ai>
@willscott willscott marked this pull request as ready for review October 10, 2023 09:18
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants