refactor(file_uploads): implement proper Tower layer and fix HTTP client buffering #7693
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Task
Refactor file uploads plugin from a temporary function-based approach to a proper Tower layer implementation, and resolve HTTP client service buffering issues that were causing runtime panics.
Why This Change Is Needed
The file uploads functionality was implemented as a temporary solution using direct function calls (
http_request_wrapper
) in the subgraph service, which violated Tower service architecture principles and created technical debt. Additionally, the HTTP client service buffering was causingpoll_ready
panics due to improper Tower service call patterns.Key issues resolved:
`send_item` called without first calling `poll_reserve`
How It Was Tackled
Layer Implementation
FileUploadLayer
andFileUploadService
following established Tower patternshttp_client_service
method inFileUploadsPlugin
http_request_wrapper
function call from subgraph serviceService Buffering Fixes
.buffer(DEFAULT_BUFFER_SIZE)
to.buffered()
for proper Clone handlingdo_fetch
to use.oneshot()
instead of.call()
for correct Tower semanticsTechnical Details
Tower Service Patterns
FileUploadService
implements proper TowerService
trait with async request transformationServiceBuilder
HTTP Client Service Buffering
.buffered()
uses router'sServiceBuilderExt
which handles Clone requirements correctly.oneshot()
ensures properpoll_ready
/call
sequencing in Tower servicesCurrent Limitation
Note: The HTTP client service is currently recreated for each request rather than being cached like other services. This will be addressed in a separate PR to implement proper caching at the factory level.
Review Strategy
Architecture Review
FileUploadLayer
follows established plugin patternsTesting Focus
Checklist
Complete the checklist (and note appropriate exceptions) before the PR is marked ready-for-review.
Exceptions
Note any exceptions here
Notes
Footnotes
It may be appropriate to bring upcoming changes to the attention of other (impacted) groups. Please endeavour to do this before seeking PR approval. The mechanism for doing this will vary considerably, so use your judgement as to how and when to do this. ↩
Configuration is an important part of many changes. Where applicable please try to document configuration examples. ↩
A lot of (if not most) features benefit from built-in observability and
debug
-level logs. Please read this guidance on metrics best-practices. ↩Tick whichever testing boxes are applicable. If you are adding Manual Tests, please document the manual testing (extensively) in the Exceptions. ↩