Skip to content

Introduce BlobPump and MessagePump#149

Merged
ian-t-adams merged 46 commits into
mainfrom
Streaming-Release-TR
May 4, 2026
Merged

Introduce BlobPump and MessagePump#149
ian-t-adams merged 46 commits into
mainfrom
Streaming-Release-TR

Conversation

@nagendramishr
Copy link
Copy Markdown
Collaborator

@nagendramishr nagendramishr commented May 1, 2026

Proyx:

  • Code restructure for Async work
  • Streamline event draining process for SB and file logger
  • Refactor blob writer methods
  • Load async templates at startup
  • Bug fix: don't activate ciruit breaker on async shutdown
  • Cleanup async shutdown
  • Bug fix: possible loss of async Queue message
  • Add configurations for AsyncBlobMaxQueue and AsyncStreamingBufferSizeBytes
  • Don't trigger Async if AsyncBlobMaxQueue is exceeded
  • Bug fix: don't cache the streaming response when writing to a blob
  • Optimize the blob writer for throughput for streaming and file writing
  • If the templates folder is not readable, turn off async mode
  • Bug fix: storage account by connection was not working

Deployment:

  • Create a deployment script to configure storage account

nagendramishr and others added 30 commits April 21, 2026 17:57
@nagendramishr
fix async startup issues
047d329
@nagendramishr
introduce AsyncRequestStore as a way to simplify
8b01396
@nagendramishr
cleanup shutdown messages
8762d25
@nagendramishr
cleanup shutdown messages
ec8e120
@nagendramishr
blob writer improvements
005be18
@nagendramishr
move code into async
7fa5b88
@nagendramishr
move code into async, load Tempaltes startup
59c9799
@nagendramishr
add template messages
7026d06
@nagendramishr
use message from messageloader
1a28221
@nagendramishr
moved log to startup from shutdown
ec05dc4
@nagendramishr
don't log circuit breaker on eviction
a9cfff7
@nagendramishr
don't log flushing when nothing to flush
6d263b8
@nagendramishr
move AsyncResponseTypeEnum into its own file
d6a68fc
@nagendramishr
remove hard coded strings
7f07272
@nagendramishr
normalize logging
55716dd
@nagendramishr
normalize logging
984fbaa
@nagendramishr
generalize messaging logic into Events, Files, SBMessages
e2d7e3e
@nagendramishr
normalize logging
5d43095
@nagendramishr
generalize messaging logic into Events, Files, SBMessages
e429fa0
@nagendramishr
normalize logging, fix SB status race condition
241434b
@nagendramishr
show stacktrace in case of failure to shutdown
965cf64
@nagendramishr
remove older file
8d9216b
@nagendramishr
output sample env vars based on defaults
c90efc1
@nagendramishr
misc commits for testing
19c1eb7
@nagendramishr
add troubleshooting
395c16f
@samchang-msft
Add missing environment variable that instructions say to use
81a36a9
@samchang-msft
Release HTTP listener on shutdown to free up the port for next startu…
a0527bd 
…p when running locally
@nagendramishr
update docs for clarity
e2f91a2
@nagendramishr
added sample doc
b2df280
@nagendramishr
added sample doc
9ce2022
MarvelintheCloud and others added 16 commits April 29, 2026 20:36
@MarvelintheCloud
docs: add no-Docker deployment path via remote ACR build
e66bc28
@nagendramishr
Merge branch 'feature-direct-backend' into docs/remote-acr-no-docker
e37f18e
@nagendramishr
Merge pull request #147 from MarvelintheCloud/docs/remote-acr-no-docker
5ef0c48 
docs: add no-Docker deployment path via remote ACR build
@nagendramishr
Merge pull request #146 from samchang-msft/improve-startup-instructio…
d372ac1 
…ns-for-feature-direct-backend

Improve startup instructions
@nagendramishr
load templates from blob at startup
757e51d
@nagendramishr
make the message pump more generic
ca01078
@nagendramishr
add AsyncBlobMaxQueue and AsyncStreamingBufferSizeBytes configs
4f8ac1f
@nagendramishr
seperate into Stream and File storage
1f03d00
@nagendramishr
make the message pump more generic
4952913
@nagendramishr
update shutdown messages with more concice logs
e480927
@nagendramishr
move blob logic to lower layers
1789f41
@nagendramishr
blob writer dont need to know about user's
eb8382a
@nagendramishr
back pressure when theres a lot of blobs
2d9a023
@nagendramishr
update to version 2.2.11
59061cb
@nagendramishr
cleanp the build
814faa5
@nagendramishr
Merge pull request #148 from microsoft/feature-direct-backend
c8ac5ec 
BlobPump and cleanup
@nagendramishr nagendramishr requested a review from ian-t-adams May 1, 2026 20:45
ian-t-adams
ian-t-adams approved these changes May 4, 2026
View reviewed changes
Copy link
Copy Markdown
Collaborator

@ian-t-adams ian-t-adams left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Streaming goes mainstream.

@ian-t-adams ian-t-adams merged commit 3be4f2a into main May 4, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ian-t-adams ian-t-adams ian-t-adams approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@nagendramishr @ian-t-adams @samchang-msft @MarvelintheCloud