Stabilize memory, probe improvements, profile-soft-delete.
·
22 commits
to Release-TR
since this release
Repo:
- Moved docs to their own folder
Policy:
- Added x-ms-client-request-id to help debug with OpenAI in the future
- copy back policy from stream version, disabled streaming
- Retry if the endpoint returns a 200 with content-length = 0
Proxy:
- Warning: Fix compiler warnings
- Don't report the service as "UP" until the userProfile is loaded
- UserConfigRequired triggers health check to fail if profiles are not loaded
- Implemented soft-delete for user profiles with alert if request received for a soft-deleted profile
- Streamlined health probes
- Don't force the HTTP connection to close to backend after each request
- Add /ForceGC to force GC
- Add memory details to /health
- Memory use improvements: Reuse proxy event objects throughout, pre-allocate size, EventHub client batch cleanup, stream response body rather than copy it.
- Bug fixes for when app insights and EventHub are disabled