Skip to content

Stabilize memory, probe improvements, profile-soft-delete.

Choose a tag to compare

@nagendramishr nagendramishr released this 12 Jan 14:16
· 22 commits to Release-TR since this release

Repo:

  • Moved docs to their own folder

Policy:

  • Added x-ms-client-request-id to help debug with OpenAI in the future
  • copy back policy from stream version, disabled streaming
  • Retry if the endpoint returns a 200 with content-length = 0

Proxy:

  • Warning: Fix compiler warnings
  • Don't report the service as "UP" until the userProfile is loaded
  • UserConfigRequired triggers health check to fail if profiles are not loaded
  • Implemented soft-delete for user profiles with alert if request received for a soft-deleted profile
  • Streamlined health probes
  • Don't force the HTTP connection to close to backend after each request
  • Add /ForceGC to force GC
  • Add memory details to /health
  • Memory use improvements: Reuse proxy event objects throughout, pre-allocate size, EventHub client batch cleanup, stream response body rather than copy it.
  • Bug fixes for when app insights and EventHub are disabled