Skip to content

Releases: FAI-Solutions/Continue-NIM-Proxy

NIM Proxy

Choose a tag to compare

@FAI-Solutions FAI-Solutions released this 01 Jun 22:00
1f7b084

Fixes Step 3.7 Flash (NIM Endpoint) silently returning empty responses in Continue . By putting a proxy between Continue and NIM, to fix things per request.


What is New:

  1. Preserving tool_calls chunks so Continue can execute tools
  2. Real-time Streaming

NIM Proxy

Choose a tag to compare

@FAI-Solutions FAI-Solutions released this 31 May 11:36
394e688

Fixes Step 3.7 Flash (NIM Endpoint) silently returning empty responses in Continue .


Sits between Continue and NIM, fixing things per request:

  1. Strips min_p from outgoing requests (causes silent HTTP 400)
  2. Strips usage from content chunks in the streaming response (causes silent empty reply)
  3. Strips reasoning/reasoning_content chunks (they had empty content)