Releases: FAI-Solutions/Continue-NIM-Proxy
Releases · FAI-Solutions/Continue-NIM-Proxy
Release list
NIM Proxy
Fixes Step 3.7 Flash (NIM Endpoint) silently returning empty responses in Continue . By putting a proxy between Continue and NIM, to fix things per request.
What is New:
- Preserving tool_calls chunks so Continue can execute tools
- Real-time Streaming
NIM Proxy
Fixes Step 3.7 Flash (NIM Endpoint) silently returning empty responses in Continue .
Sits between Continue and NIM, fixing things per request:
- Strips
min_pfrom outgoing requests (causes silent HTTP 400) - Strips
usagefrom content chunks in the streaming response (causes silent empty reply) - Strips
reasoning/reasoning_contentchunks (they had empty content)