bug: Isolate stdout from the API server and CLI - I sent an API request, but it output an error message to an inactive shell session.

[louis-jan]

Cortex version

v1.0.0-168

Describe the Bug

I have finished the shell session of models list, but somehow, when I send API requests, it keeps stdout from an inactive shell session. See attached screenshot, weird.

Steps to Reproduce

1. Start API Server
2. Run any command such as models list
3. Send API request
4. See the shell output

Screenshots / Logs

What is your OS?

• MacOS
• Windows
• Linux

What engine are you running?

• cortex.llamacpp (default)
• cortex.tensorrt-llm (Nvidia GPUs)
• cortex.onnx (NPUs, DirectML)

[gabrielle-ong]

@louis-jan checking if this is resolved for you with the latest v172?
I dont get any stdout from the inactive shell session (which is good)

[louis-jan]

It still 😆