Rust SDK always downloads the model (even when cached)

[samuel100]

The Rust SDK will always download the model - irrespective of whether it is cached or not. If the model is cached, it should not re-download.

Looking at the code, I think this line is sending the force in the message body to Neutron rather than in the query i.e. openai/download?force={force}.

AB#68998

[cicorias]

This PR updates the Rust sample — and I’ve not seen that behavior for what is on Main branch..

#158

In fact, without the change in that PR, it would fail for me — i.e prompt fails with no response from the service, and the client kicks it with “ Error: error decoding response body: EOF while parsing a value at line 1 column 0”

[natke]

@samuel100 can you confirm you still see the behavior?

[shaahji]

I retried this on current main and still not reproducible.