Parsing Error Raised when Attempting to Run Example Code

[Arahat-Chikkatur]

I installed the scale-llm engine using pip for windows and am currently running it on python. To test the engine, I ran the example code shown on the website for the engine. However, I ran into the following error.

Below is the code that was used, along with the code that raised the error


Any help would be appreciated

[rkaplan]

Thanks for filing @Arahat-Chikkatur. Looking into it.

[Arahat-Chikkatur]

I have fixed the Not Found Error using the following fix

As os.path.join added a backslash instead of forward slash. However, I now get an error for an invalid API key despite using a valid key. Running this code on a mac with the same key worked, meaning it is not an issue with the key. Here is the error message

Any help would be apprieciated.

[yunfeng-scale]

Hi @Arahat-Chikkatur, thanks for reporting issues on Windows. However we're focused on supporting macOS / Linux right now and we don't have resource to support running LLM Engine e2e on Windows at this time.

[yixu34]

We can leave this issue open for another 30 days or so in case there is additional demand/interest in Windows, but yeah what @yunfeng-scale said is correct.

[saiatmakuri]

With #225, the Completions API should work on Windows machines and I'm unable to reproduce this issue.

I believe the underlying issue lied with how the auth was done with the request at the time of this PR. Specifically, missing this param in the POST request:

auth=(api_key, "")

This was addressed in #181.