-
Notifications
You must be signed in to change notification settings - Fork 238
Closed
Description
After I launch optillm service using
python optillm.py --base_url http://localhost:8082/v1
I started another terminal to run my own python script using
python xxx.py under optillm/scripts/
In the script I made requests like
response = client.chat.completions.create(
model="spl-Qwen/Qwen2.5-7B-Instruct",
messages=[
{"role": "system", "content": system_prompt},
{"role": "user", "content": user_prompt}
],
extra_body= {"spl_learning": True},
)
However I got error
Error processing request: attempted relative import with no known parent package

Metadata
Metadata
Assignees
Labels
No labels