v1.34.0
Full Changelog: v1.33.9...v1.34.0
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 38 | 42.04039730334579 | 1.596504378868726 | 0.0 | 478 | 0 | 35.187763999942945 | 524.0036399999326 |
| /health/liveliness | Passed ✅ | 25 | 27.013957424801724 | 15.567587677629984 | 0.0 | 4661 | 0 | 23.172639999984312 | 896.960622999984 |
| /health/readiness | Passed ✅ | 25 | 27.542442462175806 | 15.717886207021392 | 0.0 | 4706 | 0 | 23.277541000027213 | 1057.5831259999973 |
| Aggregated | Passed ✅ | 25 | 27.996150299136485 | 32.881978263520104 | 0.0 | 9845 | 0 | 23.172639999984312 | 1057.5831259999973 |