Repository navigation

v0.3.0

hlin99 released this 05 Apr 12:27

· 11 commits to main since this release

f155462

Changes since v0.2.0

Cap output tokens by max_model_len (vLLM behavior)
E2e proxy integration tests
E2e dependency changed to xpyd-proxy>=1.2.0
6 regression tests for max_model_len cap
7 e2e tests for proxy integration

Assets 2