Skip to content

Tags: IBM/vllm

Tags

release.2a60ad37

🐛 change fork to spawn

Signed-off-by: Joe Runde <joe@joerun.de>

release.d23dd6d5

🐛 fix guided decoding

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

release.875e1007

add install of libsodium (#42)

To support encryption of model weights with tensorizer

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>

upstream-pr-4837-test.05af874a

Verified

This commit was signed with the committer’s verified signature.
maxdebayser Maximilien de Bayser
Squash 4837

release.fc0daf4a

⚗️ turn it way down and wait

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

release.2ac2b2d9

🐛 fix prometheus metric labels (#27)

This fixes a miss where I had seen usages of `.labels` `**`a dictionary
into kwargs, and I accidentally passed a raw dictionary as a value
instead of using keyword arguments 🤦. This caused metrics to show eg.
`method="{'method':'prefill'}"` instead of `method=prefill`

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

release.4e3ff784

🐛 set paths for wheel built

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

release.74803b6

Fix logits processor handling

release.87300e2

Squash 3125

release.4ea041f

Squash 3645