Skip to content

Conversation

@dependabot
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Apr 7, 2025

Bumps the pip group with 1 update in the /api-server/qna-eval directory: vllm.

Updates vllm from 0.8.0 to 0.8.2

Release notes

Sourced from vllm's releases.

v0.8.2

This release contains important bug fix for the V1 engine's memory usage. We highly recommend you upgrading!

Highlights

  • Revert "Use uv python for docker rather than ppa:deadsnakess/ppa (#13569)" (#15377)
  • Remove openvino support in favor of external plugin (#15339)

V1 Engine

  • Fix V1 Engine crash while handling requests with duplicate request id (#15043)
  • Support FP8 KV Cache (#14570, #15191)
  • Add flag to disable cascade attention (#15243)
  • Scheduler Refactoring: Add Scheduler Interface (#15250)
  • Structured Output
    • Add disable-any-whitespace option support for xgrammar (#15316)
    • guidance backend for structured output + auto fallback mode (#14779)
  • Spec Decode
    • Enable spec decode for top-p & top-k sampling (#15063)
    • Use better defaults for N-gram (#15358)
    • Update target_logits in place for rejection sampling (#15427)
  • AMD
    • Enable Triton(ROCm) Attention backend for Nvidia GPUs (#14071)
  • TPU
    • Support V1 Sampler for ragged attention (#14227)
    • Tensor parallel MP support (#15059)
    • MHA Pallas backend (#15288)

Features

  • Integrate fastsafetensors loader for loading model weights (#10647)
  • Add guidance backend for structured output (#14589)

Others

  • Add Kubernetes deployment guide with CPUs (#14865)
  • Support reset prefix cache by specified device (#15003)
  • Support tool calling and reasoning parser (#14511)
  • Support --disable-uvicorn-access-log parameters (#14754)
  • Support Tele-FLM Model (#15023)
  • Add pipeline parallel support to TransformersModel (#12832)
  • Enable CUDA graph support for llama 3.2 vision (#14917)

What's Changed

... (truncated)

Commits
  • 25f560a [V1][Spec Decode] Update target_logits in place for rejection sampling (#15427)
  • a09ad90 [V1] guidance backend for structured output + auto fallback mode (#14779)
  • 10b34e3 [Bugfix] Fixed the issue of not being able to input video and image simultane...
  • b5269db Revert "Fix non-contiguous input passed to Marlin kernel (#15319)" (#15398)
  • 6db9457 [Misc] Remove LoRA log (#15388)
  • 97cfa65 Add pipeline parallel support to TransformersModel (#12832)
  • 911c8eb [Minor][Spec Decode] Remove compiled_softmax (#15416)
  • ebcebee [V1][Spec Decode] Enable spec decode for top-p & top-k sampling (#15063)
  • f533b58 [ROCm][Kernel] MoE weights padding (#14454)
  • 8279201 [Build] Cython compilation support fix (#14296)
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore <dependency name> major version will close this group update PR and stop Dependabot creating any more for the specific dependency's major version (unless you unignore this specific dependency's major version or upgrade to it yourself)
  • @dependabot ignore <dependency name> minor version will close this group update PR and stop Dependabot creating any more for the specific dependency's minor version (unless you unignore this specific dependency's minor version or upgrade to it yourself)
  • @dependabot ignore <dependency name> will close this group update PR and stop Dependabot creating any more for the specific dependency (unless you unignore this specific dependency or upgrade to it yourself)
  • @dependabot unignore <dependency name> will remove all of the ignore conditions of the specified dependency
  • @dependabot unignore <dependency name> <ignore condition> will remove the ignore condition of the specified dependency and ignore conditions
    You can disable automated security fix PRs for this repo from the Security Alerts page.

Bumps the pip group with 1 update in the /api-server/qna-eval directory: [vllm](https://github.com/vllm-project/vllm).


Updates `vllm` from 0.8.0 to 0.8.2
- [Release notes](https://github.com/vllm-project/vllm/releases)
- [Changelog](https://github.com/vllm-project/vllm/blob/main/RELEASE.md)
- [Commits](vllm-project/vllm@v0.8.0...v0.8.2)

---
updated-dependencies:
- dependency-name: vllm
  dependency-version: 0.8.2
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update Python code labels Apr 7, 2025
@vishnoianil vishnoianil merged commit d09a8ce into main Apr 7, 2025
10 checks passed
@dependabot dependabot bot deleted the dependabot/pip/api-server/qna-eval/pip-86ffcf81ac branch April 7, 2025 19:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update Python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants