Skip to content

Conversation

zhuohan123
Copy link
Member

The latest Ray limits the smallest fraction of node resources. Modify it to a larger number.

Fix #173.

@zhuohan123 zhuohan123 requested a review from WoosukKwon June 21, 2023 16:03
Copy link
Collaborator

@WoosukKwon WoosukKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks for fixing the bug!

@zhuohan123 zhuohan123 changed the title Fix Ray node resources error. Fix Ray node resources error Jun 21, 2023
@zhuohan123 zhuohan123 merged commit 2e0d314 into main Jun 21, 2023
@zhuohan123 zhuohan123 deleted the fix-ray branch June 21, 2023 16:21
@WoosukKwon WoosukKwon mentioned this pull request Jun 21, 2023
hongxiayang pushed a commit to hongxiayang/vllm that referenced this pull request Feb 13, 2024
yukavio pushed a commit to yukavio/vllm that referenced this pull request Jul 3, 2024
SUMMARY:
* seed workflow for neuralmagic publish whl and tar workflow

TEST PLAN:
i'll be iterating on this going forward

---------

Co-authored-by: andy-neuma <andy@neuralmagic.com>
mht-sharma pushed a commit to mht-sharma/vllm that referenced this pull request Oct 30, 2024
vllm-project#193)

* [Grok-1] 1. upload moe configuration file for moe kernel optimization 2. support "--num-scheduler-steps" in benchmark_latency.py

* [Grok-1] 1. upload moe configuration file for moe kernel optimization 2. add copy of benchmark_latency.py to support "--num-scheduler-steps"

* [Grok-1] add option num-scheduler-steps in benchmark_latency.py
yma11 added a commit to yma11/vllm that referenced this pull request Jun 4, 2025
…cannot on bmg e211 (vllm-project#193)

* update whls (vllm-project#192)

* fix docker image built from the currently delivered Dockerfile cannot detect the GPU on the 4*24GB BMG(e211)

* return randn when profile (vllm-project#195)

* return randn when profile

* use random_(0, 10)

* fix docker image built from the currently delivered Dockerfile cannot detect the GPU on the 4*24GB BMG(e211)

Signed-off-by: ChaoJun Zhang <chzhang@habana.ai>

---------

Signed-off-by: ChaoJun Zhang <chzhang@habana.ai>
Co-authored-by: Yan Ma <yanma1@habana.ai>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
amy-why-3459 pushed a commit to amy-why-3459/vllm that referenced this pull request Sep 15, 2025
Bumps [actions/setup-python](https://github.com/actions/setup-python)
from 5.3.0 to 5.4.0.

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ValueError: The precision of the fractional quantity of resource
2 participants