Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

can not delete kserve type job #1047

Closed
gujingit opened this issue Mar 6, 2024 · 2 comments · Fixed by #1051
Closed

can not delete kserve type job #1047

gujingit opened this issue Mar 6, 2024 · 2 comments · Fixed by #1051
Assignees

Comments

@gujingit
Copy link
Contributor

gujingit commented Mar 6, 2024

/kind bug

arena version:

arena version
arena: v0.9.12
  BuildDate: 2024-03-04T01:59:47Z
  GitCommit: a707f81ef611ccd4347c82ddef122cf40b660edc
  GitTreeState: clean
  GitTag: v0.9.12
  GoVersion: go1.18.10
  Compiler: gc
  Platform: darwin/amd64

submit kserve job

arena serve kserve \
    --name=triton-vllm \
    --image=nvcr.io/nvidia/tritonserver:24.01-vllm-python-py3 \
    --gpus=1 \
    --cpu=6 \
    --memory=12Gi \
    --data="opt-pvc:/work/model_repository/vllm-model" \
    "tritonserver --model-store=/work/model_repository --grpc-port=9000 --http-port=8080 --allow-grpc=true --allow-http=true --allow-metrics=true"

arena delete triton-vllm --type kserve

ERRO[0000] Unsupport job type,arena only supports: [py(Pytorch),horovod(Horovod),volcano(Volcano),et(ElasticTraining),spark(Spark),dp(DeepSpeed),tf(Tensorflow),mpi(MPI)]
@gujingit
Copy link
Contributor Author

gujingit commented Mar 6, 2024

/assign gujingit

@Syulin7
Copy link
Collaborator

Syulin7 commented Mar 6, 2024

@gujingit arena delete is used to delete training jobs; you should use arena serve delete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants