Skip to content

Stub process 'whisper_bls_0_0' is not healthy. #646

@MrD005

Description

@MrD005

System Info

  • H200 GPU

Who can help?

No response

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • My own task or dataset (give details below)

Reproduction

Deployed using whisper docs

Expected behavior

successful whisper inference

actual behavior

task-0: 0/1
Traceback (most recent call last):
File "/mnt/local/data/whisper/client.py", line 291, in
asyncio.run(main())
File "/usr/lib/python3.10/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
return future.result()
File "/mnt/local/data/whisper/client.py", line 257, in main
answer_list = await asyncio.gather(*tasks)
File "/mnt/local/data/whisper/client.py", line 206, in send_whisper
response = await triton_client.infer(model_name,
File "/usr/local/lib/python3.10/dist-packages/tritonclient/grpc/aio/init.py", line 686, in infer
raise_error_grpc(rpc_error)
File "/usr/local/lib/python3.10/dist-packages/tritonclient/grpc/_utils.py", line 77, in raise_error_grpc
raise get_error_grpc(rpc_error) from None
tritonclient.utils.InferenceServerException: [StatusCode.INTERNAL] Stub process 'whisper_bls_0_0' is not healthy.

additional notes

No

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions