-
Notifications
You must be signed in to change notification settings - Fork 132
Description
System Info
- H200 GPU
Who can help?
No response
Information
- The official example scripts
- My own modified scripts
Tasks
- An officially supported task in the
examplesfolder (such as GLUE/SQuAD, ...) - My own task or dataset (give details below)
Reproduction
Deployed using whisper docs
Expected behavior
successful whisper inference
actual behavior
task-0: 0/1
Traceback (most recent call last):
File "/mnt/local/data/whisper/client.py", line 291, in
asyncio.run(main())
File "/usr/lib/python3.10/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
return future.result()
File "/mnt/local/data/whisper/client.py", line 257, in main
answer_list = await asyncio.gather(*tasks)
File "/mnt/local/data/whisper/client.py", line 206, in send_whisper
response = await triton_client.infer(model_name,
File "/usr/local/lib/python3.10/dist-packages/tritonclient/grpc/aio/init.py", line 686, in infer
raise_error_grpc(rpc_error)
File "/usr/local/lib/python3.10/dist-packages/tritonclient/grpc/_utils.py", line 77, in raise_error_grpc
raise get_error_grpc(rpc_error) from None
tritonclient.utils.InferenceServerException: [StatusCode.INTERNAL] Stub process 'whisper_bls_0_0' is not healthy.
additional notes
No