跑一批图片的时候总有中间卡住的 然后就不动了
2025-09-23 17:51:22.419
�[1;36m(APIServer pid=12)�[0;0m INFO 09-23 02:51:16 [loggers.py:123] Engine 000: Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 128.2 tokens/s, Running: 1 reqs, Waiting: 0 reqs, GPU KV cache usage: 16.7%, Prefix cache hit rate: 6.9%
这时必须手动结束掉对应的请求
跑一批图片的时候总有中间卡住的 然后就不动了
2025-09-23 17:51:22.419
�[1;36m(APIServer pid=12)�[0;0m INFO 09-23 02:51:16 [loggers.py:123] Engine 000: Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 128.2 tokens/s, Running: 1 reqs, Waiting: 0 reqs, GPU KV cache usage: 16.7%, Prefix cache hit rate: 6.9%
这时必须手动结束掉对应的请求