Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

330 Open 1,243 Closed
330 Open 1,243 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

question to model inference optimization triaged Issue has been reviewed and triaged
#3134 opened May 4, 2024 by geraldstanje
@agunapal
1
If micro_batch_size of micro-batch is set to 1, then model inference is still batch processing?
#3120 opened Apr 29, 2024 by pengxin233
1
CUDA out of Memory with low Memory Utilization (CUDA error: device-side assert triggered)
#3114 opened Apr 25, 2024 by emilwallner
5
Load model failed - error: Worker died
#3104 opened Apr 23, 2024 by geraldstanje
6
Update large_models/gpt_fast to llama3
#3102 opened Apr 22, 2024 by mreso
@mreso
Update large_models/tp_llama to llama3
#3101 opened Apr 22, 2024 by mreso
@mreso
Update large_models/inferentia2/llama2 to Llama3
#3100 opened Apr 22, 2024 by mreso
@lxning
Update LLM/llama2 to Llama3
#3099 opened Apr 22, 2024 by mreso
@mreso
Update cpp/llamacpp to Llama 3
#3098 opened Apr 22, 2024 by mreso
@mreso
1
Metrics collector crashes when NVIDIA MIGs are present
#3090 opened Apr 16, 2024 by UrkoAT
1
TorchServe crashes in production with `WorkerThread - IllegalStateException error'
#3087 opened Apr 15, 2024 by MaelitoP
4
Serve multiple models with both CPU and GPU question Further information is requested triaged Issue has been reviewed and triaged
#3078 opened Apr 10, 2024 by hungtrieu07
3
TorchServe linux aarch64 plan dependencies Pull requests that update a dependency file enhancement New feature or request
#3072 opened Apr 3, 2024 by agunapal
4 tasks
@agunapal
Torchserve error for more than 14 python async requests on workflow
#3069 opened Apr 3, 2024 by bennykins
2
[RFC]: Deprecation notice for TorchText installation in TorchServe deprecation
#3066 opened Apr 2, 2024 by agunapal
v0.10.0 OpenAPI specification does not validate OIP
#3058 opened Mar 30, 2024 by ericphanson
CPU Launcher fails available check with venv
#3049 opened Mar 27, 2024 by ElfoLiNk
3
\ready API for Kubernetes probe to know when TorchServe backend is ready to receive traffic kubernetes
#3047 opened Mar 27, 2024 by agunapal
1
gRPC Model Metadata using Open Inference Protocol OIP
#3045 opened Mar 26, 2024 by harshita-meena
1
Custom class handler missing BaseHandler documentation Improvements or additions to documentation
#3042 opened Mar 26, 2024 by swstack v0.11.0
support install cpp dependency in auto-benchmark benchmark enhancement New feature or request
#3039 opened Mar 22, 2024 by lxning v0.11.0
@namannandan
Newer Base Image KServe Container fails with exec /usr/local/bin/dockerd-entrypoint.sh: exec format error
#3033 opened Mar 20, 2024 by tylertitsworth
7
PyTorch Serve: Custom handler not saving inference results triaged Issue has been reviewed and triaged
#3031 opened Mar 19, 2024 by danial880
6
Exception when using torchserve to deploy hugging face model: java.lang.InterruptedException: null help wanted Extra attention is needed needs-reproduction triaged Issue has been reviewed and triaged
#3026 opened Mar 14, 2024 by yolk-pie-L
4
Add support for MPS in the basehandler enhancement New feature or request
#3022 opened Mar 13, 2024 by agunapal v0.11.0
@udaij12
1
ProTip! Exclude everything labeled bug with -label:bug.