Skip to content

issues Search Results · repo:pytorch/serve language:Java

Filter by

1k results
 (94 ms)

1k results

inpytorch/serve (press backspace or delete to remove)

pytorch/serve
Adding vendor RBLN(Rebellions)

TorchServe has a varying structure for different accelerator types through recently added #3371. Although Rebellions provides a guide on how to utilize TorchServe with the RBLN(Rebellions) NPUs through ...
  • rebel-ysseo
  • Opened 
    on May 8
  • #3416

pytorch/serve
Why Use TorchScript Format Models?

When customizing handler.py, we can load any format of model in the initialize function without needing to package the model into a .mar file. Why do the tutorials recommend converting the model to TorchScript ...
  • CongSuxu
  • Opened 
    on Apr 3
  • #3409

pytorch/serve
deploy modernBERT model question

🐛 Describe the bug hi, I just have a quick question regarding how i can deploy a answerdotai/ModernBERT-base model using torchserv? Can you point to any examples? Thanks Error logs - Installation ...
  • geraldstanje
  • Opened 
    on Mar 22
  • #3404

pytorch/serve
Why is TorchServe No Longer Actively Maintained?

Hello, I noticed that the TorchServe GitHub page has been marked as Limited Maintenance, indicating that the project is no longer actively maintained. Could you share the reasons behind this decision? ...
  • ily666666
  • 11
  • Opened 
    on Mar 3
  • #3396

pytorch/serve
Rename open_inference_grpc.proto package name

Hi Team, Starting from 0.10.0, torchServe introduced open_inference_grpc.proto to allow Pytorch GRPC APIs to follow Kserve open inference V2 protocol. However, I am wondering why the package name used ...
  • jwang20250226
  • Opened 
    on Feb 26
  • #3394

pytorch/serve
map workers and GPUs, deviceIds not considered in ts_config

lt;dr: using my existing configuration shows no effect when using the deviceIds property. I am successfully hosting three diffeerent models on a server with two gpus. Each model can be run on a single ...
  • RuDevKu
  • Opened 
    on Feb 25
  • #3393

pytorch/serve
How to run the benchmark scripts on the local model ?

How to run the benchmark scripts on the local model ? I tried following but it fails with ModelNotFoundException python benchmark_ab.py --config benchmark_config.json { url : ./model_store/custom_model.mar ...
  • ranipakeyur
  • 1
  • Opened 
    on Feb 17
  • #3392

pytorch/serve
How can a user specify an envelope?

📚 The doc issue The service_envelope parameter has disappeared from the documentation: https://pytorch.org/serve/configuration.html#other-properties The KServe documentation states that this parameter ...
  • yurkoff-mv
  • Opened 
    on Feb 14
  • #3391

pytorch/serve
Reference to `Nvidia MPS` in `README.md` references a non-existent file

  • cipherself
  • Opened 
    on Feb 13
  • #3389

pytorch/serve
please add java api cli to generate model archiver mar file or tell the generate logic

🚀 The feature HI, now we use Javacpp pytorch jar package could write and training pytorch model the same with python ,so we don t want to use python code to write python handler.py to generate mar file ...
  • mullerhai
  • Opened 
    on Feb 9
  • #3386
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Restrict your search to the title by using the in:title qualifier.
Issue search results · GitHub