Skip to content
This repository was archived by the owner on Aug 7, 2025. It is now read-only.

Getting started guide client samples broken ?Β #3348

@nikste

Description

@nikste

πŸ› Describe the bug

following the getting started guide:

https://github.com/pytorch/serve/blob/master/docs/getting_started.md

i get following error messages when trying to run the client examples.
Am I doing something wrong?

Error logs

serve$ python -m grpc_tools.protoc --proto_path=frontend/server/src/main/resources/proto/ --python_out=ts_scripts --grpc_python_out=ts_scripts frontend/server/src/main/resources/proto/inference.proto frontend/server/src/main/resources/proto/management.proto
google/rpc/status.proto: File not found.
inference.proto:6:1: Import "google/rpc/status.proto" was not found or had errors.
inference.proto:32:14: "google.rpc.Status" is not defined.

and

serve$ python ts_scripts/torchserve_grpc_client.py infer densenet161 examples/image_classifier/kitten.jpg
Traceback (most recent call last):
  File "[..]serve/ts_scripts/torchserve_grpc_client.py", line 7, in <module>
    import inference_pb2
ModuleNotFoundError: No module named 'inference_pb2'

Installation instructions

followed the getting started guide:
https://github.com/pytorch/serve/blob/master/docs/getting_started.md

Model Packaging

from getting started guide

config.properties

from getting started guide

Versions


Environment headers

Torchserve branch:

torchserve==0.12.0
torch-model-archiver==0.12.0

Python version: 3.10 (64-bit runtime)
Python executable: /home/nikste/workspace-abnoba/serving_test/venv/bin/python

Versions of relevant python libraries:
captum==0.6.0
numpy==1.24.3
nvgpu==0.10.0
pillow==10.3.0
psutil==5.9.8
requests==2.32.0
torch==2.4.0+cu121
torch-model-archiver==0.12.0
torch-workflow-archiver==0.2.15
torchaudio==2.4.0+cu121
torchserve==0.12.0
torchvision==0.19.0+cu121
wheel==0.42.0
torch==2.4.0+cu121
**Warning: torchtext not present ..
torchvision==0.19.0+cu121
torchaudio==2.4.0+cu121

Java Version:

OS: Ubuntu 22.04.5 LTS
GCC version: (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Clang version: 14.0.0-1ubuntu1.1
CMake version: version 3.30.3

Environment:
library_path (LD_/DYLD_): /usr/local/cuda-11.8/lib64:

Repro instructions

getting started guide

Possible Solution

missing packages in the requirements?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions