You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
model_store has 1 .mar file, and then the my server died, even cannot be connected through ssh, here is the logs, donno whats the problems here
WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.
2023-01-29T04:21:09,360 [INFO ] main org.pytorch.serve.servingsdk.impl.PluginsManager - Initializing plugins manager...
Python executable: /opt/conda/bin/python
Config file: /home/model-server/config.properties
Inference address: http://0.0.0.0:8080
Management address: http://0.0.0.0:8081
Metrics address: http://0.0.0.0:8082
Model Store: /home/model-server/model-store
Initial Models: all
Log dir: /home/model-server/logs
Metrics dir: /home/model-server/logs
Netty threads: 0
Netty client threads: 0
Default workers per model: 2
Blacklist Regex: N/A
Maximum Response Size: 6553500
Maximum Request Size: 6553500
Limit Maximum Image Pixels: true
Prefer direct buffer: false
Allowed Urls: [file://.*|http(s)?://.*]
Custom python dependency for model allowed: false
Metrics report format: prometheus
Enable metrics API: true
Workflow Store: /home/model-server/model-store
Model config: N/A
2023-01-29T04:21:09,458 [INFO ] main org.pytorch.serve.servingsdk.impl.PluginsManager - Loading snapshot serializer plugin...
2023-01-29T04:21:09,486 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: demo
2023-01-29T04:21:09,490 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:09,491 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive createdOn is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:09,492 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model demo
2023-01-29T04:21:09,493 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model demo
2023-01-29T04:21:09,493 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model demo loaded.
2023-01-29T04:21:09,493 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: demo, count: 2
2023-01-29T04:21:09,505 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: projects
2023-01-29T04:21:09,505 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:09,505 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive createdOn is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:09,505 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model projects
2023-01-29T04:21:09,506 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model projects
2023-01-29T04:21:09,506 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model projects loaded.
2023-01-29T04:21:09,506 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: projects, count: 2
2023-01-29T04:21:09,507 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: docs
2023-01-29T04:21:09,511 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:09,511 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive createdOn is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:09,511 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model docs
2023-01-29T04:21:09,512 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model docs
2023-01-29T04:21:09,512 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model docs loaded.
2023-01-29T04:21:09,512 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: docs, count: 2
2023-01-29T04:21:09,513 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: threeline.mar
2023-01-29T04:21:09,518 [DEBUG] W-9000-demo_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9000, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:09,519 [DEBUG] W-9001-demo_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9001, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:09,518 [DEBUG] W-9002-projects_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9002, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:09,519 [DEBUG] W-9004-docs_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9004, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:09,523 [DEBUG] W-9003-projects_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9003, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:09,523 [DEBUG] W-9005-docs_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9005, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,603 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model threeline
2023-01-29T04:21:13,609 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model threeline
2023-01-29T04:21:13,609 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model threeline loaded.
2023-01-29T04:21:13,609 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: threeline, count: 2
2023-01-29T04:21:13,615 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: tools
2023-01-29T04:21:13,616 [DEBUG] W-9006-threeline_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9006, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,619 [DEBUG] W-9007-threeline_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9007, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,806 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,806 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive createdOn is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,806 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model tools
2023-01-29T04:21:13,806 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model tools
2023-01-29T04:21:13,806 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model tools loaded.
2023-01-29T04:21:13,807 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: tools, count: 2
2023-01-29T04:21:13,810 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: models__
2023-01-29T04:21:13,811 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,811 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive createdOn is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,811 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model models__
2023-01-29T04:21:13,811 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model models__
2023-01-29T04:21:13,811 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model models__ loaded.
2023-01-29T04:21:13,811 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: models__, count: 2
2023-01-29T04:21:13,815 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: docker
2023-01-29T04:21:13,815 [DEBUG] W-9009-tools_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9009, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,816 [DEBUG] W-9010-models___1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9010, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,816 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,817 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive createdOn is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,817 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model docker
2023-01-29T04:21:13,817 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model docker
2023-01-29T04:21:13,818 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model docker loaded.
2023-01-29T04:21:13,818 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: docker, count: 2
2023-01-29T04:21:13,820 [DEBUG] W-9011-models___1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9011, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,822 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: tests
2023-01-29T04:21:13,822 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,822 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive createdOn is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,823 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model tests
2023-01-29T04:21:13,823 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model tests
2023-01-29T04:21:13,823 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model tests loaded.
2023-01-29T04:21:13,823 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: tests, count: 2
2023-01-29T04:21:13,820 [DEBUG] W-9008-tools_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9008, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,831 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: requirements
2023-01-29T04:21:13,831 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,831 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive createdOn is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,831 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model requirements
2023-01-29T04:21:13,831 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model requirements
2023-01-29T04:21:13,831 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model requirements loaded.
2023-01-29T04:21:13,831 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: requirements, count: 2
2023-01-29T04:21:13,833 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: resources
2023-01-29T04:21:13,833 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,833 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive createdOn is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
2023-01-29T04:21:13,833 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model resources
2023-01-29T04:21:13,833 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model resources
2023-01-29T04:21:13,833 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model resources loaded.
2023-01-29T04:21:13,833 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: resources, count: 2
2023-01-29T04:21:13,840 [DEBUG] W-9014-tests_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9014, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,841 [DEBUG] W-9015-tests_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9015, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,842 [DEBUG] W-9016-requirements_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9016, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,843 [DEBUG] W-9013-docker_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9013, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,841 [DEBUG] W-9012-docker_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9012, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:13,842 [DEBUG] W-9017-requirements_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9017, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:14,001 [DEBUG] W-9018-resources_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9018, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:14,049 [DEBUG] main org.pytorch.serve.ModelServer - Loading models from model store: mmdet
2023-01-29T04:21:14,050 [WARN ] main org.pytorch.serve.archive.model.ModelArchive - Model archive version is not defined. Please upgrade to torch-model-archiver 0.2.0 or higher
Model: configs, count: 2
2023-01-29T04:21:14,391 [DEBUG] W-9023-models_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9023, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:14,392 [DEBUG] W-9022-models_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9022, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:14,463 [DEBUG] W-9025-configs_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9025, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:14,463 [DEBUG] W-9024-configs_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [/opt/conda/bin/python, /opt/conda/lib/python3.7/site-packages/ts/model_service_worker.py, --sock-type, unix, --sock-name, /home/model-server/tmp/.ts.sock.9024, --metrics-config, /opt/conda/lib/python3.7/site-packages/ts/configs/metrics.yaml]
2023-01-29T04:21:15,208 [INFO ] main org.pytorch.serve.ModelServer - Initialize Inference server with: EpollServerSocketChannel.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
i have built the docker then run
model_store has 1 .mar file, and then the my server died, even cannot be connected through ssh, here is the logs, donno whats the problems here
Beta Was this translation helpful? Give feedback.
All reactions