Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prometheus metrics are empty #520

Closed
3 of 4 tasks
apage43 opened this issue Mar 20, 2025 · 1 comment
Closed
3 of 4 tasks

Prometheus metrics are empty #520

apage43 opened this issue Mar 20, 2025 · 1 comment

Comments

@apage43
Copy link

apage43 commented Mar 20, 2025

System Info

running with

docker run -p 8080:80 -v "${PWD}/data":/data --pull always ghcr.io/huggingface/text-embeddings-inference:cpu-1.6 --model-id nomic-ai/nomic-embed-text-v1.5

the service functions correctly, however /metrics successfully returns an empty response

$ curl -i localhost:8080/metrics
HTTP/1.1 200 OK
content-type: text/plain; charset=utf-8
vary: origin, access-control-request-method, access-control-request-headers
access-control-allow-origin: *
content-length: 0
date: Thu, 20 Mar 2025 23:10:29 GMT

(same can be repro'd building main and running text-embeddings-router directly)

Information

  • Docker
  • The CLI directly

Tasks

  • An officially supported command
  • My own modifications

Reproduction

  1. run TEI with HTTP (any method)
  2. request prometheus metrics - get blank response

Expected behavior

any metrics at all

@apage43
Copy link
Author

apage43 commented Mar 20, 2025

i see - they are empty until measured requests have come in

@apage43 apage43 closed this as completed Mar 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant