Skip to content

Not all models work after download #587

Description

@theKHR3b

Using docker version speaches:

speaches:
    image: ghcr.io/speaches-ai/speaches:latest-cuda
    depends_on:
      - openwebui
    ports:
      - "8000:8000"
    volumes:
      - speaches-hf-hub-cache:/home/ubuntu/.cache/huggingface/hub
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: all
              capabilities: [gpu]

volumes:
  speaches-hf-hub-cache:
    external: true

curl http://speaches:8000/v1/registry
gives following result:
...... many lines ommited {"id":"ytrbqrkflbvbhy/whisper-podlodka-turbo-ct2-float16","created":1765519359,"object":"model","owned_by":"ytrbqrkflbvbhy","language":["ru","en"],"task":"automatic-speech-recognition"}],"object":"list"}

This models is fine for me, try to download:
curl http://speaches:8000/v1/models/ytrbqrkflbvbhy/whisper-podlodka-turbo-ct2-float16 -X POST
Model 'ytrbqrkflbvbhy/whisper-podlodka-turbo-ct2-float16' downloaded

Ok, try to look at models list:
curl http://speaches:8000/v1/models
{"data":[],"object":"list"}
its empty!

Same happends with another model named juasker/whisper-ct2-podlodka-turbo

But if we try to load Systran/faster-distil-whisper-small.en like in documentation, it work as expected.
curl http://speaches:8000/v1/models
{"data":[{"id":"Systran/faster-distil-whisper-small.en","created":1765776806,"object":"model","owned_by":"Systran","language":["en"],"task":"automatic-speech-recognition"}]

Maybe there some problems with type of model, or naming, or something else.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions