Skip to content

[Question]: I deployed the rerank model using vLLM and successfully configured the settings, but I encountered a 404 error during the knowledge base test. #6301

@ZHJ19970917

Description

@ZHJ19970917

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (Language Policy).
  • Non-english title submitions will be closed directly ( 非英文标题的提交将会被直接关闭 ) (Language Policy).
  • Please do not modify this template :) and fill in all the required fields.

Describe your problem

Image

Image

When configuring the model in the settings, the vLLM-deployed rerank model API can be accessed successfully.
However, a 404 error occurs when testing the knowledge base dataset.
Image

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions