Is there any way that vllm works with huggingface pipeline?

[linkfqy]

Since vllm.LLM is not subclass of transformers.PretrainedModel, I can't use vllm like pipeline(model=vllm_model).
My code is deeply coupled with Pipeline, and modifying multiple places to introduce vllm is troublesome for me.

[yileitu]

Same here. I need to use

pipeline = transformers.pipeline(
    "text-generation",
    model=model,
    tokenizer=tokenizer,
)