[Inference] Enable vllm on HPU #1226

Job	Run time
Lint / lint	39s
Tests / bare-test (3.9)	16m 5s
Tests / docker-test (3.9)	18m 43s
Tests / setup-test (3.9)	2m 12s
Tests / bare-test (3.10)	16m 37s
Tests / getting-started-test (3.9)	2m 48s
Tests / docker-test (3.10)	19m 23s
Tests / setup-test (3.10)	2m 5s
Tests / bare-test (3.11)	16m 31s
Tests / docker-test (3.11)	19m 18s
Tests / getting-started-test (3.10)	3m 19s
Tests / setup-test (3.11)	2m 8s
Tests / getting-started-test (3.11)	3m 18s
Finetune / finetune (EleutherAI/gpt-j-6b)	25m 51s
Finetune / finetune (meta-llama/Llama-2-7b-chat-hf)	18m 57s
Finetune / finetune (mistralai/Mistral-7B-v0.1)	21m 29s
Finetune / finetune (google/gemma-2b)	6m 53s
Inference_Gaudi / inference (llama-2-7b-chat-hf)	1m 5s
Inference / inference (gpt-j-6b)	13m 16s
Inference_Gaudi / inference (llama-2-70b-chat-hf)	1s
Inference_Gaudi / inference (llama-2-7b-chat-hf-vllm)	1m 1s
Inference / inference (mistral-7b-v0.1)	6m 14s
Inference / inference (mpt-7b-ipex-llm)	5m 55s
Inference / inference (llama-2-7b-chat-hf-vllm)	2m 35s
Inference / inference (gemma-2b)	6m 45s
Inference / inference (mpt-7b, nathan0/mpt-7b-deltatuner-model)	28m 38s
	4h 21m 46s

Provide feedback