Outputs from Starcoder regressed significantly in the bleeding edge main branch. https://github.com/vllm-project/vllm/commit/6fc2a38b110f9ba6037b31ee016f20df32426877 commit was working fine