Llama-3-Instruct not using official prompt template?

[ZHZisZZ]

The evaluation of Llama-3-Instruct does not seem to use the official chat template

Llama-3-Instruct config from alpaca_eval
https://github.com/tatsu-lab/alpaca_eval/blob/main/src/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml#L2

Llama-3-Instruct official chat template
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/blob/main/tokenizer_config.json#L2053

[YannDubs]

We use the together prompt: https://github.com/tatsu-lab/alpaca_eval/blob/main/src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt which is blank because I believe Together.ai adds the prompt template on their side!