chat model evaluation

[jordane95]

Currently, there are some automatic ways to evaluate the chat performance of current aligned language models, such as mt-bench. It basically replaces human scores of different dimensions through another strong language model as proxy, like gpt4. Do we have plan for adding this type of evals?