Hanrui-Wang [minor] use fp32 when generate on CPU