You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I would like to know about chat models. When I use AWQ for calibration, I do not want to compute the loss for the instructions, but only for the responses. I want to know how to handle this when inputting the calibration dataset. For example, how should I handle the labels and attention masks?
The text was updated successfully, but these errors were encountered:
I would like to know about chat models. When I use AWQ for calibration, I do not want to compute the loss for the instructions, but only for the responses. I want to know how to handle this when inputting the calibration dataset. For example, how should I handle the labels and attention masks?
The text was updated successfully, but these errors were encountered: