You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
You can set context_window_size to -1 if you'd like to use sliding window, sliding_window_size to -1 otherwise. The official usage is without sliding window size according to Mistralv0.3's HF. This error should be fixed after 0.2.44 for prebuilt list.
For Mistral 7B (I think), which one should I set to -1?
The text was updated successfully, but these errors were encountered: