max_tokens #192
Replies: 1 comment
-
Hey Adwait, The For example, given a list Therefore, for the list above we might set In terms of data quality, usually more is better, however, there is often a limit to where performance stops improving. For example, In SkimLit, we set See section 3.2 of https://arxiv.org/pdf/1710.06071.pdf for the above image. |
Beta Was this translation helpful? Give feedback.
-
sir please tell me,
what is actually max_tokens i am very confused at it we have set max_tokens=68k in the skimlit model why that large number, is it the number of words in a sentence or number of letters in a sentence or most common words in a sentence.
Beta Was this translation helpful? Give feedback.
All reactions