-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[QA] Number of training tokens #97
Comments
2.4, 2.4, 2.4, 4, 4, 3 trillion tokens |
Many thanks! |
Thanks for the great work. can you also share how many tokens the 110B model was trained on? |
and the 32 B model as well. |
Yes, it would be great to know the number of tokens of both the 110B and 32B |
This issue has been automatically marked as inactive due to lack of recent activity. Should you believe it remains unresolved and warrants attention, kindly leave a comment on this thread. |
Hi,
What is the number of training tokens for the base models Qwen 1.5 0.5B, 1.8B, 4B, 7B, 14B, 72B models?
Thanks for the great work!
The text was updated successfully, but these errors were encountered: