关于模型参数规模和模型参数精度对模型能力的影响
#1031
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
我的一个疑问就是在在算力不变的情况下，小参数规模的全参模型和大参数规模的量化模型对比，哪个性价比更高？
比如14B fb16和30B int4，或者更夸张点6B fb16和72B int4，哪个效果相对更优质点？
Beta Was this translation helpful? Give feedback.
All reactions