Skip to content

pretrain data for qwen1.5-0.5b #1236

@Haruka1307

Description

@Haruka1307

hi,我已经尝试在社群中提问,没有回应

我想问一下qwen1.5-0.5b model的pretrain的数据量,在qwen2报告中提及qwen1.5 pretrain的数据量是3T,qwen2中,0.5b的数据量是12T其他的model size是7T,我想确认一下qwen1.5-0.5是否和qwen2 系列一样比其他model size 多一些pretrain data

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions