Skip to content

qwen2.5-0.5B作为基座使用flagembedding-decoder_only脚本训练embedding模型 #1376

@hellostronger

Description

@hellostronger

Image
这个是我的训练脚本,同一分数据,我微调zh-v1.5-bge-small,在验证集效果更好,为什么qwen0.5B参数量不是更大吗,求指点哪里出了问题

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions