Skip to content

The evaluation performance on the Filckr30k dataset #27

@mingtouyizu

Description

@mingtouyizu

Why do I only get a CIDEr score of 0.065 on Flickr30k for bliva_vicuna7b, even if multiplied by 10 it's only 0.65? Could you tell me what might have gone wrong in this process?? Thanks.
{"test": {"Bleu_1": 0.23795275042621625, "Bleu_2": 0.15775161595849657, "Bleu_3": 0.1035576186878422, "Bleu_4": 0.06837100713764228, "METEOR": 0.19554874963685032, "ROUGE_L": 0.276937750791617, "CIDEr": 0.06517325574578513, "SPICE": 0.17977547067526298}}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions