Add generative benchmarks on mscoco_captions

[gpucce]

Hi, hoping that the coca model in https://github.com/mlfoundations/open_clip works and that mlfoundations/open_clip#307 gets merged, I thought I might add some benchmarking for the generative part of the model on mscoco_captions, if it makes sense for this repository.

Before creating a PR I would also like to ask if adding https://github.com/sks3i/pycocoevalcap as a dependency is ok or not, it would make adding the benchmark simpler, otherwise I would add the metrics (bleu, cider, rouge and meteor) one by one.

[rom1504]

Yeah it's fine. Feel free to open a PR!

…

On Fri, Dec 30, 2022, 15:44 Giovanni Puccetti ***@***.***> wrote: Hi, hoping that the coca model in https://github.com/mlfoundations/open_clip works and that mlfoundations/open_clip#307 <mlfoundations/open_clip#307> gets merged, I thought I might add some benchmarking for the generative part of the model on mscoco_captions, if it makes sense for this repository. Before creating a PR I would also like to ask if adding https://github.com/sks3i/pycocoevalcap as a dependency is ok or not, it would make adding the benchmark simpler, otherwise I would add the metrics (bleu, cider, rouge and meteor) one by one. — Reply to this email directly, view it on GitHub <#61>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAR437QFNIFN4M55RN6EDIDWP3YMRANCNFSM6AAAAAATM575DM> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>