Cannot load image from CC3M

[viyjy]

Get the following error:
PIL.UnidentifiedImageError: cannot identify image file '/home/ubuntu/data/CC3M/DownloadConceptualCaptions/validation/10481_3355970027'

The error is generated by this code in caption_dataset.py:
image = Image.open(ann['image']).convert('RGB')

BTW, I can only download 2.4M images from CC3M/training, how did you download 2.95M images? Thanks.

[LiJunnan1992]

Hi, I used this code to download the dataset:
https://github.com/igorbrigadir/DownloadConceptualCaptions

[viyjy]

Thanks. How about the first question? The code cannot identify CC3M images (the path is correct, and images do exists), while it can identify images from other datasets.

[LiJunnan1992]

It could be because that the image is not downloaded correctly, so PIL cannot load it.

[viyjy]

Thanks for your help!

[shoutOutYangJie]

Hi, I used this code to download the dataset: https://github.com/igorbrigadir/DownloadConceptualCaptions

How to down CC12M dataset ? can you share the download tool?

[LiJunnan1992]

Hi, I used this code to download the dataset: https://github.com/igorbrigadir/DownloadConceptualCaptions

How to down CC12M dataset ? can you share the download tool?

Hi, I simply modified the download code for CC3M, the format between the two is very similar.

[shoutOutYangJie]

Hi, I used this code to download the dataset: https://github.com/igorbrigadir/DownloadConceptualCaptions

How to down CC12M dataset ? can you share the download tool?

Hi, I simply modified the download code for CC3M, the format between the two is very similar.

This is for CC3M rather than cc12.

[LiJunnan1992]

Hi, I used this code to download the dataset: https://github.com/igorbrigadir/DownloadConceptualCaptions

How to down CC12M dataset ? can you share the download tool?

Hi, I simply modified the download code for CC3M, the format between the two is very similar.

This is for CC3M rather than cc12.

Yes, you can slightly modify the code to download cc12.