Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to download the ADE20K dataset as mmseg required #1754

Closed
chenshuang-zhang opened this issue Jul 10, 2022 · 14 comments
Closed

How to download the ADE20K dataset as mmseg required #1754

chenshuang-zhang opened this issue Jul 10, 2022 · 14 comments
Assignees

Comments

@chenshuang-zhang
Copy link

chenshuang-zhang commented Jul 10, 2022

Hello!

I'm using mmsegmentation to train models on the ADE20K dataset. However, I cannot download the ADE20K dataset, since I found the link to download ADE20K in the mmseg github is invalid now.

I tried two ways to download, but there are still troubles since the dataset I downloaded has different file directories: No annotations files in the dataset I downloaded.

Could you please tell me how to download the ADE20K directly so I can use mmseg?

  1. I downloaded from the ADE20K official dataset:

ADE20K_2021_17_01
├── images
│ └── ADE
│ ├── training
│ └── validation
├── index_ade20k.mat
├── index_ade20k.pkl
└── objects.txt

  1. I downloaded from openAI website:

└── ADE20K_2016_07_26
├── images
│ ├── training
│ └── validation
└── index_ade20k.mat

When the official directories in mmsegmentation

ade
│ │ ├── ADEChallengeData2016
│ │ │ ├── annotations
│ │ │ │ ├── training
│ │ │ │ ├── validation
│ │ │ ├── images
│ │ │ │ ├── training
│ │ │ │ ├── validation

Thank you very much!

@fingertap
Copy link
Contributor

By default the mmseg uses the older version of ADE20k. The dataset seems to get updated. See the related issue here #984 . The link to download ADE20k is now a 404 page. Need a new mirrored download source.

@fingertap
Copy link
Contributor

@MengzhangLI @xiexinch Can you guys help?

@fingertap
Copy link
Contributor

fingertap commented Jul 10, 2022

The domain is changed. New download link is this. Unfortunately, this link is also dead.

@xiexinch
Copy link
Collaborator

Hi @fingertap,
Thanks for your report, we'll update the document soon.

And you might try this link, register an account then download the dataset.

@fingertap
Copy link
Contributor

This link will lead to a different dataset layout, making the dataloader of mmseg not directly applicable. See #984 .

And you might try this link, register an account then download the dataset.

It seems that their server is just dead. This link also gives a 404 page. I think this issue may be temporal. Anyway, I have a copy of the dataset file.

@chenshuang-zhang
Copy link
Author

chenshuang-zhang commented Jul 11, 2022

This link will lead to a different dataset layout, making the dataloader of mmseg not directly applicable. See #984 .

And you might try this link, register an account then download the dataset.

It seems that their server is just dead. This link also gives a 404 page. I think this issue may be temporal. Anyway, I have a copy of the dataset file.

Hi, @fingertap,
It seems that we met the same problem #984. And the baseline papers I read are still using the older ADE20K.

I wonder how did you get the copy of old version dataset, which works with mmseg? Could you please share the copy of old dataset with me?

Thank you very much.

@chenshuang-zhang
Copy link
Author

Problem solved by obtaining a copy of ADE20K 2016. Thank you all for your help!

@JierunChen
Copy link

Problem solved by obtaining a copy of ADE20K 2016. Thank you all for your help!

Hi, could you kindly share how you convert the ADE20K 2016 dataset to the format as in required by mmseg? Thanks a lot.

@Catherine-Tranquil
Copy link

Hi, could you kindly share the copy of ADE20K 2016 as in required by mmseg? Thanks a lot.

@wenyuqing
Copy link

Problem solved by obtaining a copy of ADE20K 2016. Thank you all for your help!

Hi,could you kindly share a copy of ADE2016? Thanks a lot。

@aungpaing98
Copy link

aungpaing98 commented Aug 17, 2022

@fingertap

Hi. could you kindly share the copy of the dataset?
The format is completed different.
Thanks.

@fingertap
Copy link
Contributor

According to the author's response, this dataset is under BSD-3, which allows us to redistribute. So maybe you can provide an image for download? @xiexinch

Hi @aungpaing98 , my dataset is on a remote server with limited bandwidth. Maybe mmseg can provide a download link for users.

@aungpaing98
Copy link

@fingertap, thanks for the response.

@xiexinch, Could you provide for the download?
If not, I would like to have some samples of the original label dataset.
So that I can convert using custom implementation.

Thanks for your time.

@xiexinch
Copy link
Collaborator

xiexinch commented Aug 18, 2022

Hi @fingertap, @aungpaing98, @JierunChen, @wenyuqing, @Catherine-Tranquil, @zcs15,
Sorry for the late reply, might try https://opendatalab.com/home, they provide plenty of datasets for download.
https://opendatalab.com/ADE20K_2016

aravind-h-v pushed a commit to aravind-h-v/mmsegmentation that referenced this issue Mar 27, 2023
* [unCLIP docs] markdown

* [unCLIP docs] UnCLIPPipeline
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants