How to generate the city_scape dataset?

[aldipiroli]

Hello and thanks for the awesome work!

I am trying to prepare the data in the format you mentioned in installation page, however I don't understand how to get your structure.
When I download the city_scape gtFine dataset I have the following data structure:

city_scapes
└── gtFine
    ├── test
    │   ├── berlin
    │   ├── bielefeld
    │   ├── bonn
    │   ├── leverkusen
    │   ├── mainz
    │   └── munich
    ├── train
    │   ├── aachen
    │   ├── bochum
    │   ├── bremen
    │   ├── cologne
    │   ├── darmstadt
    │   ├── dusseldorf
    │   ├── erfurt
    │   ├── hamburg
    │   ├── hanover
    │   ├── jena
    │   ├── krefeld
    │   ├── monchengladbach
    │   ├── strasbourg
    │   ├── stuttgart
    │   ├── tubingen
    │   ├── ulm
    │   ├── weimar
    │   └── zurich
    └── val
        ├── frankfurt
        ├── lindau
        └── munster

I succesfully ran the processing step in here.

I also had a look at the synboost preprocessed data and also at the issue #13 but I still don't get how to easily convert the structure to yours.

Also, I saw on the here that you provided the annotation folder. Should I use these files or generate them, if so how?

Hopefully I am not missing something obvious!

Best,
Aldi

[yyliu01]

I apologise for your confusion, I'll rewrite the installations when I have time.

The pre-processing of the cityscapes only changes the label, so please use our supported annotation for training.

[aldipiroli]

Hi and thank you for your answer!
I was able to run the training script.

[hyunjunChhoi]

How can you resolve the issue?? I just merge all the cities file into one folder However, there issue remains that
there is No trainlabelIDS I cannot proceed on this step Can you help??

[aldipiroli]

Hi,
the authors might be best suited to correctly answer, however this is how I did it:

1. Download the gtFine_trainvaltest.zip dataset
2. Run the post processing script from the official repo
3. create the following empty folders structure:

city_scape/
├── annotation
│   └── city_gt_fine
│       ├── train
│       └── val
└── images
    └── city_gt_fine
        ├── train
        └── val

4. in images/city_gt_fine extract in one single folder all the files for the train and val folder. So it will look something like this

images
└── city_gt_fine
    ├── train
    │   ├── aachen_000000_000019_leftImg8bit.png
    │   ├── aachen_000001_000019_leftImg8bit.png
    │   ├── aachen_000002_000019_leftImg8bit.png
    └── val
        ├── frankfurt_000000_000294_leftImg8bit.png
        ├── frankfurt_000000_000576_leftImg8bit.png
        ├── frankfurt_000000_001016_leftImg8bit.png

5. then simply download the annotation folder provided by the authors in here

[hyunjunChhoi]

Hi, the authors might be best suited to correctly answer, however this is how I did it:

1. Download the gtFine_trainvaltest.zip dataset
2. Run the post processing script from the official repo
3. create the following empty folders structure:

city_scape/
├── annotation
│   └── city_gt_fine
│       ├── train
│       └── val
└── images
    └── city_gt_fine
        ├── train
        └── val

4. in images/city_gt_fine extract in one single folder all the files for the train and val folder. So it will look something like this

images
└── city_gt_fine
    ├── train
    │   ├── aachen_000000_000019_leftImg8bit.png
    │   ├── aachen_000001_000019_leftImg8bit.png
    │   ├── aachen_000002_000019_leftImg8bit.png
    └── val
        ├── frankfurt_000000_000294_leftImg8bit.png
        ├── frankfurt_000000_000576_leftImg8bit.png
        ├── frankfurt_000000_001016_leftImg8bit.png

5. then simply download the annotation folder provided by the authors in here

Thanks, it resolves the issue

[chensongloose]

@aldipiroli Hi, I Downloaded the gtFine_trainvaltest.zip dataset, there is no picture name you mentioned
images
└── city_gt_fine
├── train
│ ├── aachen_000000_000019_leftImg8bit.png
│ ├── aachen_000001_000019_leftImg8bit.png
│ ├── aachen_000002_000019_leftImg8bit.png
└── val
├── frankfurt_000000_000294_leftImg8bit.png
├── frankfurt_000000_000576_leftImg8bit.png
├── frankfurt_000000_001016_leftImg8bit.png
So, How to get the file you mentioned?
Looking forward to your reply！