Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fogy_cityscape dataset convert error:The total number of index is not correct for adaptive object detection #119

Closed
zyfone opened this issue Mar 11, 2022 · 9 comments
Labels
object detection question Further information is requested

Comments

@zyfone
Copy link

zyfone commented Mar 11, 2022

hello thanks for developing this lib
i get voc style dataset of cityscape/fogy_cityscape in prepare_cityscapes_to_voc.py
but i find index of ImageSets/Main/test.txt which only have 493 indexs ,but there are 500 in paper

@zyfone
Copy link
Author

zyfone commented Mar 11, 2022

I know this is an object with empty labels removed, but removing the empty labels in the test will affect the final accuracy
So I want to know whether the test set in the paper removes images with empty labels
last but no least
Thanks to the authors for their open source work

@JunguangJiang
Copy link
Collaborator

mAP50 is calculated only when the IOU exceeds 0.5.
Since there is no ground truth in these images, the IOU cannot exceed 0.5. Thus even if there is output on these images, they are not involved in the final calculation.
Therefore, we think removing the empty labels will not affect the final accuracy.

@zyfone
Copy link
Author

zyfone commented Mar 14, 2022

Thanks to the authors for open-source work,again。
This is very helpful for beginners.
I'm really sorry for asking such a low-level question

I listed my results hoping to be helpful to other students who have the same problem
data-augment:cyclegan

dataset:Cityscapes to Foggy Cityscapes

FOR 500

AP for bus = 0.4898
AP for bicycle = 0.3892
AP for car = 0.5262
AP for motorcycle = 0.3314
AP for person = 0.3810
AP for rider = 0.4864
AP for train = 0.4298
AP for truck = 0.2992
Mean AP = 0.4166

FOR 492
AP for bus = 0.4898
AP for bicycle = 0.3912
AP for car = 0.5262
AP for motorcycle = 0.3315
AP for person = 0.3813
AP for rider = 0.4864
AP for train = 0.4298
AP for truck = 0.2994
Mean AP = 0.4169

@zyfone zyfone closed this as completed Mar 14, 2022
@zyfone
Copy link
Author

zyfone commented Mar 14, 2022

By the way,migration between similar domains always is a difficult problem for domain adaptive object detection。
Especially in cityscape and foggy cityscape.
Using cyclegan seems like way which use target annotation,because pictures of cyclegan are very similar to the target pictures 。
SO,Is it unreasonable to use cyclegan?
HTCN(Hierarchical Transferability Calibration Network) introduce this data-augment in object detection。But HTCN withou cyclegan only get 37.5 in foggy。

@JunguangJiang
Copy link
Collaborator

Thanks to the authors for open-source work,again。 This is very helpful for beginners. I'm really sorry for asking such a low-level question

I listed my results hoping to be helpful to other students who have the same problem data-augment:cyclegan

dataset:Cityscapes to Foggy Cityscapes

FOR 500

AP for bus = 0.4898 AP for bicycle = 0.3892 AP for car = 0.5262 AP for motorcycle = 0.3314 AP for person = 0.3810 AP for rider = 0.4864 AP for train = 0.4298 AP for truck = 0.2992 Mean AP = 0.4166

FOR 492 AP for bus = 0.4898 AP for bicycle = 0.3912 AP for car = 0.5262 AP for motorcycle = 0.3315 AP for person = 0.3813 AP for rider = 0.4864 AP for train = 0.4298 AP for truck = 0.2994 Mean AP = 0.4169

Thanks for your question and results.

@JunguangJiang
Copy link
Collaborator

By the way,migration between similar domains always is a difficult problem for domain adaptive object detection。 Especially in cityscape and foggy cityscape. Using cyclegan seems like way which use target annotation,because pictures of cyclegan are very similar to the target pictures 。 SO,Is it unreasonable to use cyclegan? HTCN(Hierarchical Transferability Calibration Network)seemly like firstly introduce this data-augment in object detection。But HTCN withou cyclegan only get 37.5 in foggy。

In my opinion, transfer between similar domains is much easier.

The real problem is that Cityscapes to Foggy Cityscapes is an ill-defined task since there exists a single-to-single map between the images in the target domain and the source domain, which is not likely encountered in practical applications. (If you really encounter such occasions, you can use a simple solution like CycleGAN.)

Since previous work has used this task, we also support this task.

@JunguangJiang JunguangJiang added question Further information is requested object detection labels Mar 14, 2022
@zyfone
Copy link
Author

zyfone commented Mar 14, 2022

By the way,migration between similar domains always is a difficult problem for domain adaptive object detection。 Especially in cityscape and foggy cityscape. Using cyclegan seems like way which use target annotation,because pictures of cyclegan are very similar to the target pictures 。 SO,Is it unreasonable to use cyclegan? HTCN(Hierarchical Transferability Calibration Network)seemly like firstly introduce this data-augment in object detection。But HTCN withou cyclegan only get 37.5 in foggy。

In my opinion, transfer between similar domains is much easier.

The real problem is that Cityscapes to Foggy Cityscapes is an ill-defined task since there exists a single-to-single map between the images in the target domain and the source domain, which is not likely encountered in practical applications. (If you really encounter such occasions, you can use a simple solution like CycleGAN.)

Since previous work has used this task, we also support this task.

Thank you very much. It was a great harvest

@Fly-dream12
Copy link

Is the two supported method cycleGAN and Decouple Adaptation independent with each other, by the way, where is the adversarial process in cycleGAN, does it works like HTCN? @JunguangJiang @microhhh @zyfone Many thanks

@zyfone
Copy link
Author

zyfone commented Apr 21, 2022

Is the two supported method cycleGAN and Decouple Adaptation independent with each other, by the way, where is the adversarial process in cycleGAN, does it works like HTCN? @JunguangJiang @microhhh @zyfone Many thanks

cycleGAN is a kind of method which is used to augment dataset。 clipart or cityscape,for example 。

Decouple Adaptation is a domain adaptive obejct detection method which decouple domain procedure to enhance Transferability and Discriminability 。

Therefore,they are independent of each other。you also can use cycleGAN to get new target-like dataset in your train-set.

It works like HTCN. Beause of the need of fair comparison.
Fair comparison can prove validity of this paper

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
object detection question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants