Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Interest detection similar to Detectron2 #3

Closed
DonaldTsang opened this issue Dec 30, 2019 · 2 comments
Closed

Interest detection similar to Detectron2 #3

DonaldTsang opened this issue Dec 30, 2019 · 2 comments

Comments

@DonaldTsang
Copy link

DonaldTsang commented Dec 30, 2019

In detectron2 (see ) you can breakdown an image based on what objects or parts or items are inside an image... is it possible to apply this to DDAM through image edge detection?

having blurs between the wings and the shoulders in addition to the boobs
some of the pubes are showing, while a faux-penis has been blurred in the shady regions

@DonaldTsang
Copy link
Author

DonaldTsang commented Dec 30, 2019

Another concept: Recaptcha-like image regional refinement, for example present a 3x3 square of images for people to tag, where 5 of the images are not related to the tag in question, 3 of the images are human-affirmed images with the tag, and 1 single image where it is machine tagged to be true but not yet confirmed by a human (5-3-1 strategy).

In order to prevent bounding box bias in image orientation (+-45degrees) the images would have to be altered slightly such that people can tag them without the influence of background noise.
See: https://github.com/aleju/imgaug for possible aid in the system

Also in order to prevent overfitting and ML botting, "Adversarial Examples" would need to be implemented in order to fuzz things and make training better (in a reasonable manner that is not too extreme when compared distance in YCbCr or similar color system).
See:

@halcy
Copy link
Owner

halcy commented Jan 2, 2020

It really isn't made for segmentation, so I'm not sure how one could effectively get super nice proper segment borders.

Wrt resistance to adversarial examples: This is a published model, so you're in a white-box situation - and as far as my understanding goes, that means you're fairly close to hosed no matter what - in which case it makes more sense to specifically look at where you'd want to use the model, what your expected threats are, and how to mitigate them other than by trying to make the model a tiny bit better (since you'll want those semi-automatic, non-ml mitigations anyways).

In any case, I see you did find the original authors repo, so I'll close this here - but feel free to fork off or copy my code if it's useful for your segmentation experiments.

@halcy halcy closed this as completed Jan 2, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants