Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Same image but bbox results from image_to_annotations and demo are different? #154

Closed
yihleego opened this issue May 8, 2023 · 2 comments

Comments

@yihleego
Copy link
Contributor

yihleego commented May 8, 2023

I used the same image run with image_to_annotations.py and the web demo, but the result from the web demo is bigger and looks better.

Did I miss something or does the API /predictions/drawn_humanoid_detector require args?

image_to_annotations.py

[
    {
        "class_name":"humanoid",
        "bbox":[
            227.16668701171875,
            171.42706298828125,
            499.19720458984375,
            526.5897216796875
        ],
        "score":0.9974969029426575
    }
]

texture

Demo (https://sketch.metademolab.com)

{
    "x1": 192,
    "y1": 164,
    "x2": 529,
    "y2": 545
}

image

@hjessmith
Copy link
Contributor

They're actually completely different models, so I'm not surprised to see that the results don't line up perfectly. The online demo model was trained several years ago, and the model weights released alongside the project were obtained via fine-tuning with data collected from the online demo.

If the returned detection is clipping the extremities of your character, this can result in very bad segmentations maps. If you want to be certain to avoid this, I would recommend you pad the detected bounding box (e.g. add 15 pixels to each side) and use that in the downstream segmentation and pose estimation steps.

@yihleego
Copy link
Contributor Author

yihleego commented May 9, 2023

Thank you for providing this information, it's better with padding now. 😄

@yihleego yihleego closed this as completed May 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants