Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accuracy issue, implementation difference compared to paper. #17

Open
avinash31d opened this issue Apr 4, 2020 · 4 comments
Open

Accuracy issue, implementation difference compared to paper. #17

avinash31d opened this issue Apr 4, 2020 · 4 comments

Comments

@avinash31d
Copy link

avinash31d commented Apr 4, 2020

Hi,

I tried retrain the model on biadu_V2, i am getting training iou as 0.945, but i evaluated on real life images, I am not able to get good results.

Also I can see the loss function you used in here is lovasz whereas the paper SINET has a completely different loss function. Can you provide some information on why the loss function and what could be the problem with these test images?

@HYOJINPARK
Copy link
Collaborator

@avinash31d
In here, I used normal CE loss and you can change it by modifying json file

@avinash31d
Copy link
Author

@HYOJINPARK

Thanks for taking out time,

I tried CE but it seems lovasz does it better. Also I posted few results just to compare. Can you crop the left side image and run through your model and upload the results here for comparison because I doubt if my model is working.

@HYOJINPARK
Copy link
Collaborator

@avinash31d
You can use my model, I uploaded the pth file

@ZshahRA
Copy link

ZshahRA commented May 6, 2020

Hello @avinash31d,

Could you please provide your code for visualize_video.py. I want to see how you test your new images. I have trouble in loading Extremec3Net model in visualize_video.py. Thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants