Support for adding custom model?

[dat-rohit]

Hi, I was looking at this tool and was wondering if (and how) it would be possible to use my own finetuned SAM model instead of the base one?
Ideally, I would like to draw the bounding box and let my model predict a segmented mask.

Any insight or help would be highly appreciated.

[Skwarson96]

How did you finetune SAM? Did you use any open solutions?

[dat-rohit]

It was actually released here in open-source with a .pth file: https://github.com/OpenGVLab/SAM-Med2D

[Skwarson96]

@dat-rohit I read your question once again and I have two observations:

• These labeling tool based on pre generated embeddings and onnx models so you need to figure out how to do it with your model
• SALT doesnt support box labeling 😢

[dat-rohit]

Thank you a lot for your insightful answer, definitely helped me!

[Skwarson96]

I added box prompt to my fork here