Can it work without the mask images?

[liyiyue2021]

I want to use this perfect work in a new dataset, but the dataset doesn't have mask labels. My objective is to perform image-level anomaly detection (normal or abnormal classification). Is that possible to achieve this using this code?

[ByChelsea]

Can you please provide more information about the new dataset (if possible)? Is it similar to datasets like MVTec-AD and VisA, or more like ImageNet and CIFAR-10? I might need more information to assess this.

[liyiyue2021]

This is a medical dataset (images of brain lesions) that has been used for anomaly detection tasks before, but without the information on masks for the abnormal regions.

[liyiyue2021]

The training process is only normal images, testing is normal and abnormal images

[ByChelsea]

Since our method is designed for zero-shot applications, you can attempt testing it on your dataset by simply changing the text prompt. However, due to the significant disparity between medical tasks and industrial anomaly detection, direct testing may not yield satisfactory results. Therefore, you can also consider retraining our method by generating synthetic anomalies (e.g. DRAEM) to better align with your specific application.

The above is just my suggestion. Since I'm not specialized in medical tasks, my ideas may not be entirely suitable. Please take them as a reference. :)

[liyiyue2021]

Thank you so much for your patient explanation and response. I have one more small request: could you please share the manual download link for the CLIP model ( ViT-L-14-336)?

[ByChelsea]

Sure! You can find all the links you need here.

[liyiyue2021]

Thanks so much.