-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Question about the description #2
Comments
Refer to read our paper on arxiv(https://arxiv.org/abs/2310.19070). We encode the anomaly maps predicted by vision experts with our proposed Expert Perception modules into both LLM and Qformer(MiniGPT4) as instructions. |
No, we do not use complex constructed answers for IAD instruction. |
Reckless to ask,I don’t understand how to enable Myriad with the ability to describe IAD, it seems like you freeze the LLM module,So how can you enable the MiniGPT to describe IAD? With the designed prompt and embedding,the conclusion that " the MiniGPT4 can make such description" seems to be impossible?
![image](https://private-user-images.githubusercontent.com/90709683/291660614-ad40f209-2034-4e94-81fa-3982719ae1c0.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjA5MzY2NzMsIm5iZiI6MTcyMDkzNjM3MywicGF0aCI6Ii85MDcwOTY4My8yOTE2NjA2MTQtYWQ0MGYyMDktMjAzNC00ZTk0LTgxZmEtMzk4MjcxOWFlMWMwLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MTQlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzE0VDA1NTI1M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTEyNzIyMTA1NTVmODM3NWM5MjM1OGNiNGMzMGViZjU0NTExZDFhY2JlZjMwMzhkNDJhYWQ0NTBjMGU2MDk3MGUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.dlvsuBJBpaCTJhmU5xWbzMPg2lkFFhRoG_kDfpfdH1E)
The text was updated successfully, but these errors were encountered: