Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于跟视觉相关的shortcut统计相关问题 #2

Open
dggeed opened this issue Oct 24, 2023 · 8 comments
Open

关于跟视觉相关的shortcut统计相关问题 #2

dggeed opened this issue Oct 24, 2023 · 8 comments

Comments

@dggeed
Copy link

dggeed commented Oct 24, 2023

您好,感谢您的工作!我看您文章中附录B.3章节介绍关于如何计算KO/KOP/QT+KO-specific 相关的互信息那段描述中的提及了,KO: All objects (81 kinds of objects in total) appear in the images are provided in the VQA v2 annotation.,我想请教一下,您这里提及的VQAv2数据集的标注中一共有81种目标是怎么得到的呀?另外还想请教下,每条样本包含了<image, question, answer>,该样本中的image中包含了哪些object的相关信息也包含在VQAv2数据集的标注中吗?

@PhoebusSi
Copy link
Owner

PhoebusSi commented Oct 24, 2023 via email

@dggeed
Copy link
Author

dggeed commented Oct 25, 2023

感谢您的回复,再麻烦请教下:每张image中包含了哪些object的相关信息包含在VQAv2数据集的标注中是哪个版本的数据集呢。我下载了之前VQAv2数据集和您这篇文章中的VQA-VS数据集,question标注信息中都只包含了{question_id, image_id, question},而answer标注信息中也只包含了{question_type, multiple_choice_answer, image_id, answer_type, question_id}信息,没有看到哪里有说每张image中包含了哪些object呀

@PhoebusSi
Copy link
Owner

PhoebusSi commented Oct 25, 2023 via email

@PhoebusSi
Copy link
Owner

PhoebusSi commented Oct 25, 2023 via email

@dggeed
Copy link
Author

dggeed commented Oct 25, 2023

image
COCO这篇文章我看了下的,文中说的是包含91种类型的object,然后我看您文章中写的“81种object来自VQAv2数据集提供的标注”,所以,我感觉VQAv2数据集是不是并没有用到COCO数据集中的image全集,但是又不是很清楚您写的由VQAv2中包含的81种object标注信息是哪个版本的VQAv2

@dggeed
Copy link
Author

dggeed commented Oct 25, 2023

image

还有就是我看您文章中利用公式9去计算object与answer之间的互信息的话,那您用的VQAv2数据版本中的数据标注中应该是包含了image中object的标注信息的。所以主要是想请教下,您用的哪个版本的VQAv2数据集呀,因为我目前的工作中也想用到image中包含的object信息,谢谢啦~

@PhoebusSi
Copy link
Owner

PhoebusSi commented Oct 25, 2023 via email

@dggeed
Copy link
Author

dggeed commented Oct 25, 2023

好的,非常感谢您的回复,我去看看~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants