| Datas-et | Language | # Hate | # Non-Hate | Resource |
|---|---|---|---|---|
| HateMM | English | 431 | 652 | BitChute |
| MultiHateClip | English | YouTube | ||
| MultiHateClip | Chinese | Bilibili |
"Is there any hateful content in this video? Respond 'Yes' or 'No' and explain why."
| MLLMs | Accuracy | Precision | Recall | F1 |
|---|---|---|---|---|
| Closed-source | ||||
| Gemini-1.5-pro | 0.64380 | 0.42741 | 0.94642 | 0.58889 |
| Azure AI Video Indexer | ||||
| Open-source | ||||
| VideoChat2 | ||||
| VideoLLaMA2 (30FPS) | 0.62442 | 0.54811 | 0.30536 | 0.39221 |
| LLaVA-Next-Video(Image-Text) | ||||
| LLaVA-OneVision(Image-Text) | ||||