arXiv cs.AI· Gabriella Bollici, Stefano De Giorgis, Wouter Van Atteveldt, Filip Ilievski·· 2 小时前AI 评分34
IRON-Meme:面向网络迷因叙事中身份与角色的结构化理解基准
IRON-Meme: A Benchmark for Structured Understanding of Identities and Roles in Online Meme Narratives
AI 导读
研究者发布 IRON-Meme,一个基于社会科学理论、由人工标注的 1,110 条政治迷因基准,涵盖社会身份、内外群体视角与叙事角色三类标签。对九个视觉语言模型的评测显示,前沿规模与推理型模型表现最好,但低频标签在身份和角色分类上准确率下降;加入模板背景知识无助于角色分类。IRON-Meme 与代码已公开。
正文 · 原文
Abstract:As polarization grows on social media, understanding how political memes shape online narratives has become increasingly important. Previous research has relied on either qualitative frameworks that are hard to scale or computational methods that lack theoretical grounding. Both approaches treat narrative categories in isolation and focus exclusively on moral portrayals of identity. To address these limitations, we introduce a framework grounded in social science theories, encompassing three categories: social identities (such as gender, politics, and ethnicity), viewpoints (ingroup and outgroup perspectives), and narrative roles (moral character, intelligence, status, and power). Building on this framework, we present IRON-Meme, a human-annotated benchmark comprising 1,110 political memes across substantially more templates than existing benchmarks. Our analysis of IRON-Meme shows that most memes assign derogatory roles and that identities, roles, and templates are systematically interconnected. Evaluation of nine vision-language models indicates that frontier-scale and reasoning models achieve the highest performance, while accuracy on social identities and narrative roles decreases for less frequent labels. Incorporating template background knowledge does not enhance narrative role classification, suggesting that meme interpretation relies on how memes are adapted for specific communicative purposes. We make IRON-Meme and our code publicly available.
| Comments: | Submitted to ARR |
| Subjects: | Artificial Intelligence (cs.AI) |
| MSC classes: | 68T07 |
| Cite as: | arXiv:2610.33097 [cs.AI] |
| (or arXiv:2610.33097v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.33097 arXiv-issued DOI via DataCite |
Submission history
From: Gabriella Bollici [view email]
[v1]
Thu, 22 Oct 2026 10:51:07 UTC (7,882 KB)
来源:arXiv cs.AI · arxiv.org