MemeSense: An Adaptive In-Context Framework for Social Commonsense Driven Meme Moderation
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908599672897536 |
|---|---|
| author | Adak, Sayantan Banerjee, Somnath Mandal, Rajarshi Halder, Avik Layek, Sayan Hazra, Rima Mukherjee, Animesh |
| author_facet | Adak, Sayantan Banerjee, Somnath Mandal, Rajarshi Halder, Avik Layek, Sayan Hazra, Rima Mukherjee, Animesh |
| contents | Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail to recognize such subtle or implicit harm. We introduce MemeSense, an adaptive framework designed to generate socially grounded interventions for harmful memes by combining visual and textual understanding with curated, semantically aligned examples enriched with commonsense cues. This enables the model to detect nuanced complexed threats like misogyny, stereotyping, or vulgarity "even in memes lacking overt language". Across multiple benchmark datasets, MemeSense outperforms state-of-the-art methods, achieving up to 35% higher semantic similarity and 9% improvement in BERTScore for non-textual memes, and notable gains for text-rich memes as well. These results highlight MemeSense as a promising step toward safer, more context-aware AI systems for real-world content moderation. Code and data available at: https://github.com/sayantan11995/MemeSense |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_11246 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MemeSense: An Adaptive In-Context Framework for Social Commonsense Driven Meme Moderation Adak, Sayantan Banerjee, Somnath Mandal, Rajarshi Halder, Avik Layek, Sayan Hazra, Rima Mukherjee, Animesh Information Retrieval Computation and Language Computers and Society Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail to recognize such subtle or implicit harm. We introduce MemeSense, an adaptive framework designed to generate socially grounded interventions for harmful memes by combining visual and textual understanding with curated, semantically aligned examples enriched with commonsense cues. This enables the model to detect nuanced complexed threats like misogyny, stereotyping, or vulgarity "even in memes lacking overt language". Across multiple benchmark datasets, MemeSense outperforms state-of-the-art methods, achieving up to 35% higher semantic similarity and 9% improvement in BERTScore for non-textual memes, and notable gains for text-rich memes as well. These results highlight MemeSense as a promising step toward safer, more context-aware AI systems for real-world content moderation. Code and data available at: https://github.com/sayantan11995/MemeSense |
| title | MemeSense: An Adaptive In-Context Framework for Social Commonsense Driven Meme Moderation |
| topic | Information Retrieval Computation and Language Computers and Society |
| url | https://arxiv.org/abs/2502.11246 |