From text to multimodal: a survey of adversarial example generation in question answering systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yigit, Gulsum, Amasyali, Mehmet Fatih
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910562286305280
author Yigit, Gulsum
Amasyali, Mehmet Fatih
author_facet Yigit, Gulsum
Amasyali, Mehmet Fatih
contents Integrating adversarial machine learning with Question Answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to comprehensively review adversarial example-generation techniques in the QA field, including textual and multimodal contexts. We examine the techniques employed through systematic categorization, providing a comprehensive, structured review. Beginning with an overview of traditional QA models, we traverse the adversarial example generation by exploring rule-based perturbations and advanced generative models. We then extend our research to include multimodal QA systems, analyze them across various methods, and examine generative models, seq2seq architectures, and hybrid methodologies. Our research grows to different defense strategies, adversarial datasets, and evaluation metrics and illustrates the comprehensive literature on adversarial QA. Finally, the paper considers the future landscape of adversarial question generation, highlighting potential research directions that can advance textual and multimodal QA systems in the context of adversarial challenges.
format Preprint
id arxiv_https___arxiv_org_abs_2312_16156
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle From text to multimodal: a survey of adversarial example generation in question answering systems
Yigit, Gulsum
Amasyali, Mehmet Fatih
Computation and Language
Artificial Intelligence
Integrating adversarial machine learning with Question Answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to comprehensively review adversarial example-generation techniques in the QA field, including textual and multimodal contexts. We examine the techniques employed through systematic categorization, providing a comprehensive, structured review. Beginning with an overview of traditional QA models, we traverse the adversarial example generation by exploring rule-based perturbations and advanced generative models. We then extend our research to include multimodal QA systems, analyze them across various methods, and examine generative models, seq2seq architectures, and hybrid methodologies. Our research grows to different defense strategies, adversarial datasets, and evaluation metrics and illustrates the comprehensive literature on adversarial QA. Finally, the paper considers the future landscape of adversarial question generation, highlighting potential research directions that can advance textual and multimodal QA systems in the context of adversarial challenges.
title From text to multimodal: a survey of adversarial example generation in question answering systems
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2312.16156