QLSC: A Query Latent Semantic Calibrator for Robust Extractive Question Answering

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ouyang, Sheng, Wang, Jianzong, Zhang, Yong, Li, Zhitao, Liang, Ziqi, Zhang, Xulong, Cheng, Ning, Xiao, Jing
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913336159895552
author Ouyang, Sheng
Wang, Jianzong
Zhang, Yong
Li, Zhitao
Liang, Ziqi
Zhang, Xulong
Cheng, Ning
Xiao, Jing
author_facet Ouyang, Sheng
Wang, Jianzong
Zhang, Yong
Li, Zhitao
Liang, Ziqi
Zhang, Xulong
Cheng, Ning
Xiao, Jing
contents Extractive Question Answering (EQA) in Machine Reading Comprehension (MRC) often faces the challenge of dealing with semantically identical but format-variant inputs. Our work introduces a novel approach, called the ``Query Latent Semantic Calibrator (QLSC)'', designed as an auxiliary module for existing MRC models. We propose a unique scaling strategy to capture latent semantic center features of queries. These features are then seamlessly integrated into traditional query and passage embeddings using an attention mechanism. By deepening the comprehension of the semantic queries-passage relationship, our approach diminishes sensitivity to variations in text format and boosts the model's capability in pinpointing accurate answers. Experimental results on robust Question-Answer datasets confirm that our approach effectively handles format-variant but semantically identical queries, highlighting the effectiveness and adaptability of our proposed method.
format Preprint
id arxiv_https___arxiv_org_abs_2404_19316
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle QLSC: A Query Latent Semantic Calibrator for Robust Extractive Question Answering
Ouyang, Sheng
Wang, Jianzong
Zhang, Yong
Li, Zhitao
Liang, Ziqi
Zhang, Xulong
Cheng, Ning
Xiao, Jing
Computation and Language
Extractive Question Answering (EQA) in Machine Reading Comprehension (MRC) often faces the challenge of dealing with semantically identical but format-variant inputs. Our work introduces a novel approach, called the ``Query Latent Semantic Calibrator (QLSC)'', designed as an auxiliary module for existing MRC models. We propose a unique scaling strategy to capture latent semantic center features of queries. These features are then seamlessly integrated into traditional query and passage embeddings using an attention mechanism. By deepening the comprehension of the semantic queries-passage relationship, our approach diminishes sensitivity to variations in text format and boosts the model's capability in pinpointing accurate answers. Experimental results on robust Question-Answer datasets confirm that our approach effectively handles format-variant but semantically identical queries, highlighting the effectiveness and adaptability of our proposed method.
title QLSC: A Query Latent Semantic Calibrator for Robust Extractive Question Answering
topic Computation and Language
url https://arxiv.org/abs/2404.19316