READ: Reinforcement-based Adversarial Learning for Text Classification with Limited Labeled Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sharma, Rohit, Kumar, Shanu, Kumar, Avinash
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910783800082432
author Sharma, Rohit
Kumar, Shanu
Kumar, Avinash
author_facet Sharma, Rohit
Kumar, Shanu
Kumar, Avinash
contents Pre-trained transformer models such as BERT have shown massive gains across many text classification tasks. However, these models usually need enormous labeled data to achieve impressive performances. Obtaining labeled data is often expensive and time-consuming, whereas collecting unlabeled data using some heuristics is relatively much cheaper for any task. Therefore, this paper proposes a method that encapsulates reinforcement learning-based text generation and semi-supervised adversarial learning approaches in a novel way to improve the model's performance. Our method READ, Reinforcement-based Adversarial learning, utilizes an unlabeled dataset to generate diverse synthetic text through reinforcement learning, improving the model's generalization capability using adversarial learning. Our experimental results show that READ outperforms the existing state-of-art methods on multiple datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2501_08035
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle READ: Reinforcement-based Adversarial Learning for Text Classification with Limited Labeled Data
Sharma, Rohit
Kumar, Shanu
Kumar, Avinash
Computation and Language
Artificial Intelligence
Pre-trained transformer models such as BERT have shown massive gains across many text classification tasks. However, these models usually need enormous labeled data to achieve impressive performances. Obtaining labeled data is often expensive and time-consuming, whereas collecting unlabeled data using some heuristics is relatively much cheaper for any task. Therefore, this paper proposes a method that encapsulates reinforcement learning-based text generation and semi-supervised adversarial learning approaches in a novel way to improve the model's performance. Our method READ, Reinforcement-based Adversarial learning, utilizes an unlabeled dataset to generate diverse synthetic text through reinforcement learning, improving the model's generalization capability using adversarial learning. Our experimental results show that READ outperforms the existing state-of-art methods on multiple datasets.
title READ: Reinforcement-based Adversarial Learning for Text Classification with Limited Labeled Data
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2501.08035