AEMLO: AutoEncoder-Guided Multi-Label Oversampling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Ao, Liu, Bin, Wang, Jin, Sun, Kaiwei, Liu, Kelin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929471544623104
author Zhou, Ao
Liu, Bin
Wang, Jin
Sun, Kaiwei
Liu, Kelin
author_facet Zhou, Ao
Liu, Bin
Wang, Jin
Sun, Kaiwei
Liu, Kelin
contents Class imbalance significantly impacts the performance of multi-label classifiers. Oversampling is one of the most popular approaches, as it augments instances associated with less frequent labels to balance the class distribution. Existing oversampling methods generate feature vectors of synthetic samples through replication or linear interpolation and assign labels through neighborhood information. Linear interpolation typically generates new samples between existing data points, which may result in insufficient diversity of synthesized samples and further lead to the overfitting issue. Deep learning-based methods, such as AutoEncoders, have been proposed to generate more diverse and complex synthetic samples, achieving excellent performance on imbalanced binary or multi-class datasets. In this study, we introduce AEMLO, an AutoEncoder-guided Oversampling technique specifically designed for tackling imbalanced multi-label data. AEMLO is built upon two fundamental components. The first is an encoder-decoder architecture that enables the model to encode input data into a low-dimensional feature space, learn its latent representations, and then reconstruct it back to its original dimension, thus applying to the generation of new data. The second is an objective function tailored to optimize the sampling task for multi-label scenarios. We show that AEMLO outperforms the existing state-of-the-art methods with extensive empirical studies.
format Preprint
id arxiv_https___arxiv_org_abs_2408_13078
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AEMLO: AutoEncoder-Guided Multi-Label Oversampling
Zhou, Ao
Liu, Bin
Wang, Jin
Sun, Kaiwei
Liu, Kelin
Machine Learning
Artificial Intelligence
Class imbalance significantly impacts the performance of multi-label classifiers. Oversampling is one of the most popular approaches, as it augments instances associated with less frequent labels to balance the class distribution. Existing oversampling methods generate feature vectors of synthetic samples through replication or linear interpolation and assign labels through neighborhood information. Linear interpolation typically generates new samples between existing data points, which may result in insufficient diversity of synthesized samples and further lead to the overfitting issue. Deep learning-based methods, such as AutoEncoders, have been proposed to generate more diverse and complex synthetic samples, achieving excellent performance on imbalanced binary or multi-class datasets. In this study, we introduce AEMLO, an AutoEncoder-guided Oversampling technique specifically designed for tackling imbalanced multi-label data. AEMLO is built upon two fundamental components. The first is an encoder-decoder architecture that enables the model to encode input data into a low-dimensional feature space, learn its latent representations, and then reconstruct it back to its original dimension, thus applying to the generation of new data. The second is an objective function tailored to optimize the sampling task for multi-label scenarios. We show that AEMLO outperforms the existing state-of-the-art methods with extensive empirical studies.
title AEMLO: AutoEncoder-Guided Multi-Label Oversampling
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2408.13078