How to Achieve Higher Accuracy with Less Training Points?

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Jinghan, Pani, Anupam, Zhang, Yunchao
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908325969395712
author Yang, Jinghan
Pani, Anupam
Zhang, Yunchao
author_facet Yang, Jinghan
Pani, Anupam
Zhang, Yunchao
contents In the era of large-scale model training, the extensive use of available datasets has resulted in significant computational inefficiencies. To tackle this issue, we explore methods for identifying informative subsets of training data that can achieve comparable or even superior model performance. We propose a technique based on influence functions to determine which training samples should be included in the training set. We conducted empirical evaluations of our method on binary classification tasks utilizing logistic regression models. Our approach demonstrates performance comparable to that of training on the entire dataset while using only 10% of the data. Furthermore, we found that our method achieved even higher accuracy when trained with just 60% of the data.
format Preprint
id arxiv_https___arxiv_org_abs_2504_13586
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle How to Achieve Higher Accuracy with Less Training Points?
Yang, Jinghan
Pani, Anupam
Zhang, Yunchao
Machine Learning
Applications
In the era of large-scale model training, the extensive use of available datasets has resulted in significant computational inefficiencies. To tackle this issue, we explore methods for identifying informative subsets of training data that can achieve comparable or even superior model performance. We propose a technique based on influence functions to determine which training samples should be included in the training set. We conducted empirical evaluations of our method on binary classification tasks utilizing logistic regression models. Our approach demonstrates performance comparable to that of training on the entire dataset while using only 10% of the data. Furthermore, we found that our method achieved even higher accuracy when trained with just 60% of the data.
title How to Achieve Higher Accuracy with Less Training Points?
topic Machine Learning
Applications
url https://arxiv.org/abs/2504.13586