Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.06306 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913538463760384 |
|---|---|
| author | Reale, Simona Di Stasio, Pietro Mauro, Francesco Sebastianelli, Alessandro Gamba, Paolo Ullo, Silvia Liberata |
| author_facet | Reale, Simona Di Stasio, Pietro Mauro, Francesco Sebastianelli, Alessandro Gamba, Paolo Ullo, Silvia Liberata |
| contents | In this paper, a novel method for data splitting is presented: an iterative procedure divides the input dataset of volcanic eruption, chosen as the proposed use case, into two parts using a dissimilarity index calculated on the cumulative histograms of these two parts. The Cumulative Histogram Dissimilarity (CHD) index is introduced as part of the design. Based on the obtained results the proposed model in this case, compared to both Random splitting and K-means implemented over different configurations, achieves the best performance, with a slightly higher number of epochs. However, this demonstrates that the model can learn more deeply from the input dataset, which is attributable to the quality of the splitting. In fact, each model was trained with early stopping, suitable in case of overfitting, and the higher number of epochs in the proposed method demonstrates that early stopping did not detect overfitting, and consequently, the learning was optimal. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_06306 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Benchmarking of a new data splitting method on volcanic eruption data Reale, Simona Di Stasio, Pietro Mauro, Francesco Sebastianelli, Alessandro Gamba, Paolo Ullo, Silvia Liberata Computer Vision and Pattern Recognition In this paper, a novel method for data splitting is presented: an iterative procedure divides the input dataset of volcanic eruption, chosen as the proposed use case, into two parts using a dissimilarity index calculated on the cumulative histograms of these two parts. The Cumulative Histogram Dissimilarity (CHD) index is introduced as part of the design. Based on the obtained results the proposed model in this case, compared to both Random splitting and K-means implemented over different configurations, achieves the best performance, with a slightly higher number of epochs. However, this demonstrates that the model can learn more deeply from the input dataset, which is attributable to the quality of the splitting. In fact, each model was trained with early stopping, suitable in case of overfitting, and the higher number of epochs in the proposed method demonstrates that early stopping did not detect overfitting, and consequently, the learning was optimal. |
| title | Benchmarking of a new data splitting method on volcanic eruption data |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2410.06306 |