Overcoming the Generalization Limits of SLM Finetuning for Shape-Based Extraction of Datatype and Object Properties
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917134966194176 |
|---|---|
| author | Ringwald, Célian Gandon, Fabien Faron, Catherine Michel, Franck Akl, Hanna Abi |
| author_facet | Ringwald, Célian Gandon, Fabien Faron, Catherine Michel, Franck Akl, Hanna Abi |
| contents | Small language models (SLMs) have shown promises for relation extraction (RE) when extracting RDF triples guided by SHACL shapes focused on common datatype properties. This paper investigates how SLMs handle both datatype and object properties for a complete RDF graph extraction. We show that the key bottleneck is related to long-tail distribution of rare properties. To solve this issue, we evaluate several strategies: stratified sampling, weighted loss, dataset scaling, and template-based synthetic data augmentation. We show that the best strategy to perform equally well over unbalanced target properties is to build a training set where the number of occurrences of each property exceeds a given threshold. To enable reproducibility, we publicly released our datasets, experimental results and code. Our findings offer practical guidance for training shape-aware SLMs and highlight promising directions for future work in semantic RE. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_03407 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Overcoming the Generalization Limits of SLM Finetuning for Shape-Based Extraction of Datatype and Object Properties Ringwald, Célian Gandon, Fabien Faron, Catherine Michel, Franck Akl, Hanna Abi Computation and Language I.2.7; I.2.4 Small language models (SLMs) have shown promises for relation extraction (RE) when extracting RDF triples guided by SHACL shapes focused on common datatype properties. This paper investigates how SLMs handle both datatype and object properties for a complete RDF graph extraction. We show that the key bottleneck is related to long-tail distribution of rare properties. To solve this issue, we evaluate several strategies: stratified sampling, weighted loss, dataset scaling, and template-based synthetic data augmentation. We show that the best strategy to perform equally well over unbalanced target properties is to build a training set where the number of occurrences of each property exceeds a given threshold. To enable reproducibility, we publicly released our datasets, experimental results and code. Our findings offer practical guidance for training shape-aware SLMs and highlight promising directions for future work in semantic RE. |
| title | Overcoming the Generalization Limits of SLM Finetuning for Shape-Based Extraction of Datatype and Object Properties |
| topic | Computation and Language I.2.7; I.2.4 |
| url | https://arxiv.org/abs/2511.03407 |