'Layer su Layer': Identifying and Disambiguating the Italian NPN Construction in BERT's family
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910102964928512 |
|---|---|
| author | Gorzoni, Greta Pannitto, Ludovica Masini, Francesca |
| author_facet | Gorzoni, Greta Pannitto, Ludovica Masini, Francesca |
| contents | Interpretability research has highlighted the importance of evaluating Pretrained Language Models (PLMs) and in particular contextual embeddings against explicit linguistic theories to determine what linguistic information they encode. This study focuses on the Italian NPN (noun-preposition-noun) constructional family, challenging some of the theoretical and methodological assumptions underlying previous experimental designs and extending this type of research to a lesser-investigated language. Contextual vector representations are extracted from BERT and used as input to layer-wise probing classifiers, systematically evaluating information encoded across the model's internal layers. The results shed light on the extent to which constructional form and meaning are reflected in contextual embeddings, contributing empirical evidence to the dialogue between constructionist theory and neural language modelling |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_03673 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | 'Layer su Layer': Identifying and Disambiguating the Italian NPN Construction in BERT's family Gorzoni, Greta Pannitto, Ludovica Masini, Francesca Computation and Language Interpretability research has highlighted the importance of evaluating Pretrained Language Models (PLMs) and in particular contextual embeddings against explicit linguistic theories to determine what linguistic information they encode. This study focuses on the Italian NPN (noun-preposition-noun) constructional family, challenging some of the theoretical and methodological assumptions underlying previous experimental designs and extending this type of research to a lesser-investigated language. Contextual vector representations are extracted from BERT and used as input to layer-wise probing classifiers, systematically evaluating information encoded across the model's internal layers. The results shed light on the extent to which constructional form and meaning are reflected in contextual embeddings, contributing empirical evidence to the dialogue between constructionist theory and neural language modelling |
| title | 'Layer su Layer': Identifying and Disambiguating the Italian NPN Construction in BERT's family |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2604.03673 |