Improving Causal Interventions in Amnesic Probing with Mean Projection or LEACE
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916793334890496 |
|---|---|
| author | Dobrzeniecka, Alicja Fokkens, Antske Sommerauer, Pia |
| author_facet | Dobrzeniecka, Alicja Fokkens, Antske Sommerauer, Pia |
| contents | Amnesic probing is a technique used to examine the influence of specific linguistic information on the behaviour of a model. This involves identifying and removing the relevant information and then assessing whether the model's performance on the main task changes. If the removed information is relevant, the model's performance should decline. The difficulty with this approach lies in removing only the target information while leaving other information unchanged. It has been shown that Iterative Nullspace Projection (INLP), a widely used removal technique, introduces random modifications to representations when eliminating target information. We demonstrate that Mean Projection (MP) and LEACE, two proposed alternatives, remove information in a more targeted manner, thereby enhancing the potential for obtaining behavioural explanations through Amnesic Probing. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_11673 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Improving Causal Interventions in Amnesic Probing with Mean Projection or LEACE Dobrzeniecka, Alicja Fokkens, Antske Sommerauer, Pia Computation and Language Artificial Intelligence Amnesic probing is a technique used to examine the influence of specific linguistic information on the behaviour of a model. This involves identifying and removing the relevant information and then assessing whether the model's performance on the main task changes. If the removed information is relevant, the model's performance should decline. The difficulty with this approach lies in removing only the target information while leaving other information unchanged. It has been shown that Iterative Nullspace Projection (INLP), a widely used removal technique, introduces random modifications to representations when eliminating target information. We demonstrate that Mean Projection (MP) and LEACE, two proposed alternatives, remove information in a more targeted manner, thereby enhancing the potential for obtaining behavioural explanations through Amnesic Probing. |
| title | Improving Causal Interventions in Amnesic Probing with Mean Projection or LEACE |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2506.11673 |