Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.07423 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912513825701888 |
|---|---|
| author | Koulakos, Alexandros Lymperaiou, Maria Filandrianos, Giorgos Stamou, Giorgos |
| author_facet | Koulakos, Alexandros Lymperaiou, Maria Filandrianos, Giorgos Stamou, Giorgos |
| contents | The surge of state-of-the-art Transformer-based models has undoubtedly pushed the limits of NLP model performance, excelling in a variety of tasks. We cast the spotlight on the underexplored task of Natural Language Inference (NLI), since models trained on popular well-suited datasets are susceptible to adversarial attacks, allowing subtle input interventions to mislead the model. In this work, we validate the usage of natural language explanation as a model-agnostic defence strategy through extensive experimentation: only by fine-tuning a classifier on the explanation rather than premise-hypothesis inputs, robustness under various adversarial attacks is achieved in comparison to explanation-free baselines. Moreover, since there is no standard strategy of testing the semantic validity of the generated explanations, we research the correlation of widely used language generation metrics with human perception, in order for them to serve as a proxy towards robust NLI models. Our approach is resource-efficient and reproducible without significant computational limitations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_07423 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Enhancing adversarial robustness in Natural Language Inference using explanations Koulakos, Alexandros Lymperaiou, Maria Filandrianos, Giorgos Stamou, Giorgos Computation and Language The surge of state-of-the-art Transformer-based models has undoubtedly pushed the limits of NLP model performance, excelling in a variety of tasks. We cast the spotlight on the underexplored task of Natural Language Inference (NLI), since models trained on popular well-suited datasets are susceptible to adversarial attacks, allowing subtle input interventions to mislead the model. In this work, we validate the usage of natural language explanation as a model-agnostic defence strategy through extensive experimentation: only by fine-tuning a classifier on the explanation rather than premise-hypothesis inputs, robustness under various adversarial attacks is achieved in comparison to explanation-free baselines. Moreover, since there is no standard strategy of testing the semantic validity of the generated explanations, we research the correlation of widely used language generation metrics with human perception, in order for them to serve as a proxy towards robust NLI models. Our approach is resource-efficient and reproducible without significant computational limitations. |
| title | Enhancing adversarial robustness in Natural Language Inference using explanations |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2409.07423 |