Iterative Multilingual Spectral Attribute Erasure
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917170907185152 |
|---|---|
| author | Shao, Shun Ziser, Yftah Zhao, Zheng Qiu, Yifu Cohen, Shay B. Korhonen, Anna |
| author_facet | Shao, Shun Ziser, Yftah Zhao, Zheng Qiu, Yifu Cohen, Shay B. Korhonen, Anna |
| contents | Multilingual representations embed words with similar meanings to share a common semantic space across languages, creating opportunities to transfer debiasing effects between languages. However, existing methods for debiasing are unable to exploit this opportunity because they operate on individual languages. We present Iterative Multilingual Spectral Attribute Erasure (IMSAE), which identifies and mitigates joint bias subspaces across multiple languages through iterative SVD-based truncation. Evaluating IMSAE across eight languages and five demographic dimensions, we demonstrate its effectiveness in both standard and zero-shot settings, where target language data is unavailable, but linguistically similar languages can be used for debiasing. Our comprehensive experiments across diverse language models (BERT, LLaMA, Mistral) show that IMSAE outperforms traditional monolingual and cross-lingual approaches while maintaining model utility. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_11244 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Iterative Multilingual Spectral Attribute Erasure Shao, Shun Ziser, Yftah Zhao, Zheng Qiu, Yifu Cohen, Shay B. Korhonen, Anna Computation and Language Multilingual representations embed words with similar meanings to share a common semantic space across languages, creating opportunities to transfer debiasing effects between languages. However, existing methods for debiasing are unable to exploit this opportunity because they operate on individual languages. We present Iterative Multilingual Spectral Attribute Erasure (IMSAE), which identifies and mitigates joint bias subspaces across multiple languages through iterative SVD-based truncation. Evaluating IMSAE across eight languages and five demographic dimensions, we demonstrate its effectiveness in both standard and zero-shot settings, where target language data is unavailable, but linguistically similar languages can be used for debiasing. Our comprehensive experiments across diverse language models (BERT, LLaMA, Mistral) show that IMSAE outperforms traditional monolingual and cross-lingual approaches while maintaining model utility. |
| title | Iterative Multilingual Spectral Attribute Erasure |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2506.11244 |