Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.20315 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909366650667008 |
|---|---|
| author | Zhong, Ming Wu, Zhizhi Honda, Nanako |
| author_facet | Zhong, Ming Wu, Zhizhi Honda, Nanako |
| contents | Dense retrievers have achieved state-of-the-art performance in various information retrieval tasks, but their robustness against tokenizer poisoning remains underexplored. In this work, we assess the vulnerability of dense retrieval systems to poisoned tokenizers by evaluating models such as BERT, Dense Passage Retrieval (DPR), Contriever, SimCSE, and ANCE. We find that supervised models like BERT and DPR experience significant performance degradation when tokenizers are compromised, while unsupervised models like ANCE show greater resilience. Our experiments reveal that even small perturbations can severely impact retrieval accuracy, highlighting the need for robust defenses in critical applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_20315 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Deep Learning Based Dense Retrieval: A Comparative Study Zhong, Ming Wu, Zhizhi Honda, Nanako Computation and Language Artificial Intelligence Dense retrievers have achieved state-of-the-art performance in various information retrieval tasks, but their robustness against tokenizer poisoning remains underexplored. In this work, we assess the vulnerability of dense retrieval systems to poisoned tokenizers by evaluating models such as BERT, Dense Passage Retrieval (DPR), Contriever, SimCSE, and ANCE. We find that supervised models like BERT and DPR experience significant performance degradation when tokenizers are compromised, while unsupervised models like ANCE show greater resilience. Our experiments reveal that even small perturbations can severely impact retrieval accuracy, highlighting the need for robust defenses in critical applications. |
| title | Deep Learning Based Dense Retrieval: A Comparative Study |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2410.20315 |