Saved in:
Bibliographic Details
Main Authors: Cao, Xi, Gesang, Quzong, Sun, Yuan, Qun, Nuo, Nyima, Tashi
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.02371
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909535065604096
author Cao, Xi
Gesang, Quzong
Sun, Yuan
Qun, Nuo
Nyima, Tashi
author_facet Cao, Xi
Gesang, Quzong
Sun, Yuan
Qun, Nuo
Nyima, Tashi
contents Language models based on deep neural networks are vulnerable to textual adversarial attacks. While rich-resource languages like English are receiving focused attention, Tibetan, a cross-border language, is gradually being studied due to its abundant ancient literature and critical language strategy. Currently, there are several Tibetan adversarial text generation methods, but they do not fully consider the textual features of Tibetan script and overestimate the quality of generated adversarial texts. To address this issue, we propose a novel Tibetan adversarial text generation method called TSCheater, which considers the characteristic of Tibetan encoding and the feature that visually similar syllables have similar semantics. This method can also be transferred to other abugidas, such as Devanagari script. We utilize a self-constructed Tibetan syllable visual similarity database called TSVSDB to generate substitution candidates and adopt a greedy algorithm-based scoring mechanism to determine substitution order. After that, we conduct the method on eight victim language models. Experimentally, TSCheater outperforms existing methods in attack effectiveness, perturbation magnitude, semantic similarity, visual similarity, and human acceptance. Finally, we construct the first Tibetan adversarial robustness evaluation benchmark called AdvTS, which is generated by existing methods and proofread by humans.
format Preprint
id arxiv_https___arxiv_org_abs_2412_02371
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle TSCheater: Generating High-Quality Tibetan Adversarial Texts via Visual Similarity
Cao, Xi
Gesang, Quzong
Sun, Yuan
Qun, Nuo
Nyima, Tashi
Computation and Language
Cryptography and Security
Language models based on deep neural networks are vulnerable to textual adversarial attacks. While rich-resource languages like English are receiving focused attention, Tibetan, a cross-border language, is gradually being studied due to its abundant ancient literature and critical language strategy. Currently, there are several Tibetan adversarial text generation methods, but they do not fully consider the textual features of Tibetan script and overestimate the quality of generated adversarial texts. To address this issue, we propose a novel Tibetan adversarial text generation method called TSCheater, which considers the characteristic of Tibetan encoding and the feature that visually similar syllables have similar semantics. This method can also be transferred to other abugidas, such as Devanagari script. We utilize a self-constructed Tibetan syllable visual similarity database called TSVSDB to generate substitution candidates and adopt a greedy algorithm-based scoring mechanism to determine substitution order. After that, we conduct the method on eight victim language models. Experimentally, TSCheater outperforms existing methods in attack effectiveness, perturbation magnitude, semantic similarity, visual similarity, and human acceptance. Finally, we construct the first Tibetan adversarial robustness evaluation benchmark called AdvTS, which is generated by existing methods and proofread by humans.
title TSCheater: Generating High-Quality Tibetan Adversarial Texts via Visual Similarity
topic Computation and Language
Cryptography and Security
url https://arxiv.org/abs/2412.02371