Copertina

Inside the Black Box: Detecting Data Leakage in Pre-trained Language Encoders

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Xin, Yuan, Li, Zheng, Yu, Ning, Chen, Dingfan, Fritz, Mario, Backes, Michael, Zhang, Yang
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Jailbreaking Attacks vs. Content Safety Filters: How Far Are We in the LLM Safety Arms Race?
di: Xin, Yuan, et al.
Pubblicazione: (2025)

Provably Cost-Sensitive Adversarial Defense via Randomized Smoothing
di: Xin, Yuan, et al.
Pubblicazione: (2023)

Reconsidering Degeneration of Token Embeddings with Definitions for Encoder-based Pre-trained Language Models
di: Zhang, Ying, et al.
Pubblicazione: (2024)

Probing Language Models for Pre-training Data Detection
di: Liu, Zhenhua, et al.
Pubblicazione: (2024)

PoLLMgraph: Unraveling Hallucinations in Large Language Models via State Transition Dynamics
di: Zhu, Derui, et al.
Pubblicazione: (2024)

Automated Detection of Pre-training Text in Black-box LLMs
di: Hu, Ruihan, et al.
Pubblicazione: (2025)

From Unfamiliar to Familiar: Detecting Pre-training Data via Gradient Deviations in Large Language Models
di: Zhang, Ruiqi, et al.
Pubblicazione: (2026)

On Leveraging Encoder-only Pre-trained Language Models for Effective Keyphrase Generation
di: Wu, Di, et al.
Pubblicazione: (2024)

Reconstruct Your Previous Conversations! Comprehensively Investigating Privacy Leakage Risks in Conversations with GPT Models
di: Chu, Junjie, et al.
Pubblicazione: (2024)

Knowledge Distillation of Black-Box Large Language Models
di: Chen, Hongzhan, et al.
Pubblicazione: (2024)

Black-Box Segmentation of Electronic Medical Records
di: Yuan, Hongyi, et al.
Pubblicazione: (2024)

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization
di: Zhang, Haode, et al.
Pubblicazione: (2022)

Nemotron-CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training
di: Diao, Shizhe, et al.
Pubblicazione: (2025)

The Inverse Scaling Effect of Pre-Trained Language Model Surprisal Is Not Due to Data Leakage
di: Oh, Byung-Doh, et al.
Pubblicazione: (2025)

OPUS: Towards Efficient and Principled Data Selection in Large Language Model Pre-training in Every Iteration
di: Wang, Shaobo, et al.
Pubblicazione: (2026)

Memory Reviving, Continuing Learning and Beyond: Evaluation of Pre-trained Encoders and Decoders for Multimodal Machine Translation
di: Yu, Zhuang, et al.
Pubblicazione: (2025)

Masked Structural Growth for 2x Faster Language Model Pre-training
di: Yao, Yiqun, et al.
Pubblicazione: (2023)

NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data
di: Bogdanov, Sergei, et al.
Pubblicazione: (2024)

Text to Band Gap: Pre-trained Language Models as Encoders for Semiconductor Band Gap Prediction
di: Yeh, Ying-Ting, et al.
Pubblicazione: (2025)

Adaptive Pre-training Data Detection for Large Language Models via Surprising Tokens
di: Zhang, Anqi, et al.
Pubblicazione: (2024)

Generalist Reward Models: Found Inside Large Language Models
di: Li, Yi-Chen, et al.
Pubblicazione: (2025)

DataMan: Data Manager for Pre-training Large Language Models
di: Peng, Ru, et al.
Pubblicazione: (2025)

Relational Prompt-based Pre-trained Language Models for Social Event Detection
di: Li, Pu, et al.
Pubblicazione: (2024)

Knowledge-augmented Pre-trained Language Models for Biomedical Relation Extraction
di: Sänger, Mario, et al.
Pubblicazione: (2025)

Are Transformers in Pre-trained LM A Good ASR Encoder? An Empirical Study
di: An, Keyu, et al.
Pubblicazione: (2024)

DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment
di: Li, Haitao, et al.
Pubblicazione: (2024)

Quantifying Memorization and Detecting Training Data of Pre-trained Language Models using Japanese Newspaper
di: Ishihara, Shotaro, et al.
Pubblicazione: (2024)

PDR: A Plug-and-Play Positional Decay Framework for LLM Pre-training Data Detection
di: Liu, Jinhan, et al.
Pubblicazione: (2026)

RegMix: Data Mixture as Regression for Language Model Pre-training
di: Liu, Qian, et al.
Pubblicazione: (2024)

Boosting Explainability through Selective Rationalization in Pre-trained Language Models
di: Yuan, Libing, et al.
Pubblicazione: (2025)

SSL-WM: A Black-Box Watermarking Approach for Encoders Pre-trained by Self-supervised Learning
di: Lv, Peizhuo, et al.
Pubblicazione: (2022)

A Systematic Study of Training-Free Methods for Trustworthy Large Language Models
di: Si, Wai Man, et al.
Pubblicazione: (2026)

Membership Inference Attacks Against In-Context Learning
di: Wen, Rui, et al.
Pubblicazione: (2024)

DataVisT5: A Pre-trained Language Model for Jointly Understanding Text and Data Visualization
di: Wan, Zhuoyue, et al.
Pubblicazione: (2024)

Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RL
di: Wang, Sudong, et al.
Pubblicazione: (2026)

AfriqueLLM: How Data Mixing and Model Architecture Impact Continued Pre-training for African Languages
di: Yu, Hao, et al.
Pubblicazione: (2026)

Fuzzy Fingerprinting Encoder Pre-trained Language Models for Emotion Recognition in Conversations: Human Assessment and Validity Study
di: Pereira, Patrícia, et al.
Pubblicazione: (2026)

Examining Forgetting in Continual Pre-training of Aligned Large Language Models
di: Li, Chen-An, et al.
Pubblicazione: (2024)

Language Models as Hierarchy Encoders
di: He, Yuan, et al.
Pubblicazione: (2024)

RadarPLM: Adapting Pre-trained Language Models for Marine Radar Target Detection by Selective Fine-tuning
di: Hu, Qiying, et al.
Pubblicazione: (2025)