Image de couverture de livre

PDR: A Plug-and-Play Positional Decay Framework for LLM Pre-training Data Detection

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Liu, Jinhan, Yang, Yibo, Lu, Ruiying, Piekos, Piotr, Chen, Yimeng, Wang, Peng, Guo, Dandan
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
par: Xiao, Chaojun, et autres
Publié: (2023)

Investigating Mask-aware Prototype Learning for Tabular Anomaly Detection
par: Lu, Ruiying, et autres
Publié: (2025)

Mixture of Sparse Attention: Content-Based Learnable Sparse Attention via Expert-Choice Routing
par: Piękos, Piotr, et autres
Publié: (2025)

Probing Language Models for Pre-training Data Detection
par: Liu, Zhenhua, et autres
Publié: (2024)

AgentMonitor: A Plug-and-Play Framework for Predictive and Secure Multi-Agent Systems
par: Chan, Chi-Min, et autres
Publié: (2024)

Plug-and-Play Training Framework for Preference Optimization
par: Ma, Jingyuan, et autres
Publié: (2024)

PAS: Data-Efficient Plug-and-Play Prompt Augmentation System
par: Zheng, Miao, et autres
Publié: (2024)

WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training
par: Tian, Changxin, et autres
Publié: (2025)

Pre-training LLM without Learning Rate Decay Enhances Supervised Fine-Tuning
par: Yano, Kazuki, et autres
Publié: (2026)

Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
par: Zhang, Zhenyu, et autres
Publié: (2024)

Generation-Augmented Generation: A Plug-and-Play Framework for Private Knowledge Injection in Large Language Models
par: Li, Rongji, et autres
Publié: (2026)

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
par: Csordás, Róbert, et autres
Publié: (2023)

Harnessing the Plug-and-Play Controller by Prompting
par: Wang, Hao, et autres
Publié: (2024)

Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training
par: Bergsma, Shane, et autres
Publié: (2025)

DataMan: Data Manager for Pre-training Large Language Models
par: Peng, Ru, et autres
Publié: (2025)

Inside the Black Box: Detecting Data Leakage in Pre-trained Language Encoders
par: Xin, Yuan, et autres
Publié: (2024)

Prompt2Fingerprint: Plug-and-Play LLM Fingerprinting via Text-to-Weight Generation
par: Chen, Sixu, et autres
Publié: (2026)

Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models
par: Li, Miaoran, et autres
Publié: (2023)

Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models
par: Cao, Jiaqi, et autres
Publié: (2025)

Decoupled Alignment for Robust Plug-and-Play Adaptation
par: Luo, Haozheng, et autres
Publié: (2024)

Con-ReCall: Detecting Pre-training Data in LLMs via Contrastive Decoding
par: Wang, Cheng, et autres
Publié: (2024)

LLM-KT: Aligning Large Language Models with Knowledge Tracing using a Plug-and-Play Instruction
par: Wang, Ziwei, et autres
Publié: (2025)

Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models
par: Chen, Jiaxing, et autres
Publié: (2024)

Planning to Explore: Curiosity-Driven Planning for LLM Test Generation
par: Amayuelas, Alfonso, et autres
Publié: (2026)

DSAS: A Universal Plug-and-Play Framework for Attention Optimization in Multi-Document Question Answering
par: Li, Jiakai, et autres
Publié: (2025)

Enhancing LLM Language Adaption through Cross-lingual In-Context Pre-training
par: Wu, Linjuan, et autres
Publié: (2025)

Bridging the Fairness Gap: Enhancing Pre-trained Models with LLM-Generated Sentences
par: Yu, Liu, et autres
Publié: (2025)

Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data
par: Guo, Xu, et autres
Publié: (2026)

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization
par: Zhang, Haode, et autres
Publié: (2022)

PhysGym: Benchmarking LLMs in Interactive Physics Discovery with Controlled Priors
par: Chen, Yimeng, et autres
Publié: (2025)

Towards Extreme Pruning of LLMs with Plug-and-Play Mixed Sparsity
par: Xu, Chi, et autres
Publié: (2025)

DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check
par: Qiao, Ziheng, et autres
Publié: (2024)

Beyond Fixed Length: Bucket Pre-training is All You Need
par: Yang, Qing, et autres
Publié: (2024)

Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training
par: Yang, Kailai, et autres
Publié: (2025)

ProTransformer: Robustify Transformers via Plug-and-Play Paradigm
par: Hou, Zhichao, et autres
Publié: (2024)

MADLLM: Multivariate Anomaly Detection via Pre-trained LLMs
par: Tao, Wei, et autres
Publié: (2025)

Sparse Autoencoders as Plug-and-Play Firewalls for Adversarial Attack Detection in VLMs
par: Wang, Hao, et autres
Publié: (2026)

From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis
par: Cheng, Chuanqi, et autres
Publié: (2024)

OPUS: Towards Efficient and Principled Data Selection in Large Language Model Pre-training in Every Iteration
par: Wang, Shaobo, et autres
Publié: (2026)

Plug-and-Play LLM Knowledge Extraction for Robot Navigation: A Fine-Tuning-Free Edge Framework
par: Rojas-Ordoñez, Sebastian, et autres
Publié: (2026)