Imagen de Portada

PDR: A Plug-and-Play Positional Decay Framework for LLM Pre-training Data Detection

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Jinhan, Yang, Yibo, Lu, Ruiying, Piekos, Piotr, Chen, Yimeng, Wang, Peng, Guo, Dandan
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
por: Xiao, Chaojun, et al.
Publicado: (2023)

Investigating Mask-aware Prototype Learning for Tabular Anomaly Detection
por: Lu, Ruiying, et al.
Publicado: (2025)

Mixture of Sparse Attention: Content-Based Learnable Sparse Attention via Expert-Choice Routing
por: Piękos, Piotr, et al.
Publicado: (2025)

Probing Language Models for Pre-training Data Detection
por: Liu, Zhenhua, et al.
Publicado: (2024)

AgentMonitor: A Plug-and-Play Framework for Predictive and Secure Multi-Agent Systems
por: Chan, Chi-Min, et al.
Publicado: (2024)

Plug-and-Play Training Framework for Preference Optimization
por: Ma, Jingyuan, et al.
Publicado: (2024)

PAS: Data-Efficient Plug-and-Play Prompt Augmentation System
por: Zheng, Miao, et al.
Publicado: (2024)

WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training
por: Tian, Changxin, et al.
Publicado: (2025)

Pre-training LLM without Learning Rate Decay Enhances Supervised Fine-Tuning
por: Yano, Kazuki, et al.
Publicado: (2026)

Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
por: Zhang, Zhenyu, et al.
Publicado: (2024)

Generation-Augmented Generation: A Plug-and-Play Framework for Private Knowledge Injection in Large Language Models
por: Li, Rongji, et al.
Publicado: (2026)

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
por: Csordás, Róbert, et al.
Publicado: (2023)

Harnessing the Plug-and-Play Controller by Prompting
por: Wang, Hao, et al.
Publicado: (2024)

Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training
por: Bergsma, Shane, et al.
Publicado: (2025)

DataMan: Data Manager for Pre-training Large Language Models
por: Peng, Ru, et al.
Publicado: (2025)

Inside the Black Box: Detecting Data Leakage in Pre-trained Language Encoders
por: Xin, Yuan, et al.
Publicado: (2024)

Prompt2Fingerprint: Plug-and-Play LLM Fingerprinting via Text-to-Weight Generation
por: Chen, Sixu, et al.
Publicado: (2026)

Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models
por: Li, Miaoran, et al.
Publicado: (2023)

Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models
por: Cao, Jiaqi, et al.
Publicado: (2025)

Decoupled Alignment for Robust Plug-and-Play Adaptation
por: Luo, Haozheng, et al.
Publicado: (2024)

Con-ReCall: Detecting Pre-training Data in LLMs via Contrastive Decoding
por: Wang, Cheng, et al.
Publicado: (2024)

LLM-KT: Aligning Large Language Models with Knowledge Tracing using a Plug-and-Play Instruction
por: Wang, Ziwei, et al.
Publicado: (2025)

Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models
por: Chen, Jiaxing, et al.
Publicado: (2024)

Planning to Explore: Curiosity-Driven Planning for LLM Test Generation
por: Amayuelas, Alfonso, et al.
Publicado: (2026)

DSAS: A Universal Plug-and-Play Framework for Attention Optimization in Multi-Document Question Answering
por: Li, Jiakai, et al.
Publicado: (2025)

Enhancing LLM Language Adaption through Cross-lingual In-Context Pre-training
por: Wu, Linjuan, et al.
Publicado: (2025)

Bridging the Fairness Gap: Enhancing Pre-trained Models with LLM-Generated Sentences
por: Yu, Liu, et al.
Publicado: (2025)

Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data
por: Guo, Xu, et al.
Publicado: (2026)

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization
por: Zhang, Haode, et al.
Publicado: (2022)

PhysGym: Benchmarking LLMs in Interactive Physics Discovery with Controlled Priors
por: Chen, Yimeng, et al.
Publicado: (2025)

Towards Extreme Pruning of LLMs with Plug-and-Play Mixed Sparsity
por: Xu, Chi, et al.
Publicado: (2025)

DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check
por: Qiao, Ziheng, et al.
Publicado: (2024)

Beyond Fixed Length: Bucket Pre-training is All You Need
por: Yang, Qing, et al.
Publicado: (2024)

Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training
por: Yang, Kailai, et al.
Publicado: (2025)

ProTransformer: Robustify Transformers via Plug-and-Play Paradigm
por: Hou, Zhichao, et al.
Publicado: (2024)

MADLLM: Multivariate Anomaly Detection via Pre-trained LLMs
por: Tao, Wei, et al.
Publicado: (2025)

Sparse Autoencoders as Plug-and-Play Firewalls for Adversarial Attack Detection in VLMs
por: Wang, Hao, et al.
Publicado: (2026)

From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis
por: Cheng, Chuanqi, et al.
Publicado: (2024)

OPUS: Towards Efficient and Principled Data Selection in Large Language Model Pre-training in Every Iteration
por: Wang, Shaobo, et al.
Publicado: (2026)

Plug-and-Play LLM Knowledge Extraction for Robot Navigation: A Fine-Tuning-Free Edge Framework
por: Rojas-Ordoñez, Sebastian, et al.
Publicado: (2026)