Imagen de Portada

AdapterSwap: Continuous Training of LLMs with Data Removal and Access-Control Guarantees

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Fleshman, William, Khan, Aleem, Marone, Marc, Van Durme, Benjamin
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

SEQR: Secure and Efficient QR-based LoRA Routing
por: Fleshman, William, et al.
Publicado: (2025)

LoRA-Augmented Generation (LAG) for Knowledge-Intensive Language Tasks
por: Fleshman, William, et al.
Publicado: (2025)

RE-Adapt: Reverse Engineered Adaptation of Large Language Models
por: Fleshman, William, et al.
Publicado: (2024)

SpectR: Dynamically Composing LM Experts with Spectral Routing
por: Fleshman, William, et al.
Publicado: (2025)

RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation
por: Fleshman, William, et al.
Publicado: (2024)

mmBERT: A Modern Multilingual Encoder with Annealed Language Learning
por: Marone, Marc, et al.
Publicado: (2025)

"According to ...": Prompting Language Models Improves Quoting from Pre-Training Data
por: Weller, Orion, et al.
Publicado: (2023)

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
por: Chen, Tong, et al.
Publicado: (2024)

LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
por: Wang, Boshi, et al.
Publicado: (2024)

SELF-[IN]CORRECT: LLMs Struggle with Discriminating Self-Generated Responses
por: Jiang, Dongwei, et al.
Publicado: (2024)

Always Tell Me The Odds: Fine-grained Conditional Probability Estimation
por: Wang, Liaoyaqi, et al.
Publicado: (2025)

Do Androids Know They're Only Dreaming of Electric Sheep?
por: CH-Wang, Sky, et al.
Publicado: (2023)

Sample-Efficient Online Learning in LM Agents via Hindsight Trajectory Rewriting
por: Hu, Michael Y., et al.
Publicado: (2025)

How to Train Data-Efficient LLMs
por: Sachdeva, Noveen, et al.
Publicado: (2024)

MICE for CATs: Model-Internal Confidence Estimation for Calibrating Agents with Tools
por: Subramani, Nishant, et al.
Publicado: (2025)

Continuous Approximations for Improving Quantization Aware Training of LLMs
por: Li, He, et al.
Publicado: (2024)

Training-Free Bayesianization for Low-Rank Adapters of Large Language Models
por: Shi, Haizhou, et al.
Publicado: (2024)

Learning to Route for Dynamic Adapter Composition in Continual Learning with Language Models
por: Araujo, Vladimir, et al.
Publicado: (2024)

Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Models
por: Bandarkar, Lucas, et al.
Publicado: (2024)

JumpLoRA: Sparse Adapters for Continual Learning in Large Language Models
por: Dragomir, Alexandra, et al.
Publicado: (2026)

K-Merge: Online Continual Merging of Adapters for On-device Large Language Models
por: Shenaj, Donald, et al.
Publicado: (2025)

CuMA: Aligning LLMs with Sparse Cultural Values via Demographic-Aware Mixture of Adapters
por: Sun, Ao, et al.
Publicado: (2026)

Data-driven Clustering and Merging of Adapters for On-device Large Language Models
por: Bohdal, Ondrej, et al.
Publicado: (2026)

Learning Self-Interpretation from Interpretability Artifacts: Training Lightweight Adapters on Vector-Label Pairs
por: Pepper, Keenan, et al.
Publicado: (2026)

AutoScale: Scale-Aware Data Mixing for Pre-Training LLMs
por: Kang, Feiyang, et al.
Publicado: (2024)

Seq vs Seq: An Open Suite of Paired Encoders and Decoders
por: Weller, Orion, et al.
Publicado: (2025)

Not All Adapters Matter: Selective Adapter Freezing for Memory-Efficient Fine-Tuning of Language Models
por: Son, Hyegang, et al.
Publicado: (2024)

Predicting Training Re-evaluation Curves Enables Effective Data Curriculums for LLMs
por: Bergsma, Shane, et al.
Publicado: (2025)

Efficient Exploration for LLMs
por: Dwaracherla, Vikranth, et al.
Publicado: (2024)

KV-Distill: Nearly Lossless Learnable Context Compression for LLMs
por: Chari, Vivek, et al.
Publicado: (2025)

Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters
por: Wang, Xinjue, et al.
Publicado: (2026)

Ensembles of Low-Rank Expert Adapters
por: Li, Yinghao, et al.
Publicado: (2025)

MoKA: Mixture of Kronecker Adapters
por: Sadeghi, Mohammadreza, et al.
Publicado: (2025)

Random Initialization of Gated Sparse Adapters
por: Retault, Vi, et al.
Publicado: (2025)

PII-Scope: A Comprehensive Study on Training Data PII Extraction Attacks in LLMs
por: Nakka, Krishna Kanth, et al.
Publicado: (2024)

Connecting the Dots: LLMs can Infer and Verbalize Latent Structure from Disparate Training Data
por: Treutlein, Johannes, et al.
Publicado: (2024)

Dual-Personalizing Adapter for Federated Foundation Models
por: Yang, Yiyuan, et al.
Publicado: (2024)

Learning Adapter Rank via Symmetry Breaking
por: Doyle, Cooper, et al.
Publicado: (2025)

Neutral Residues: Revisiting Adapters for Model Extension
por: Talla, Franck Signe, et al.
Publicado: (2024)

Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models
por: Abbes, Istabrak, et al.
Publicado: (2025)