Imagen de Portada

Neutral Residues: Revisiting Adapters for Model Extension

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Talla, Franck Signe, Grave, Edouard, Jégou, Hervé
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Understanding Data Temporality Impact on Large Language Models Pre-training
por: Pilchen, Hippolyte, et al.
Publicado: (2026)

Moshi: a speech-text foundation model for real-time dialogue
por: Défossez, Alexandre, et al.
Publicado: (2024)

KVzap: Fast, Adaptive, and Faithful KV Cache Pruning
por: Jegou, Simon, et al.
Publicado: (2026)

Time Sensitive Knowledge Editing through Efficient Finetuning
por: Ge, Xiou, et al.
Publicado: (2024)

Not All Adapters Matter: Selective Adapter Freezing for Memory-Efficient Fine-Tuning of Language Models
por: Son, Hyegang, et al.
Publicado: (2024)

Dual-Personalizing Adapter for Federated Foundation Models
por: Yang, Yiyuan, et al.
Publicado: (2024)

ABBA-Adapters: Efficient and Expressive Fine-Tuning of Foundation Models
por: Singhal, Raghav, et al.
Publicado: (2025)

Multiple Choice Learning of Low-Rank Adapters for Language Modeling
por: Letzelter, Victor, et al.
Publicado: (2025)

Training-Free Bayesianization for Low-Rank Adapters of Large Language Models
por: Shi, Haizhou, et al.
Publicado: (2024)

BBox-Adapter: Lightweight Adapting for Black-Box Large Language Models
por: Sun, Haotian, et al.
Publicado: (2024)

Learning to Route for Dynamic Adapter Composition in Continual Learning with Language Models
por: Araujo, Vladimir, et al.
Publicado: (2024)

Data-driven Clustering and Merging of Adapters for On-device Large Language Models
por: Bohdal, Ondrej, et al.
Publicado: (2026)

Ensembles of Low-Rank Expert Adapters
por: Li, Yinghao, et al.
Publicado: (2025)

MoKA: Mixture of Kronecker Adapters
por: Sadeghi, Mohammadreza, et al.
Publicado: (2025)

Random Initialization of Gated Sparse Adapters
por: Retault, Vi, et al.
Publicado: (2025)

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
por: Chen, Tong, et al.
Publicado: (2024)

JumpLoRA: Sparse Adapters for Continual Learning in Large Language Models
por: Dragomir, Alexandra, et al.
Publicado: (2026)

K-Merge: Online Continual Merging of Adapters for On-device Large Language Models
por: Shenaj, Donald, et al.
Publicado: (2025)

Winning Amazon KDD Cup'24
por: Deotte, Chris, et al.
Publicado: (2024)

Learning Adapter Rank via Symmetry Breaking
por: Doyle, Cooper, et al.
Publicado: (2025)

Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completion
por: Liu, Ben, et al.
Publicado: (2024)

Reading with Intent -- Neutralizing Intent
por: Reichman, Benjamin, et al.
Publicado: (2025)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
por: Wang, Zhengbo, et al.
Publicado: (2024)

Shears: Unstructured Sparsity with Neural Low-rank Adapter Search
por: Muñoz, J. Pablo, et al.
Publicado: (2024)

MedualTime: A Dual-Adapter Language Model for Medical Time Series-Text Multimodal Learning
por: Ye, Jiexia, et al.
Publicado: (2024)

Rethinking Adapter Placement: A Dominant Adaptation Module Perspective
por: Zhang, Suoxin, et al.
Publicado: (2026)

Revisiting the Shape Convention of Transformer Language Models
por: Liao, Feng-Ting, et al.
Publicado: (2026)

Low-Rank Adapters Meet Neural Architecture Search for LLM Compression
por: Muñoz, J. Pablo, et al.
Publicado: (2025)

zFLoRA: Zero-Latency Fused Low-Rank Adapters
por: Gowda, Dhananjaya, et al.
Publicado: (2025)

ARC-Encoder: learning compressed text representations for large language models
por: Pilchen, Hippolyte, et al.
Publicado: (2025)

AdapterSwap: Continuous Training of LLMs with Data Removal and Access-Control Guarantees
por: Fleshman, William, et al.
Publicado: (2024)

OrchMoE: Efficient Multi-Adapter Learning with Task-Skill Synergy
por: Wang, Haowen, et al.
Publicado: (2024)

Disentangled Safety Adapters Enable Efficient Guardrails and Flexible Inference-Time Alignment
por: Krishna, Kundan, et al.
Publicado: (2025)

YaRN: Efficient Context Window Extension of Large Language Models
por: Peng, Bowen, et al.
Publicado: (2023)

Revisiting Character-level Adversarial Attacks for Language Models
por: Rocamora, Elias Abad, et al.
Publicado: (2024)

Revisiting In-Context Learning with Long Context Language Models
por: Baek, Jinheon, et al.
Publicado: (2024)

Revisiting Uncertainty Estimation and Calibration of Large Language Models
por: Tao, Linwei, et al.
Publicado: (2025)

Revisiting Entropy in Reinforcement Learning for Large Reasoning Models
por: Jin, Renren, et al.
Publicado: (2025)

Revisiting Multilingual Data Mixtures in Language Model Pretraining
por: Foroutan, Negar, et al.
Publicado: (2025)

Task-Aware LoRA Adapter Composition via Similarity Retrieval in Vector Databases
por: Adsul, Riya, et al.
Publicado: (2026)