Imagen de Portada

LoRS: Efficient Low-Rank Adaptation for Sparse Large Language Model

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hu, Yuxuan, Zhang, Jing, Chen, Xiaodong, Zhao, Zhe, Li, Cuiping, Chen, Hong
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language I.2.7
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Streamlining Redundant Layers to Compress Large Language Models
por: Chen, Xiaodong, et al.
Publicado: (2024)

QUAD: Quantization and Parameter-Efficient Tuning of LLM with Activation Decomposition
por: Hu, Yuxuan, et al.
Publicado: (2025)

$\rm SP^3$: Enhancing Structured Pruning via PCA Projection
por: Hu, Yuxuan, et al.
Publicado: (2023)

SECURA: Sigmoid-Enhanced CUR Decomposition with Uninterrupted Retention and Low-Rank Adaptation in Large Language Models
por: Zhang, Yuxuan
Publicado: (2025)

SAM Decoding: Speculative Decoding via Suffix Automaton
por: Hu, Yuxuan, et al.
Publicado: (2024)

AsyncTLS: Efficient Generative LLM Inference with Asynchronous Two-level Sparse Attention
por: Hu, Yuxuan, et al.
Publicado: (2026)

CRISP: Persistent Concept Unlearning via Sparse Autoencoders
por: Ashuach, Tomer, et al.
Publicado: (2025)

ConPET: Continual Parameter-Efficient Tuning for Large Language Models
por: Song, Chenyang, et al.
Publicado: (2023)

Strategy Adaptation in Large Language Model Werewolf Agents
por: Nakamori, Fuya, et al.
Publicado: (2025)

LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using Uncertainty
por: Zhang, Zhen, et al.
Publicado: (2024)

Text-Based Approaches to Item Difficulty Modeling in Large-Scale Assessments: A Systematic Review
por: Peters, Sydney, et al.
Publicado: (2025)

After Retrieval, Before Generation: Enhancing the Trustworthiness of Large Language Models in Retrieval-Augmented Generation
por: Dai, Xinbang, et al.
Publicado: (2025)

Quantization-Robust LLM Unlearning via Low-Rank Adaptation
por: Abitante, João Vitor Boer, et al.
Publicado: (2026)

MALoRA: Mixture of Asymmetric Low-Rank Adaptation for Enhanced Multi-Task Learning
por: Wang, Xujia, et al.
Publicado: (2024)

LLM-Ref: Enhancing Reference Handling in Technical Writing with Large Language Models
por: Fuad, Kazi Ahmed Asif, et al.
Publicado: (2024)

Towards Effective and Efficient Continual Pre-training of Large Language Models
por: Chen, Jie, et al.
Publicado: (2024)

Sparsing Law: Towards Large Language Models with Greater Activation Sparsity
por: Luo, Yuqi, et al.
Publicado: (2024)

RUQuant: Towards Refining Uniform Quantization for Large Language Models
por: Liu, Han, et al.
Publicado: (2026)

Effective and Efficient Schema-aware Information Extraction Using On-Device Large Language Models
por: Wen, Zhihao, et al.
Publicado: (2025)

PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing
por: Deng, Cheng, et al.
Publicado: (2025)

Towards Greater Leverage: Scaling Laws for Efficient Mixture-of-Experts Language Models
por: Tian, Changxin, et al.
Publicado: (2025)

SpectralLoRA: Is Low-Frequency Structure Sufficient for LoRA Adaptation? A Spectral Analysis of Weight Updates
por: Singh, Rajveer
Publicado: (2026)

REVS: Unlearning Sensitive Information in Language Models via Rank Editing in the Vocabulary Space
por: Ashuach, Tomer, et al.
Publicado: (2024)

Aligning Large Language Models for Faithful Integrity Against Opposing Argument
por: Zhao, Yong, et al.
Publicado: (2025)

Beyond Token Length: Step Pruner for Efficient and Accurate Reasoning in Large Language Models
por: Wu, Canhui, et al.
Publicado: (2025)

MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning
por: Ren, Pengjie, et al.
Publicado: (2024)

A Multi-Pass Large Language Model Framework for Precise and Efficient Radiology Report Error Detection
por: Kim, Songsoo, et al.
Publicado: (2025)

SEPTQ: A Simple and Effective Post-Training Quantization Paradigm for Large Language Models
por: Liu, Han, et al.
Publicado: (2026)

Memory Bank Compression for Continual Adaptation of Large Language Models
por: Katraouras, Thomas, et al.
Publicado: (2026)

Credit C-GPT: A Domain-Specialized Large Language Model for Conversational Understanding in Vietnamese Debt Collection
por: Hong, Nhung Nguyen Thi, et al.
Publicado: (2026)

Efficient Reasoning via Thought-Training and Thought-Free Inference
por: Wu, Canhui, et al.
Publicado: (2025)

Precise Length Control in Large Language Models
por: Butcher, Bradley, et al.
Publicado: (2024)

Large Language Models for Biomedical Article Classification
por: Proboszcz, Jakub, et al.
Publicado: (2026)

MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models
por: Xu, Jingwei, et al.
Publicado: (2024)

Towards Fundamental Language Models: Does Linguistic Competence Scale with Model Size?
por: Collado-Montañez, Jaime, et al.
Publicado: (2025)

Socially Responsible Data for Large Multilingual Language Models
por: Smart, Andrew, et al.
Publicado: (2024)

Multi-Method Validation of Large Language Model Medical Translation Across High- and Low-Resource Languages
por: Anyaegbuna, Chukwuebuka, et al.
Publicado: (2026)

Lacuna Language Learning: Leveraging RNNs for Ranked Text Completion in Digitized Coptic Manuscripts
por: Levine, Lauren, et al.
Publicado: (2024)

SITA: Learning Speaker-Invariant and Tone-Aware Speech Representations for Low-Resource Tonal Languages
por: Xu, Tianyi, et al.
Publicado: (2026)

Large Language Models for Persian $ \leftrightarrow $ English Idiom Translation
por: Rezaeimanesh, Sara, et al.
Publicado: (2024)