Cover Image

TASO: Task-Aligned Sparse Optimization for Parameter-Efficient Model Adaptation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Miao, Daiye, Liu, Yufang, Wang, Jie, Sun, Changzhi, Zhang, Yunke, Yan, Demei, Dong, Shaokang, Zhang, Qi, Wu, Yuanbin
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generation with Dynamic Vocabulary
by: Liu, Yanting, et al.
Published: (2024)

Stabilizing LLM Supervised Fine-Tuning via Explicit Distributional Control
by: Wang, Xinyu, et al.
Published: (2026)

Logic-Regularized Verifier Elicits Reasoning from LLMs
by: Wang, Xinyu, et al.
Published: (2026)

Distribution-Aligned Decoding for Efficient LLM Task Adaptation
by: Hu, Senkang, et al.
Published: (2025)

CERD: A Comprehensive Chinese Rhetoric Dataset for Rhetorical Understanding and Generation in Essays
by: Liu, Nuowei, et al.
Published: (2024)

Investigating and Mitigating Object Hallucinations in Pretrained Vision-Language (CLIP) Models
by: Liu, Yufang, et al.
Published: (2024)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
by: Zhang, Haojie
Published: (2025)

Efficient Task Adaptation in Large Language Models via Selective Parameter Optimization
by: Wan, Weijie, et al.
Published: (2026)

TokAlign: Efficient Vocabulary Adaptation via Token Alignment
by: Li, Chong, et al.
Published: (2025)

Expert Pyramid Tuning: Efficient Parameter Fine-Tuning for Expertise-Driven Task Allocation
by: Zhang, Jia-Chen, et al.
Published: (2026)

Parameter-Efficient Conversational Recommender System as a Language Processing Task
by: Ravaut, Mathieu, et al.
Published: (2024)

On Support Samples of Next Word Prediction
by: Li, Yuqian, et al.
Published: (2025)

NeuroLoRA: Context-Aware Neuromodulation for Parameter-Efficient Multi-Task Adaptation
by: Yang, Yuxin, et al.
Published: (2026)

Length Generalization of Causal Transformers without Position Encoding
by: Wang, Jie, et al.
Published: (2024)

TaxoAlign: Scholarly Taxonomy Generation Using Language Models
by: Lahiri, Avishek, et al.
Published: (2025)

Sparse Tokens Suffice: Jailbreaking Audio Language Models via Token-Aware Gradient Optimization
by: Fang, Zheng, et al.
Published: (2026)

PEML: Parameter-efficient Multi-Task Learning with Optimized Continuous Prompts
by: Chowdhury, Anjir Ahmed, et al.
Published: (2026)

The CoNLL-2013 Shared Task on Grammatical Error Correction
by: Ng, Hwee Tou, et al.
Published: (2025)

Beyond Heuristics: A Decision-Theoretic Framework for Agent Memory Management
by: Sun, Changzhi, et al.
Published: (2025)

SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space
by: Shen, Zhenyi, et al.
Published: (2025)

SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning
by: Wen, Zhihao, et al.
Published: (2024)

TAPO: Task-Referenced Adaptation for Prompt Optimization
by: Luo, Wenxin, et al.
Published: (2025)

What Makes a Good Speech Tokenizer for LLM-Centric Speech Generation? A Systematic Study
by: Fan, Xiaoran, et al.
Published: (2025)

From Parameters to Data: A Task-Parameter-Guided Fine-Tuning Pipeline for Efficient LLM Alignment
by: Chen, Hao, et al.
Published: (2026)

UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter-Efficient Fine-Tuning of Large Models
by: Zhang, Xueyan, et al.
Published: (2025)

Efficient Stitchable Task Adaptation
by: He, Haoyu, et al.
Published: (2023)

AlignEvoSkill: Towards Knowledge-Aware and Task-Aligned Agent Skill Evolution
by: Wang, Dingzirui, et al.
Published: (2025)

StepPO: Step-Aligned Policy Optimization for Agentic Reinforcement Learning
by: Wang, Daoyu, et al.
Published: (2026)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
by: Lin, Weicheng, et al.
Published: (2026)

PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers
by: Zhong, Yibo, et al.
Published: (2024)

Sparsity May Be All You Need: Sparse Random Parameter Adaptation
by: Rios, Jesus, et al.
Published: (2025)

SparseEval: Efficient Evaluation of Large Language Models by Sparse Optimization
by: Zhang, Taolin, et al.
Published: (2026)

Aligning Multimodal Sequential Recommendations via Robust Direct Preference Optimization with Sparse MoE
by: Huang, Hejin, et al.
Published: (2026)

Systematic Task Exploration with LLMs: A Study in Citation Text Generation
by: Şahinuç, Furkan, et al.
Published: (2024)

TokAlign++: Advancing Vocabulary Adaptation via Better Token Alignment
by: Li, Chong, et al.
Published: (2026)

Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic
by: He, Yifei, et al.
Published: (2024)

AlignSAE: Concept-Aligned Sparse Autoencoders
by: Yang, Minglai, et al.
Published: (2025)

KnowMap: Efficient Knowledge-Driven Task Adaptation for LLMs
by: Fu, Kelin, et al.
Published: (2025)

Targeted Efficient Fine-tuning: Optimizing Parameter Updates with Data-Driven Sample Selection
by: Dong, Ming, et al.
Published: (2024)

Safety Alignment in NLP Tasks: Weakly Aligned Summarization as an In-Context Attack
by: Fu, Yu, et al.
Published: (2023)