Cover Image

Dynamic Task Vector Grouping for Efficient Multi-Task Prompt Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Pieyi, Zhang, Richong, Nie, Zhijie
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CoRect: Context-Aware Logit Contrast for Hidden State Rectification to Resolve Knowledge Conflicts
by: Ma, Xuhua, et al.
Published: (2026)

General Table Question Answering via Answer-Formula Joint Generation
by: Wang, Zhongyuan, et al.
Published: (2025)

Code-Style In-Context Learning for Knowledge-Based Question Answering
by: Nie, Zhijie, et al.
Published: (2023)

EasyRAG: Efficient Retrieval-Augmented Generation Framework for Automated Network Operations
by: Feng, Zhangchi, et al.
Published: (2024)

CrossPT: Exploring Cross-Task Transferability through Multi-Task Prompt Tuning
by: Pouramini, Ahmad, et al.
Published: (2025)

Multi-domain Knowledge Graph Collaborative Pre-training and Prompt Tuning for Diverse Downstream Tasks
by: Zhang, Yichi, et al.
Published: (2024)

Automatic Prompt Engineering with No Task Cues and No Tuning
by: Chowdhury, Faisal, et al.
Published: (2026)

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models
by: Zheng, Yaowei, et al.
Published: (2024)

Efficiently Aligned Cross-Lingual Transfer Learning for Conversational Tasks using Prompt-Tuning
by: Tu, Lifu, et al.
Published: (2023)

When Text Embedding Meets Large Language Model: A Comprehensive Survey
by: Nie, Zhijie, et al.
Published: (2024)

AnyTaskTune: Advanced Domain-Specific Solutions through Task-Fine-Tuning
by: Cui, Jiaxi, et al.
Published: (2024)

Enhancing Few-Shot Transfer Learning with Optimized Multi-Task Prompt Tuning through Modular Prompt Composition
by: Pouramini, Ahmad, et al.
Published: (2024)

Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives
by: Feng, Zhangchi, et al.
Published: (2024)

Pseudocode-Injection Magic: Enabling LLMs to Tackle Graph Computational Tasks
by: Gong, Chang, et al.
Published: (2025)

Identifying Task Groupings for Multi-Task Learning Using Pointwise V-Usable Information
by: Li, Yingya, et al.
Published: (2024)

Decomposing the Basic Abilities of Large Language Models: Mitigating Cross-Task Interference in Multi-Task Instruct-Tuning
by: Wang, Bing, et al.
Published: (2026)

Beyond Elicitation: Provision-based Prompt Optimization for Knowledge-Intensive Tasks
by: Xu, Yunzhe, et al.
Published: (2025)

PEML: Parameter-efficient Multi-Task Learning with Optimized Continuous Prompts
by: Chowdhury, Anjir Ahmed, et al.
Published: (2026)

TransLLM: A Unified Multi-Task Foundation Framework for Urban Transportation via Learnable Prompting
by: Leng, Jiaming, et al.
Published: (2025)

Improving General Text Embedding Model: Tackling Task Conflict and Data Imbalance through Model Merging
by: Li, Mingxin, et al.
Published: (2024)

Efficient Prompt Tuning by Multi-Space Projection and Prompt Fusion
by: Lan, Pengxiang, et al.
Published: (2024)

Towards Better Understanding of Contrastive Sentence Representation Learning: A Unified Paradigm for Gradient
by: Li, Mingxin, et al.
Published: (2024)

Donors and Recipients: On Asymmetric Transfer Across Tasks and Languages with Parameter-Efficient Fine-Tuning
by: Dymkiewicz, Kajetan, et al.
Published: (2025)

Learning to Select: Query-Aware Adaptive Dimension Selection for Dense Retrieval
by: Wu, Zhanyu, et al.
Published: (2026)

Provable Benefits of Task-Specific Prompts for In-context Learning
by: Chang, Xiangyu, et al.
Published: (2025)

Task as Context Prompting for Accurate Medical Symptom Coding Using Large Language Models
by: He, Chengyang, et al.
Published: (2025)

Low-Resource Fine-Tuning for Multi-Task Structured Information Extraction with a Billion-Parameter Instruction-Tuned Model
by: Chih, Yu Cheng, et al.
Published: (2025)

AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization
by: Gu, Haoran, et al.
Published: (2026)

Improving Task Diversity in Label Efficient Supervised Finetuning of LLMs
by: Arabelly, Abhinav, et al.
Published: (2025)

UtilityMax Prompting: A Formal Framework for Multi-Objective Large Language Model Tasks
by: Marom, Ofir
Published: (2026)

Intent-conditioned and Non-toxic Counterspeech Generation using Multi-Task Instruction Tuning with RLAIF
by: Hengle, Amey, et al.
Published: (2024)

Distributional Alignment as a Criterion for Designing Task Vectors in In-Context Learning
by: Kwon, Jihoon, et al.
Published: (2026)

Bias Vector: Mitigating Biases in Language Models with Task Arithmetic Approach
by: Shirafuji, Daiki, et al.
Published: (2024)

TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data
by: Zhang, Jipeng, et al.
Published: (2024)

Strategic Prompting for Conversational Tasks: A Comparative Analysis of Large Language Models Across Diverse Conversational Tasks
by: Joshi, Ratnesh Kumar, et al.
Published: (2024)

A Text is Worth Several Tokens: Text Embedding from LLMs Secretly Aligns Well with The Key Tokens
by: Nie, Zhijie, et al.
Published: (2024)

PromptWizard: Task-Aware Prompt Optimization Framework
by: Agarwal, Eshaan, et al.
Published: (2024)

Efficient Estimation of Kernel Surrogate Models for Task Attribution
by: Zhang, Zhenshuo, et al.
Published: (2026)

InfiMed-Foundation: Pioneering Advanced Multimodal Medical Models with Compute-Efficient Pre-Training and Multi-Stage Fine-Tuning
by: Zhu, Guanghao, et al.
Published: (2025)

Efficient and Effective Prompt Tuning via Prompt Decomposition and Compressed Outer Product
by: Lan, Pengxiang, et al.
Published: (2025)