Cover Image

Task Prompt Vectors: Effective Initialization through Multi-Task Soft-Prompt Transfer

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Belanec, Robert, Ostermann, Simon, Srba, Ivan, Bielikova, Maria
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models
by: Belanec, Robert, et al.
Published: (2025)

PEFT-Bench: A Parameter-Efficient Fine-Tuning Methods Benchmark
by: Belanec, Robert, et al.
Published: (2025)

Soft Language Prompts for Language Transfer
by: Vykopal, Ivan, et al.
Published: (2024)

Fighting Randomness with Randomness: Mitigating Optimisation Instability of Fine-Tuning using Delayed Ensemble and Noisy Interpolation
by: Pecher, Branislav, et al.
Published: (2024)

Better as Generators Than Classifiers: Leveraging LLMs and Synthetic Data for Low-Resource Multilingual Classification
by: Pecher, Branislav, et al.
Published: (2026)

Bayesian Multi-Task Transfer Learning for Soft Prompt Tuning
by: Lee, Haeju, et al.
Published: (2024)

On Sensitivity of Learning with Limited Labelled Data to the Effects of Randomness: Impact of Interactions and Systematic Choices
by: Pecher, Branislav, et al.
Published: (2024)

Comparing Specialised Small and General Large Language Models on Text Classification: 100 Labelled Samples to Achieve Break-Even Performance
by: Pecher, Branislav, et al.
Published: (2024)

A Survey on Stability of Learning with Limited Labelled Data and its Sensitivity to the Effects of Randomness
by: Pecher, Branislav, et al.
Published: (2023)

Dynamic Task Vector Grouping for Efficient Multi-Task Prompt Tuning
by: Zhang, Pieyi, et al.
Published: (2025)

Revisiting Prompt Sensitivity in Large Language Models for Text Classification: The Role of Prompt Underspecification
by: Pecher, Branislav, et al.
Published: (2026)

CrossPT: Exploring Cross-Task Transferability through Multi-Task Prompt Tuning
by: Pouramini, Ahmad, et al.
Published: (2025)

Disinformation Capabilities of Large Language Models
by: Vykopal, Ivan, et al.
Published: (2023)

Automatic Combination of Sample Selection Strategies for Few-Shot Learning
by: Pecher, Branislav, et al.
Published: (2024)

Enhancing Few-Shot Transfer Learning with Optimized Multi-Task Prompt Tuning through Modular Prompt Composition
by: Pouramini, Ahmad, et al.
Published: (2024)

Soft Begging: Modular and Efficient Shielding of LLMs against Prompt Injection and Jailbreaking based on Prompt Tuning
by: Ostermann, Simon, et al.
Published: (2024)

SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval
by: Peng, Qiwei, et al.
Published: (2025)

Effects of diversity incentives on sample diversity and downstream model performance in LLM-based text augmentation
by: Cegin, Jan, et al.
Published: (2024)

Use Random Selection for Now: Investigation of Few-Shot Selection Strategies in LLM-based Text Augmentation for Classification
by: Cegin, Jan, et al.
Published: (2024)

PromptSuite: A Task-Agnostic Framework for Multi-Prompt Generation
by: Habba, Eliya, et al.
Published: (2025)

Can we Soft Prompt LLMs for Graph Learning Tasks?
by: Liu, Zheyuan, et al.
Published: (2024)

Cross-Prompt Encoder for Low-Performing Languages
by: Mikaberidze, Beso, et al.
Published: (2025)

Transfer-Prompting: Enhancing Cross-Task Adaptation in Large Language Models via Dual-Stage Prompts Optimization
by: Chang, Yupeng, et al.
Published: (2025)

MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphs
by: Yu, Xingtong, et al.
Published: (2023)

TemPrompt: Multi-Task Prompt Learning for Temporal Relation Extraction in RAG-based Crowdsourcing Systems
by: Yang, Jing, et al.
Published: (2024)

PromptWizard: Task-Aware Prompt Optimization Framework
by: Agarwal, Eshaan, et al.
Published: (2024)

Multilingual Previously Fact-Checked Claim Retrieval
by: Pikuliak, Matúš, et al.
Published: (2023)

TAPO: Task-Referenced Adaptation for Prompt Optimization
by: Luo, Wenxin, et al.
Published: (2025)

Reverse Probing: Evaluating Knowledge Transfer via Finetuned Task Embeddings for Coreference Resolution
by: Anikina, Tatiana, et al.
Published: (2025)

PromptEmbedder:: Efficient and Transferable Text Embedding via Dual-LLM Soft Prompting
by: Tsai, Yu-Che, et al.
Published: (2026)

Transferable Modeling Strategies for Low-Resource LLM Tasks: A Prompt and Alignment-Based Approach
by: Lyu, Shuangquan, et al.
Published: (2025)

Effectively Prompting Small-sized Language Models for Cross-lingual Tasks via Winning Tickets
by: Li, Mingqi, et al.
Published: (2024)

Exploring the Effectiveness and Consistency of Task Selection in Intermediate-Task Transfer Learning
by: Lin, Pin-Jie, et al.
Published: (2024)

Learning Optimal Prompt Ensemble for Multi-source Visual Prompt Transfer
by: Zhang, Enming, et al.
Published: (2025)

Improving Multi-turn Task Completion in Task-Oriented Dialog Systems via Prompt Chaining and Fine-Grained Feedback
by: Fereidouni, Moghis, et al.
Published: (2025)

Overview of the PromptCBLUE Shared Task in CHIP2023
by: Zhu, Wei, et al.
Published: (2023)

Zero-Shot Continuous Prompt Transfer: Generalizing Task Semantics Across Language Models
by: Wu, Zijun, et al.
Published: (2023)

Efficiently Aligned Cross-Lingual Transfer Learning for Conversational Tasks using Prompt-Tuning
by: Tu, Lifu, et al.
Published: (2023)

Efficient Knowledge Transfer in Multi-Task Learning through Task-Adaptive Low-Rank Representation
by: Zhang, Xiao, et al.
Published: (2025)

Dynamic Prompt Fusion for Multi-Task and Cross-Domain Adaptation in LLMs
by: Hu, Xin, et al.
Published: (2025)