Cover Image

Label Words as Local Task Vectors in In-Context Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Bowen, Ma, Ming, Lin, Zhongqiao, Yang, Tianming
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SimLens for Early Exit in Large Language Models: Eliciting Accurate Latent Predictions with One More Token
by: Ma, Ming, et al.
Published: (2025)

Localizing Task Recognition and Task Learning in In-Context Learning via Attention Head Analysis
by: Yang, Haolin, et al.
Published: (2025)

Unifying Attention Heads and Task Vectors via Hidden State Geometry in In-Context Learning
by: Yang, Haolin, et al.
Published: (2025)

One Task Vector is not Enough: A Large-Scale Study for In-Context Learning
by: Tikhonov, Pavel, et al.
Published: (2025)

Distributional Alignment as a Criterion for Designing Task Vectors in In-Context Learning
by: Kwon, Jihoon, et al.
Published: (2026)

Using Images to Find Context-Independent Word Representations in Vector Space
by: Kumar, Harsh
Published: (2024)

In-Context Learning with Noisy Labels
by: Kang, Junyong, et al.
Published: (2024)

Combining Supervised Learning and Reinforcement Learning for Multi-Label Classification Tasks with Partial Labels
by: Jia, Zixia, et al.
Published: (2024)

Emergence and Effectiveness of Task Vectors in In-Context Learning: An Encoder Decoder Perspective
by: Han, Seungwook, et al.
Published: (2024)

QAQ: Bidirectional Semantic Coherence for Selecting High-Quality Synthetic Code Instructions
by: Lei, Jiayin, et al.
Published: (2026)

Task Vectors, Learned Not Extracted: Performance Gains and Mechanistic Insight
by: Yang, Haolin, et al.
Published: (2025)

Calibrate to Discriminate: Improve In-Context Learning with Label-Free Comparative Inference
by: Cheng, Wei, et al.
Published: (2024)

Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learning
by: Huang, Brandon, et al.
Published: (2024)

Probing Context Localization of Polysemous Words in Pre-trained Language Model Sub-Layers
by: Vijayakumar, Soniya, et al.
Published: (2024)

DeCoVec: Building Decoding Space based Task Vector for Large Language Models via In-Context Learning
by: Li, Feiyang, et al.
Published: (2026)

TAT-R1: Terminology-Aware Translation with Reinforcement Learning and Word Alignment
by: Li, Zheng, et al.
Published: (2025)

Funzac at CoMeDi Shared Task: Modeling Annotator Disagreement from Word-In-Context Perspectives
by: Sarumi, Olufunke O., et al.
Published: (2025)

From Transformer to Biology: A Hierarchical Model for Attention in Complex Problem-Solving
by: Lin, Zhongqiao, et al.
Published: (2024)

From Word Vectors to Multimodal Embeddings: Techniques, Applications, and Future Directions For Large Language Models
by: Zhang, Charles, et al.
Published: (2024)

BenTo: Benchmark Task Reduction with In-Context Transferability
by: Zhao, Hongyu, et al.
Published: (2024)

Learning Task Representations from In-Context Learning
by: Saglam, Baturay, et al.
Published: (2025)

Using Context to Improve Word Segmentation
by: Hu, Stephanie, et al.
Published: (2025)

Local and Global Contexts for Conversation
by: Lin, Zuoquan, et al.
Published: (2024)

Task-Oriented Dialogue with In-Context Learning
by: Bocklisch, Tom, et al.
Published: (2024)

Hierarchies over Vector Space: Orienting Word and Graph Embeddings
by: Guo, Xingzhi, et al.
Published: (2022)

BabyLM's First Words: Word Segmentation as a Phonological Probing Task
by: Goriely, Zébulon, et al.
Published: (2025)

A Global Context Mechanism for Sequence Labeling
by: Xu, Conglei, et al.
Published: (2023)

PivotAttack: Rethinking the Search Trajectory in Hard-Label Text Attacks via Pivot Words
by: Liang, Yuzhi, et al.
Published: (2026)

Data Augmentation with In-Context Learning and Comparative Evaluation in Math Word Problem Solving
by: Yigit, Gulsum, et al.
Published: (2024)

Rapid Word Learning Through Meta In-Context Learning
by: Wang, Wentao, et al.
Published: (2025)

PWESuite: Phonetic Word Embeddings and Tasks They Facilitate
by: Zouhar, Vilém, et al.
Published: (2023)

LIVE: Learnable In-Context Vector for Visual Question Answering
by: Peng, Yingzhe, et al.
Published: (2024)

Enhancing Input-Label Mapping in In-Context Learning with Contrastive Decoding
by: Peng, Keqin, et al.
Published: (2025)

BOW: Reinforcement Learning for Bottlenecked Next Word Prediction
by: Shen, Ming, et al.
Published: (2025)

In-Context Learning for Extreme Multi-Label Classification
by: D'Oosterlinck, Karel, et al.
Published: (2024)

Interpretable Syntactic Representations Enable Hierarchical Word Vectors
by: Silwal, Biraj
Published: (2024)

Task Vector Geometry Underlies Dual Modes of Task Inference in Transformers
by: Yan, Hao, et al.
Published: (2026)

In-Context Learning State Vector with Inner and Momentum Optimization
by: Li, Dongfang, et al.
Published: (2024)

Enhancing Metaphor Detection through Soft Labels and Target Word Prediction
by: Jia, Kaidi, et al.
Published: (2024)

Iterative Forward Tuning Boosts In-Context Learning in Language Models
by: Yang, Jiaxi, et al.
Published: (2023)