Cover Image

Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pan, Dayan, Fu, Zhaoyang, Wang, Jingyuan, Han, Xiao, Zhu, Yue, Zhao, Xiangyu
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RoSA: Enhancing Parameter-Efficient Fine-Tuning via RoPE-aware Selective Adaptation in Large Language Models
by: Pan, Dayan, et al.
Published: (2025)

Efficient Task Adaptation in Large Language Models via Selective Parameter Optimization
by: Wan, Weijie, et al.
Published: (2026)

Sliding Window Attention Training for Efficient Large Language Models
by: Fu, Zichuan, et al.
Published: (2025)

ALPS: Attention Localization and Pruning Strategy for Efficient Alignment of Large Language Models
by: Chen, Hao, et al.
Published: (2025)

Attention Basin: Why Contextual Position Matters in Large Language Models
by: Yi, Zihao, et al.
Published: (2025)

Efficient Streaming Language Models with Attention Sinks
by: Xiao, Guangxuan, et al.
Published: (2023)

Efficient Attention Mechanisms for Large Language Models: A Survey
by: Sun, Yutao, et al.
Published: (2025)

METER: Evaluating Multi-Level Contextual Causal Reasoning in Large Language Models
by: Li, Pengfeng, et al.
Published: (2026)

CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoor
by: Xu, Zhenhua, et al.
Published: (2025)

CAT: Causal Attention Tuning For Injecting Fine-grained Causal Knowledge into Large Language Models
by: Han, Kairong, et al.
Published: (2025)

From AR to Diffusion: Efficiently Adapting Large Language Models with Strictly Causal and Elastic Horizons
by: Ma, Xiangyu, et al.
Published: (2026)

Teaching Large Language Models to Maintain Contextual Faithfulness via Synthetic Tasks and Reinforcement Learning
by: Si, Shuzheng, et al.
Published: (2025)

TeamLLM: A Human-Like Team-Oriented Collaboration Framework for Multi-Step Contextualized Tasks
by: Wang, Xiangyu, et al.
Published: (2026)

PrivacyMind: Large Language Models Can Be Contextual Privacy Protection Learners
by: Xiao, Yijia, et al.
Published: (2023)

When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
by: You, Haoran, et al.
Published: (2024)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
by: Lin, Weicheng, et al.
Published: (2026)

Dynamic Topic Evolution with Temporal Decay and Attention in Large Language Models
by: Wu, Di, et al.
Published: (2025)

MedAdapter: Efficient Test-Time Adaptation of Large Language Models towards Medical Reasoning
by: Shi, Wenqi, et al.
Published: (2024)

Semantic Layered Embedding Diffusion in Large Language Models for Multi-Contextual Consistency
by: Kabakum, Irin, et al.
Published: (2025)

Improving Contextual ASR via Multi-grained Fusion with Large Language Models
by: Zhou, Shilin, et al.
Published: (2025)

Enhancing Contextual Understanding in Large Language Models through Contrastive Decoding
by: Zhao, Zheng, et al.
Published: (2024)

TsqLoRA: Towards Sensitivity and Quality Low-Rank Adaptation for Efficient Fine-Tuning
by: Chen, Yu, et al.
Published: (2025)

LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?
by: Wang, Jingyuan, et al.
Published: (2025)

AdapTime: Enabling Adaptive Temporal Reasoning in Large Language Models
by: Deng, Yimin, et al.
Published: (2026)

Distribution-Aligned Decoding for Efficient LLM Task Adaptation
by: Hu, Senkang, et al.
Published: (2025)

HonestLLM: Toward an Honest and Helpful Large Language Model
by: Gao, Chujie, et al.
Published: (2024)

Data Efficient Adaptation in Large Language Models via Continuous Low-Rank Fine-Tuning
by: Han, Xiao, et al.
Published: (2025)

Intersectional Bias in Japanese Large Language Models from a Contextualized Perspective
by: Yanaka, Hitomi, et al.
Published: (2025)

Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Tasks
by: Luo, Ling, et al.
Published: (2023)

Driving Everywhere with Large Language Model Policy Adaptation
by: Li, Boyi, et al.
Published: (2024)

MTMCS-Bench: Evaluating Contextual Safety of Multimodal Large Language Models in Multi-Turn Dialogues
by: Liu, Zheyuan, et al.
Published: (2026)

StreamAdapter: Efficient Test Time Adaptation from Contextual Streams
by: Muhtar, Dilxat, et al.
Published: (2024)

Towards a Benchmark for Large Language Models for Business Process Management Tasks
by: Busch, Kiran, et al.
Published: (2024)

Towards Atoms of Large Language Models
by: Hu, Chenhui, et al.
Published: (2025)

A Comparative Study of Task Adaptation Techniques of Large Language Models for Identifying Sustainable Development Goals
by: Cadeddu, Andrea, et al.
Published: (2025)

Contextual Augmentation for Entity Linking using Large Language Models
by: Vollmers, Daniel, et al.
Published: (2025)

Contextual Reinforcement in Multimodal Token Compression for Large Language Models
by: Piero, Naderdel, et al.
Published: (2025)

LoRASuite: Efficient LoRA Adaptation Across Large Language Model Upgrades
by: Li, Yanan, et al.
Published: (2025)

TimeSense:Making Large Language Models Proficient in Time-Series Analysis
by: Zhang, Zhirui, et al.
Published: (2025)

Eliciting Causal Abilities in Large Language Models for Reasoning Tasks
by: Wang, Yajing, et al.
Published: (2024)