Image de couverture de livre

Adapting LLMs for Efficient Context Processing through Soft Prompt Compression

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Cangqing, Yang, Yutian, Li, Ruisi, Sun, Dan, Cai, Ruicong, Zhang, Yuzhu, Fu, Chengqian, Floyd, Lillian
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Prompt Recursive Search: A Living Framework with Adaptive Growth in LLM Auto-Prompting
par: Zhao, Xiangyu, et autres
Publié: (2024)

ATACompressor: Adaptive Task-Aware Compression for Efficient Long-Context Processing in LLMs
par: Li, Xuancheng, et autres
Publié: (2026)

CA-BERT: Leveraging Context Awareness for Enhanced Multi-Turn Chat Interaction
par: Liu, Minghao, et autres
Publié: (2024)

Modular Representation Compression: Adapting LLMs for Efficient and Effective Recommendations
par: Xi, Yunjia, et autres
Publié: (2026)

Reinforcement Learning Approach for Integrating Compressed Contexts into Knowledge Graphs
par: Quach, Ngoc, et autres
Publié: (2024)

The Power of Adaptation: Boosting In-Context Learning through Adaptive Prompting
par: Cai, Shuzhang, et autres
Publié: (2024)

Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compression
par: Hong, Junyuan, et autres
Publié: (2024)

ZSMerge: Zero-Shot KV Cache Compression for Memory-Efficient Long-Context LLMs
par: Liu, Xin, et autres
Publié: (2025)

Efficient and Effective Prompt Tuning via Prompt Decomposition and Compressed Outer Product
par: Lan, Pengxiang, et autres
Publié: (2025)

Soft Begging: Modular and Efficient Shielding of LLMs against Prompt Injection and Jailbreaking based on Prompt Tuning
par: Ostermann, Simon, et autres
Publié: (2024)

Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context
par: Bartl, Marion, et autres
Publié: (2025)

EFPC: Towards Efficient and Flexible Prompt Compression
par: Cao, Yun-Hao, et autres
Publié: (2025)

Recurrent Context Compression: Efficiently Expanding the Context Window of LLM
par: Huang, Chensen, et autres
Publié: (2024)

Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
par: Ning, Xuefei, et autres
Publié: (2023)

PromptEmbedder:: Efficient and Transferable Text Embedding via Dual-LLM Soft Prompting
par: Tsai, Yu-Che, et autres
Publié: (2026)

Sentinel: Decoding Context Utilization via Attention Probing for Efficient LLM Context Compression
par: Zhang, Yong, et autres
Publié: (2025)

KV-Distill: Nearly Lossless Learnable Context Compression for LLMs
par: Chari, Vivek, et autres
Publié: (2025)

Adapting Whisper for Parameter-efficient Code-Switching Speech Recognition via Soft Prompt Tuning
par: Yang, Hongli, et autres
Publié: (2025)

QUITO: Accelerating Long-Context Reasoning through Query-Guided Context Compression
par: Wang, Wenshan, et autres
Publié: (2024)

Prompting Large Language Models for Supporting the Differential Diagnosis of Anemia
par: Castagnari, Elisa, et autres
Publié: (2024)

Dynamic Compressing Prompts for Efficient Inference of Large Language Models
par: Hu, Jinwu, et autres
Publié: (2025)

PIS: Linking Importance Sampling and Attention Mechanisms for Efficient Prompt Compression
par: Chen, Lizhe, et autres
Publié: (2025)

Accelerating Prefilling for Long-Context LLMs via Sparse Pattern Sharing
par: Peng, Dan, et autres
Publié: (2025)

On the Transformations across Reward Model, Parameter Update, and In-Context Prompt
par: Cai, Deng, et autres
Publié: (2024)

No Universal Prompt: Unifying Reasoning through Adaptive Prompting for Temporal Table Reasoning
par: Rajgaria, Abhishek, et autres
Publié: (2025)

IPS: In-Prompt Process Supervision for Short Video Content Moderation
par: Liu, Mingchao, et autres
Publié: (2024)

Methodology of Adapting Large English Language Models for Specific Cultural Contexts
par: Zhang, Wenjing, et autres
Publié: (2024)

Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning
par: Yang, Juncheng, et autres
Publié: (2024)

Steer2Adapt: Dynamically Composing Steering Vectors Elicits Efficient Adaptation of LLMs
par: Han, Pengrui, et autres
Publié: (2026)

C3: A Bilingual Benchmark for Spoken Dialogue Models Exploring Challenges in Complex Conversations
par: Ma, Chengqian, et autres
Publié: (2025)

From Context to EDUs: Faithful and Structured Context Compression via Elementary Discourse Unit Decomposition
par: Zhou, Yiqing, et autres
Publié: (2025)

Context Engineering 2.0: The Context of Context Engineering
par: Hua, Qishuo, et autres
Publié: (2025)

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
par: Xiao, Chaojun, et autres
Publié: (2024)

Benchmarking and Adapting On-Device LLMs for Clinical Decision Support
par: Munim, Alif, et autres
Publié: (2025)

Adapting LLMs for Minimal-edit Grammatical Error Correction
par: Staruch, Ryszard, et autres
Publié: (2025)

Discrete Prompt Compression with Reinforcement Learning
par: Jung, Hoyoun, et autres
Publié: (2023)

Domain-Adapted Retrieval for In-Context Annotation of Pedagogical Dialogue Acts
par: Lee, Jinsook, et autres
Publié: (2026)

Adapting LLMs to Time Series Forecasting via Temporal Heterogeneity Modeling and Semantic Alignment
par: Sun, Yanru, et autres
Publié: (2025)

SoftTiger: A Clinical Foundation Model for Healthcare Workflows
par: Chen, Ye, et autres
Publié: (2024)

LiteLong: Resource-Efficient Long-Context Data Synthesis for LLMs
par: Jia, Junlong, et autres
Publié: (2025)