Copertina

Rodimus*: Breaking the Accuracy-Efficiency Trade-Off with Efficient Attentions

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	He, Zhihao, Yu, Hang, Gong, Zi, Liu, Shizhan, Li, Jianguo, Lin, Weiyao
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

BasisFormer: Attention-based Time Series Forecasting with Learnable and Interpretable Basis
di: Ni, Zelin, et al.
Pubblicazione: (2023)

Breaking the Trade-Off Between Faithfulness and Expressiveness for Large Language Models
di: Yang, Chenxu, et al.
Pubblicazione: (2025)

CoBa: Convergence Balancer for Multitask Finetuning of Large Language Models
di: Gong, Zi, et al.
Pubblicazione: (2024)

DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-off
di: Zhang, Jusheng, et al.
Pubblicazione: (2025)

ACCORD: Alleviating Concept Coupling through Dependence Regularization for Text-to-Image Diffusion Personalization
di: Liu, Shizhan, et al.
Pubblicazione: (2025)

DND: Boosting Large Language Models with Dynamic Nested Depth
di: Chen, Tieyuan, et al.
Pubblicazione: (2025)

FFSplit: Split Feed-Forward Network For Optimizing Accuracy-Efficiency Trade-off in Language Model Inference
di: Liu, Zirui, et al.
Pubblicazione: (2024)

CAKE: Cascading and Adaptive KV Cache Eviction with Layer Preferences
di: Qin, Ziran, et al.
Pubblicazione: (2025)

Encoder-Decoder Gemma: Improving the Quality-Efficiency Trade-Off via Adaptation
di: Zhang, Biao, et al.
Pubblicazione: (2025)

CreditDecoding: Accelerating Parallel Decoding in Diffusion Large Language Models with Trace Credit
di: Wang, Kangyu, et al.
Pubblicazione: (2025)

Structure-Learnable Adapter Fine-Tuning for Parameter-Efficient Large Language Models
di: Gong, Ming, et al.
Pubblicazione: (2025)

Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code
di: Zhang, Ziyin, et al.
Pubblicazione: (2023)

Characterizing the Accuracy -- Efficiency Trade-off of Low-rank Decomposition in Language Models
di: Moar, Chakshu, et al.
Pubblicazione: (2024)

ERAGent: Enhancing Retrieval-Augmented Language Models with Improved Accuracy, Efficiency, and Personalization
di: Shi, Yunxiao, et al.
Pubblicazione: (2024)

RAT: Bridging RNN Efficiency and Attention Accuracy via Chunk-based Sequence Modeling
di: Wei, Xiuying, et al.
Pubblicazione: (2025)

ABC: Adaptive BayesNet Structure Learning for Computational Scalable Multi-task Image Compression
di: Zhang, Yufeng, et al.
Pubblicazione: (2025)

Entropy-Guided Watermarking for LLMs: A Test-Time Framework for Robust and Traceable Text Generation
di: Cai, Shizhan, et al.
Pubblicazione: (2025)

Demystifying the Accuracy-Interpretability Trade-Off: A Case Study of Inferring Ratings from Reviews
di: Atrey, Pranjal, et al.
Pubblicazione: (2025)

Knocking-Heads Attention
di: Zhou, Zhanchao, et al.
Pubblicazione: (2025)

D2LLM: Decomposed and Distilled Large Language Models for Semantic Search
di: Liao, Zihan, et al.
Pubblicazione: (2024)

Breaking the Attention Bottleneck
di: Hilsenbek, Kalle
Pubblicazione: (2024)

PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization
di: Meng, Xiangdi, et al.
Pubblicazione: (2024)

Scaling Stick-Breaking Attention: An Efficient Implementation and In-depth Study
di: Tan, Shawn, et al.
Pubblicazione: (2024)

LAMDAS: LLM as an Implicit Classifier for Domain-specific Data Selection
di: Wu, Jian, et al.
Pubblicazione: (2025)

HyLRA: Hybrid Layer Reuse Attention for Efficient Long-Context Inference
di: Ai, Xuan, et al.
Pubblicazione: (2026)

Brainformers: Trading Simplicity for Efficiency
di: Zhou, Yanqi, et al.
Pubblicazione: (2023)

End-to-End Dialog Neural Coreference Resolution: Balancing Efficiency and Accuracy in Large-Scale Systems
di: Dong, Zhang, et al.
Pubblicazione: (2025)

Beyond Homogeneous Attention: Memory-Efficient LLMs via Fourier-Approximated KV Cache
di: Liu, Xiaoran, et al.
Pubblicazione: (2025)

Efficient OpAmp Adaptation for Zoom Attention to Golden Contexts
di: Wu, Haoyuan, et al.
Pubblicazione: (2025)

Stealth Fine-Tuning: Efficiently Breaking Alignment in RVLMs Using Self-Generated CoT
di: Yu, Le, et al.
Pubblicazione: (2025)

Exploring Accuracy-Fairness Trade-off in Large Language Models
di: Zhang, Qingquan, et al.
Pubblicazione: (2024)

Factuality on Demand: Controlling the Factuality-Informativeness Trade-off in Text Generation
di: Gong, Ziwei, et al.
Pubblicazione: (2026)

GALLa: Graph Aligned Large Language Models for Improved Source Code Understanding
di: Zhang, Ziyin, et al.
Pubblicazione: (2024)

Efficient Length-Generalizable Attention via Causal Retrieval for Long-Context Language Modeling
di: Hu, Xiang, et al.
Pubblicazione: (2024)

S$^2$-MAD: Breaking the Token Barrier to Enhance Multi-Agent Debate Efficiency
di: Zeng, Yuting, et al.
Pubblicazione: (2025)

Breaking the Adversarial Robustness-Performance Trade-off in Text Classification via Manifold Purification
di: Dang, Chenhao, et al.
Pubblicazione: (2025)

E2LLM: Encoder Elongated Large Language Models for Long-Context Understanding and Reasoning
di: Liao, Zihan, et al.
Pubblicazione: (2024)

TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
di: Yang, Lijie, et al.
Pubblicazione: (2024)

ATTNPO: Attention-Guided Process Supervision for Efficient Reasoning
di: Nie, Shuaiyi, et al.
Pubblicazione: (2026)

WuNeng: Hybrid State with Attention
di: Xiao, Liu, et al.
Pubblicazione: (2025)