Copertina

From Attention to Activation: Unravelling the Enigmas of Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Kaul, Prannay, Ma, Chengcheng, Elezi, Ismail, Deng, Jiankang
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching
di: Miles, Roy, et al.
Pubblicazione: (2026)

Three Heads Are Better Than One: Complementary Experts for Long-Tailed Semi-supervised Learning
di: Ma, Chengcheng, et al.
Pubblicazione: (2023)

G3DR: Generative 3D Reconstruction in ImageNet
di: Reddy, Pradyumna, et al.
Pubblicazione: (2024)

$V_kD:$ Improving Knowledge Distillation using Orthogonal Projections
di: Miles, Roy, et al.
Pubblicazione: (2024)

Deep Active Learning: A Reality Check
di: Gashi, Edrina, et al.
Pubblicazione: (2024)

"Principal Components" Enable A New Language of Images
di: Wen, Xin, et al.
Pubblicazione: (2025)

VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections
di: Miles, Roy, et al.
Pubblicazione: (2024)

RetouchLLM: Training-free Code-based Image Retouching with Vision Language Models
di: Ye-Bin, Moon, et al.
Pubblicazione: (2025)

CASteer: Cross-Attention Steering for Controllable Concept Erasure
di: Gaintseva, Tatiana, et al.
Pubblicazione: (2025)

Fractal Calibration for long-tailed object detection
di: Alexandridis, Konstantinos Panagiotis, et al.
Pubblicazione: (2024)

SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensing
di: Toker, Aysim, et al.
Pubblicazione: (2025)

Stable and Explainable Personality Trait Evaluation in Large Language Models with Internal Activations
di: Ma, Xiaoxu, et al.
Pubblicazione: (2026)

Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization
di: Son, Seungwoo, et al.
Pubblicazione: (2024)

Do You See What I Am Pointing At? Gesture-Based Egocentric Video Question Answering
di: Choi, Yura, et al.
Pubblicazione: (2026)

Hybrid EEG--Driven Brain--Computer Interface: A Large Language Model Framework for Personalized Language Rehabilitation
di: Hossain, Ismail, et al.
Pubblicazione: (2025)

An Enigma of Artificial Reason: Investigating the Production-Evaluation Gap in Large Reasoning Models
di: Sun, Mingzhong, et al.
Pubblicazione: (2026)

First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models
di: Ma, Chi, et al.
Pubblicazione: (2024)

Unraveling Arithmetic in Large Language Models: The Role of Algebraic Structures
di: Chang, Fu-Chieh, et al.
Pubblicazione: (2024)

Massive Activations in Large Language Models
di: Sun, Mingjie, et al.
Pubblicazione: (2024)

Measuring Maximum Activations in Open Large Language Models
di: Chen, Luxuan, et al.
Pubblicazione: (2026)

Activation-Guided Consensus Merging for Large Language Models
di: Yao, Yuxuan, et al.
Pubblicazione: (2025)

Why do Large Language Models Fail in Low-resource Translation? Unraveling the Token Dynamics of Large Language Models for Machine Translation
di: Qian, Shenbin, et al.
Pubblicazione: (2026)

Learning to Check: Unleashing Potentials for Self-Correction in Large Language Models
di: Zhang, Che, et al.
Pubblicazione: (2024)

Formality is Favored: Unraveling the Learning Preferences of Large Language Models on Data with Conflicting Knowledge
di: Li, Jiahuan, et al.
Pubblicazione: (2024)

Unraveling Interwoven Roles of Large Language Models in Authorship Privacy: Obfuscation, Mimicking, and Verification
di: Nguyen, Tuc, et al.
Pubblicazione: (2025)

Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
di: Wang, Hongyu, et al.
Pubblicazione: (2024)

Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models
di: Zhu, Tinghui, et al.
Pubblicazione: (2024)

Head-wise Shareable Attention for Large Language Models
di: Cao, Zouying, et al.
Pubblicazione: (2024)

Attention Heads of Large Language Models: A Survey
di: Zheng, Zifan, et al.
Pubblicazione: (2024)

Unraveling the Dominance of Large Language Models Over Transformer Models for Bangla Natural Language Inference: A Comprehensive Study
di: Faria, Fatema Tuj Johora, et al.
Pubblicazione: (2024)

PocketLLM: Ultimate Compression of Large Language Models via Meta Networks
di: Tian, Ye, et al.
Pubblicazione: (2025)

Unraveling and Mitigating Retriever Inconsistencies in Retrieval-Augmented Large Language Models
di: Li, Mingda, et al.
Pubblicazione: (2024)

Controlling Large Language Model Agents with Entropic Activation Steering
di: Rahn, Nate, et al.
Pubblicazione: (2024)

Controlling Large Language Models Through Concept Activation Vectors
di: Zhang, Hanyu, et al.
Pubblicazione: (2025)

Riddle Quest : The Enigma of Words
di: Parasa, Niharika Sri, et al.
Pubblicazione: (2026)

Activation-Informed Merging of Large Language Models
di: Nobari, Amin Heyrani, et al.
Pubblicazione: (2025)

Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
di: Qiu, Zihan, et al.
Pubblicazione: (2025)

PoLLMgraph: Unraveling Hallucinations in Large Language Models via State Transition Dynamics
di: Zhu, Derui, et al.
Pubblicazione: (2024)

Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generator
di: Zuo, Ronglai, et al.
Pubblicazione: (2024)

Polynomial Composition Activations: Unleashing the Dynamics of Large Language Models
di: Zhuo, Zhijian, et al.
Pubblicazione: (2024)