Image de couverture de livre

From Attention to Activation: Unravelling the Enigmas of Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kaul, Prannay, Ma, Chengcheng, Elezi, Ismail, Deng, Jiankang
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching
par: Miles, Roy, et autres
Publié: (2026)

Three Heads Are Better Than One: Complementary Experts for Long-Tailed Semi-supervised Learning
par: Ma, Chengcheng, et autres
Publié: (2023)

G3DR: Generative 3D Reconstruction in ImageNet
par: Reddy, Pradyumna, et autres
Publié: (2024)

$V_kD:$ Improving Knowledge Distillation using Orthogonal Projections
par: Miles, Roy, et autres
Publié: (2024)

Deep Active Learning: A Reality Check
par: Gashi, Edrina, et autres
Publié: (2024)

"Principal Components" Enable A New Language of Images
par: Wen, Xin, et autres
Publié: (2025)

VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections
par: Miles, Roy, et autres
Publié: (2024)

RetouchLLM: Training-free Code-based Image Retouching with Vision Language Models
par: Ye-Bin, Moon, et autres
Publié: (2025)

CASteer: Cross-Attention Steering for Controllable Concept Erasure
par: Gaintseva, Tatiana, et autres
Publié: (2025)

Fractal Calibration for long-tailed object detection
par: Alexandridis, Konstantinos Panagiotis, et autres
Publié: (2024)

SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensing
par: Toker, Aysim, et autres
Publié: (2025)

Stable and Explainable Personality Trait Evaluation in Large Language Models with Internal Activations
par: Ma, Xiaoxu, et autres
Publié: (2026)

Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization
par: Son, Seungwoo, et autres
Publié: (2024)

Do You See What I Am Pointing At? Gesture-Based Egocentric Video Question Answering
par: Choi, Yura, et autres
Publié: (2026)

Hybrid EEG--Driven Brain--Computer Interface: A Large Language Model Framework for Personalized Language Rehabilitation
par: Hossain, Ismail, et autres
Publié: (2025)

An Enigma of Artificial Reason: Investigating the Production-Evaluation Gap in Large Reasoning Models
par: Sun, Mingzhong, et autres
Publié: (2026)

First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models
par: Ma, Chi, et autres
Publié: (2024)

Unraveling Arithmetic in Large Language Models: The Role of Algebraic Structures
par: Chang, Fu-Chieh, et autres
Publié: (2024)

Massive Activations in Large Language Models
par: Sun, Mingjie, et autres
Publié: (2024)

Measuring Maximum Activations in Open Large Language Models
par: Chen, Luxuan, et autres
Publié: (2026)

Activation-Guided Consensus Merging for Large Language Models
par: Yao, Yuxuan, et autres
Publié: (2025)

Why do Large Language Models Fail in Low-resource Translation? Unraveling the Token Dynamics of Large Language Models for Machine Translation
par: Qian, Shenbin, et autres
Publié: (2026)

Learning to Check: Unleashing Potentials for Self-Correction in Large Language Models
par: Zhang, Che, et autres
Publié: (2024)

Formality is Favored: Unraveling the Learning Preferences of Large Language Models on Data with Conflicting Knowledge
par: Li, Jiahuan, et autres
Publié: (2024)

Unraveling Interwoven Roles of Large Language Models in Authorship Privacy: Obfuscation, Mimicking, and Verification
par: Nguyen, Tuc, et autres
Publié: (2025)

Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
par: Wang, Hongyu, et autres
Publié: (2024)

Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models
par: Zhu, Tinghui, et autres
Publié: (2024)

Head-wise Shareable Attention for Large Language Models
par: Cao, Zouying, et autres
Publié: (2024)

Attention Heads of Large Language Models: A Survey
par: Zheng, Zifan, et autres
Publié: (2024)

Unraveling the Dominance of Large Language Models Over Transformer Models for Bangla Natural Language Inference: A Comprehensive Study
par: Faria, Fatema Tuj Johora, et autres
Publié: (2024)

PocketLLM: Ultimate Compression of Large Language Models via Meta Networks
par: Tian, Ye, et autres
Publié: (2025)

Unraveling and Mitigating Retriever Inconsistencies in Retrieval-Augmented Large Language Models
par: Li, Mingda, et autres
Publié: (2024)

Controlling Large Language Model Agents with Entropic Activation Steering
par: Rahn, Nate, et autres
Publié: (2024)

Controlling Large Language Models Through Concept Activation Vectors
par: Zhang, Hanyu, et autres
Publié: (2025)

Riddle Quest : The Enigma of Words
par: Parasa, Niharika Sri, et autres
Publié: (2026)

Activation-Informed Merging of Large Language Models
par: Nobari, Amin Heyrani, et autres
Publié: (2025)

Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
par: Qiu, Zihan, et autres
Publié: (2025)

PoLLMgraph: Unraveling Hallucinations in Large Language Models via State Transition Dynamics
par: Zhu, Derui, et autres
Publié: (2024)

Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generator
par: Zuo, Ronglai, et autres
Publié: (2024)

Polynomial Composition Activations: Unleashing the Dynamics of Large Language Models
par: Zhuo, Zhijian, et autres
Publié: (2024)