Cover Image

Dissecting Multiplication in Transformers: Insights into LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Qiu, Luyu, Li, Jianing, Su, Chi, Zhang, Chen Jason, Chen, Lei
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

XPose: eXplainable Human Pose Estimation
by: Qiu, Luyu, et al.
Published: (2024)

Interactive Text-to-SQL via Expected Information Gain for Disambiguation
by: Qiu, Luyu, et al.
Published: (2025)

Exposing Numeracy Gaps: A Benchmark to Evaluate Fundamental Numerical Abilities in Large Language Models
by: Li, Haoyang, et al.
Published: (2025)

Dissecting Role Cognition in Medical LLMs via Neuronal Ablation
by: Liang, Xun, et al.
Published: (2025)

The Language Barrier: Dissecting Safety Challenges of LLMs in Multilingual Contexts
by: Shen, Lingfeng, et al.
Published: (2024)

Mask What Matters: Mitigating Object Hallucinations in Multimodal Large Language Models with Object-Aligned Visual Contrastive Decoding
by: Chen, Boqi, et al.
Published: (2026)

Revisiting Greedy Decoding for Visual Question Answering: A Calibration Perspective
by: Chen, Boqi, et al.
Published: (2026)

SonicBench: Dissecting the Physical Perception Bottleneck in Large Audio Language Models
by: Sun, Yirong, et al.
Published: (2026)

Towards Efficient LLMs Annealing with Principled Sample Selection
by: Xu, Yuanjian, et al.
Published: (2026)

Benchmarking Cognitive Domains for LLMs: Insights from Taiwanese Hakka Culture
by: Chang, Chen-Chi, et al.
Published: (2024)

AI Hiring with LLMs: A Context-Aware and Explainable Multi-Agent Framework for Resume Screening
by: Lo, Frank P. -W., et al.
Published: (2025)

Modeling Multiple Support Strategies within a Single Turn for Emotional Support Conversations
by: Zhu, Jie, et al.
Published: (2026)

Instruction Anchor: Dissecting the Mechanistic Dynamics of Modality Arbitration
by: Zhang, Yu, et al.
Published: (2026)

Dissecting Bias in LLMs: A Mechanistic Interpretability Perspective
by: Chandna, Bhavik, et al.
Published: (2025)

Dissecting Judicial Reasoning in U.S. Copyright Damage Awards
by: Lo, Pei-Chi, et al.
Published: (2026)

From Dissonance to Insights: Dissecting Disagreements in Rationale Construction for Case Outcome Classification
by: Xu, Shanshan, et al.
Published: (2023)

Mitigating Hidden Confounding by Progressive Confounder Imputation via Large Language Models
by: Yang, Hao, et al.
Published: (2025)

Anatomy of the Modality Gap: Dissecting the Internal States of End-to-End Speech LLMs
by: Hsu, Ming-Hao, et al.
Published: (2026)

Eye of Judgement: Dissecting the Evaluation of Russian-speaking LLMs with POLLUX
by: Martynov, Nikita, et al.
Published: (2025)

QualBench: Benchmarking Chinese LLMs with Localized Professional Qualifications for Vertical Domain Evaluation
by: Hong, Mengze, et al.
Published: (2025)

Revolutionizing Finance with LLMs: An Overview of Applications and Insights
by: Zhao, Huaqin, et al.
Published: (2024)

Lost in Multilinguality: Dissecting Cross-lingual Factual Inconsistency in Transformer Language Models
by: Wang, Mingyang, et al.
Published: (2025)

Unveiling Scoring Processes: Dissecting the Differences between LLMs and Human Graders in Automatic Scoring
by: Wu, Xuansheng, et al.
Published: (2024)

Safe in the Future, Dangerous in the Past: Dissecting Temporal and Linguistic Vulnerabilities in LLMs
by: Said, Muhammad Abdullahi, et al.
Published: (2025)

Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study
by: Zhou, Yujun, et al.
Published: (2025)

Dissecting Human and LLM Preferences
by: Li, Junlong, et al.
Published: (2024)

Reasoning that Travels: Dissecting How Chain-of-Thought Transfers Across Models
by: Cheng, Xinyuan, et al.
Published: (2026)

Mechanistic Interpretability of Binary and Ternary Transformers
by: Li, Jason
Published: (2024)

Dissecting Outlier Dynamics in LLM NVFP4 Pretraining
by: Dong, Peijie, et al.
Published: (2026)

Beyond path selection: Better LLMs for Scientific Information Extraction with MimicSFT and Relevance and Rule-induced(R$^2$)GRPO
by: Li, Ran, et al.
Published: (2025)

Dissecting Tool-Integrated Reasoning: An Empirical Study and Analysis
by: Zhao, Yufeng, et al.
Published: (2025)

Beyond Single-Point Judgment: Distribution Alignment for LLM-as-a-Judge
by: Chen, Luyu, et al.
Published: (2025)

Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective
by: Zhong, Meizhi, et al.
Published: (2024)

GEMQ: Global Expert-Level Mixed-Precision Quantization for MoE LLMs
by: Deng, Jianing, et al.
Published: (2026)

Two Failures of Self-Consistency in the Multi-Step Reasoning of LLMs
by: Chen, Angelica, et al.
Published: (2023)

Can Post-Training Transform LLMs into Causal Reasoners?
by: Chen, Junqi, et al.
Published: (2026)

Dissecting the Ullman Variations with a SCALPEL: Why do LLMs fail at Trivial Alterations to the False Belief Task?
by: Pi, Zhiqiang, et al.
Published: (2024)

Using LLMs for Automated Privacy Policy Analysis: Prompt Engineering, Fine-Tuning and Explainability
by: Chen, Yuxin, et al.
Published: (2025)

Beyond GPT-5: Making LLMs Cheaper and Better via Performance-Efficiency Optimized Routing
by: Zhang, Yiqun, et al.
Published: (2025)

Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
by: Ji, Tao, et al.
Published: (2025)