Image de couverture de livre

ALTA: Compiler-Based Analysis of Transformers

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Shaw, Peter, Cohan, James, Eisenstein, Jacob, Lee, Kenton, Berant, Jonathan, Toutanova, Kristina
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Bridging Kolmogorov Complexity and Deep Learning: Asymptotically Optimal Description Length Objectives for Transformers
par: Shaw, Peter, et autres
Publié: (2025)

Effective Reasoning Chains Reduce Intrinsic Dimensionality
par: Prasad, Archiki, et autres
Publié: (2026)

BgGPT 1.0: Extending English-centric LLMs to other languages
par: Alexandrov, Anton, et autres
Publié: (2024)

MT-PingEval: Evaluating Multi-Turn Collaboration with Private Information Games
par: Eisenstein, Jacob, et autres
Publié: (2026)

Robust Preference Optimization through Reward Model Distillation
par: Fisch, Adam, et autres
Publié: (2024)

Plantain: Plan-Answer Interleaved Reasoning
par: Liang, Anthony, et autres
Publié: (2025)

SEMQA: Semi-Extractive Multi-Source Question Answering
par: Schuster, Tal, et autres
Publié: (2023)

On Evaluating LLM Alignment by Evaluating LLMs as Judges
par: Liu, Yixin, et autres
Publié: (2025)

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference
par: Gao, Mingqi, et autres
Publié: (2024)

Transforming and Combining Rewards for Aligning Large Language Models
par: Wang, Zihao, et autres
Publié: (2024)

Algorithmic Capabilities of Random Transformers
par: Zhong, Ziqian, et autres
Publié: (2024)

Observable Propagation: Uncovering Feature Vectors in Transformers
par: Dunefsky, Jacob, et autres
Publié: (2023)

Calibrating Long-form Generations from Large Language Models
par: Huang, Yukun, et autres
Publié: (2024)

Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Models
par: Belenki, Lior, et autres
Publié: (2025)

Don't lie to your friends: Learning what you know from collaborative self-play
par: Eisenstein, Jacob, et autres
Publié: (2025)

References Improve LLM Alignment in Non-Verifiable Domains
par: Shi, Kejian, et autres
Publié: (2026)

Can Large Language Models Understand Intermediate Representations in Compilers?
par: Jiang, Hailong, et autres
Publié: (2025)

Latent Context Compilation: Distilling Long Context into Compact Portable Memory
par: Li, Zeju, et autres
Publié: (2026)

The Anxiety of Influence: Bloom Filters in Transformer Attention Heads
par: Balogh, Peter
Publié: (2026)

Contrast-CAT: Contrasting Activations for Enhanced Interpretability in Transformer-based Text Classifiers
par: Han, Sungmin, et autres
Publié: (2025)

Optimizing Diversity and Quality through Base-Aligned Model Collaboration
par: Wang, Yichen, et autres
Publié: (2025)

Limits of Transformer Language Models on Learning to Compose Algorithms
par: Thomm, Jonathan, et autres
Publié: (2024)

Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoning
par: Setlur, Amrith, et autres
Publié: (2024)

ReIFE: Re-evaluating Instruction-Following Evaluation
par: Liu, Yixin, et autres
Publié: (2024)

Survey on Evaluation of LLM-based Agents
par: Yehudai, Asaf, et autres
Publié: (2025)

AIOS Compiler: LLM as Interpreter for Natural Language Programming and Flow Programming of AI Agents
par: Xu, Shuyuan, et autres
Publié: (2024)

Symbolic Prompt Program Search: A Structure-Aware Approach to Efficient Compile-Time Prompt Optimization
par: Schnabel, Tobias, et autres
Publié: (2024)

An Enhanced Dual Transformer Contrastive Network for Multimodal Sentiment Analysis
par: Dao, Phuong Q., et autres
Publié: (2025)

Power Transformer Fault Prediction Based on Knowledge Graphs
par: Wang, Chao, et autres
Publié: (2024)

Compile to Compress: Boosting Formal Theorem Provers by Compiler Outputs
par: Li, Guchan, et autres
Publié: (2026)

Beyond Components: Singular Vector-Based Interpretability of Transformer Circuits
par: Ahmad, Areeb, et autres
Publié: (2025)

Classification of Hope in Textual Data using Transformer-Based Models
par: Ijezue, Chukwuebuka Fortunate, et autres
Publié: (2025)

Latent Chain-of-Thought? Decoding the Depth-Recurrent Transformer
par: Lu, Wenquan, et autres
Publié: (2025)

Theoretical guarantees on the best-of-n alignment policy
par: Beirami, Ahmad, et autres
Publié: (2024)

Integrating Locality-Aware Attention with Transformers for General Geometry PDEs
par: Koh, Minsu, et autres
Publié: (2025)

Examining Reasoning LLMs-as-Judges in Non-Verifiable LLM Post-Training
par: Liu, Yixin, et autres
Publié: (2026)

CAST: Compositional Analysis via Spectral Tracking for Understanding Transformer Layer Functions
par: Fu, Zihao, et autres
Publié: (2025)

Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models
par: Lv, Ang, et autres
Publié: (2024)

Transformer-Based Multimodal Knowledge Graph Completion with Link-Aware Contexts
par: Ma, Haodi, et autres
Publié: (2025)

One-shot Optimized Steering Vectors Mediate Safety-relevant Behaviors in LLMs
par: Dunefsky, Jacob, et autres
Publié: (2025)