Image de couverture de livre

The Transformer Cookbook

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yang, Andy, Watson, Christopher, Xue, Anton, Bhattamishra, Satwik, Llarena, Jose, Merrill, William, Ferreira, Emile Dos Santos, Svete, Anej, Chiang, David
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Discovering Interpretable Algorithms by Decompiling Transformers to RASP
par: Huang, Xinting, et autres
Publié: (2026)

Revisiting Padded Transformer Expressivity: Which Architectural Choices Matter and Which Don't
par: Svete, Anej, et autres
Publié: (2026)

Context-Free Recognition with Transformers
par: Jerad, Selim, et autres
Publié: (2026)

Transformers Can Represent $n$-gram Language Models
par: Svete, Anej, et autres
Publié: (2024)

On the Reasoning Abilities of Masked Diffusion Language Models
par: Svete, Anej, et autres
Publié: (2025)

Separations in the Representational Capabilities of Transformers and Recurrent Architectures
par: Bhattamishra, Satwik, et autres
Publié: (2024)

Hardness of Learning Regular Languages in the Next Symbol Prediction Setting
par: Bhattamishra, Satwik, et autres
Publié: (2025)

A Formal Framework for Understanding Length Generalization in Transformers
par: Huang, Xinting, et autres
Publié: (2024)

Provably Learning Attention with Queries
par: Bhattamishra, Satwik, et autres
Publié: (2026)

On the Representational Capacity of Recurrent Neural Language Models
par: Nowak, Franz, et autres
Publié: (2023)

On Efficiently Representing Regular Languages as RNNs
par: Svete, Anej, et autres
Publié: (2024)

Gumbel Counterfactual Generation From Language Models
par: Ravfogel, Shauli, et autres
Publié: (2024)

Unique Hard Attention: A Tale of Two Sides
par: Jerad, Selim, et autres
Publié: (2025)

Counting Like Transformers: Compiling Temporal Counting Logic Into Softmax Transformers
par: Yang, Andy, et autres
Publié: (2024)

Training Neural Networks as Recognizers of Formal Languages
par: Butoi, Alexandra, et autres
Publié: (2024)

Inshrinkerator: Compressing Deep Learning Training Checkpoints via Dynamic Quantization
par: Agrawal, Amey, et autres
Publié: (2023)

Benefits and Limitations of Communication in Multi-Agent Reasoning
par: Rizvi-Martel, Michael, et autres
Publié: (2025)

Optimising for Energy Efficiency and Performance in Machine Learning
par: Ferreira, Emile Dos Santos, et autres
Publié: (2026)

Probability Distributions Computed by Autoregressive Transformers
par: Yang, Andy, et autres
Publié: (2025)

A Logic for Expressing Log-Precision Transformers
par: Merrill, William, et autres
Publié: (2022)

What Formal Languages Can Transformers Express? A Survey
par: Strobl, Lena, et autres
Publié: (2023)

A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers
par: Merrill, William, et autres
Publié: (2025)

The Course Difficulty Analysis Cookbook
par: Baucks, Frederik, et autres
Publié: (2025)

Masked Hard-Attention Transformers Recognize Exactly the Star-Free Languages
par: Yang, Andy, et autres
Publié: (2023)

Exact Expressive Power of Transformers with Padding
par: Merrill, William, et autres
Publié: (2025)

Tensor Cookbook: Mastering Tensors through Diagrams
par: Rakhshan, Beheshteh T., et autres
Publié: (2026)

The Expressive Power of Transformers with Chain of Thought
par: Merrill, William, et autres
Publié: (2023)

Cookbook: A framework for improving LLM generative abilities via programmatic data generating templates
par: Narayan, Avanika, et autres
Publié: (2024)

A Theory of Training Profit-Optimal LLMs
par: Hao, Sophie, et autres
Publié: (2026)

Length Generalization Bounds for Transformers
par: Yang, Andy, et autres
Publié: (2026)

Gating Enables Curvature: A Geometric Expressivity Gap in Attention
par: Bathula, Satwik, et autres
Publié: (2026)

Inverse-Transpilation: Reverse-Engineering Quantum Compiler Optimization Passes from Circuit Snapshots
par: Kundu, Satwik, et autres
Publié: (2025)

STIQ: Safeguarding Training and Inferencing of Quantum Neural Networks from Untrusted Cloud
par: Kundu, Satwik, et autres
Publié: (2024)

The Ultimate Cookbook for Invisible Poison: Crafting Subtle Clean-Label Text Backdoors with Style Attributes
par: You, Wencong, et autres
Publié: (2025)

Transformers in Uniform TC$^0$
par: Chiang, David
Publié: (2024)

On Affine Homotopy between Language Encoders
par: Chan, Robin SM, et autres
Publié: (2024)

Security Concerns in Quantum Machine Learning as a Service
par: Kundu, Satwik, et autres
Publié: (2024)

Olmo Hybrid: From Theory to Practice and Back
par: Merrill, William, et autres
Publié: (2026)

Simulating Hard Attention Using Soft Attention
par: Yang, Andy, et autres
Publié: (2024)

Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training
par: Merrill, William, et autres
Publié: (2025)