Imagen de Portada

A Sharper Picture of Generalization in Transformers

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lintilhac, Paul, Shaikh, Sair
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Sharper Generalization Bounds for Transformer
por: Li, Yawen, et al.
Publicado: (2026)

Why Adam Can Beat SGD: Second-Moment Normalization Yields Sharper Tails
por: Jin, Ruinan, et al.
Publicado: (2026)

Sharper Error Bounds in Late Fusion Multi-view Clustering Using Eigenvalue Proportion
por: Du, Liang, et al.
Publicado: (2024)

TEL'M: Test and Evaluation of Language Models
por: Cybenko, George, et al.
Publicado: (2024)

The Bid Picture: Auction-Inspired Multi-player Generative Adversarial Networks Training
por: Shim, Joo Yong, et al.
Publicado: (2024)

Emergent Language Symbolic Autoencoder (ELSA) with Weak Supervision to Model Hierarchical Brain Networks
por: Latheef, Ammar Ahmed Pallikonda, et al.
Publicado: (2024)

Permutation Picture of Graph Combinatorial Optimization Problems
por: Min, Yimeng
Publicado: (2024)

EnTransformer: A Deep Generative Transformer for Multivariate Probabilistic Forecasting
por: Pathak, Rajdeep, et al.
Publicado: (2026)

Stability and Generalization in Looped Transformers
por: Labovich, Asher
Publicado: (2026)

Traj-Transformer: Diffusion Models with Transformer for GPS Trajectory Generation
por: Zhang, Zhiyang, et al.
Publicado: (2025)

RL + Transformer = A General-Purpose Problem Solver
por: Rentschler, Micah, et al.
Publicado: (2025)

A Controlled Study of Double DQN and Dueling DQN Under Cross-Environment Transfer
por: Nasir, Azkaa, et al.
Publicado: (2026)

MedXAI: A Retrieval-Augmented and Self-Verifying Framework for Knowledge-Guided Medical Image Analysis
por: Urooj, Midhat, et al.
Publicado: (2025)

Generalized Graph Transformer Variational Autoencoder
por: Karki, Siddhant
Publicado: (2025)

On Vanishing Variance in Transformer Length Generalization
por: Li, Ruining, et al.
Publicado: (2025)

Graph Generative Pre-trained Transformer
por: Chen, Xiaohui, et al.
Publicado: (2025)

A Picture is Worth A Thousand Numbers: Enabling LLMs Reason about Time Series via Visualization
por: Liu, Haoxin, et al.
Publicado: (2024)

Do Transformers Have the Ability for Periodicity Generalization?
por: Liu, Huanyu, et al.
Publicado: (2026)

Meta-Learning Transformers to Improve In-Context Generalization
por: Braccaioli, Lorenzo, et al.
Publicado: (2025)

Principled Understanding of Generalization for Generative Transformer Models in Arithmetic Reasoning Tasks
por: Xu, Xingcheng, et al.
Publicado: (2024)

BioCOMPASS: Integrating Biomarkers into Transformer-Based Immunotherapy Response Prediction
por: Hashim, Sayed, et al.
Publicado: (2026)

Fourier Transformers for Latent Crystallographic Diffusion and Generative Modeling
por: Duersch, Jed A., et al.
Publicado: (2026)

Diffusion Transformers for Tabular Data Time Series Generation
por: Garuti, Fabrizio, et al.
Publicado: (2025)

It Ain't That Bad: Understanding the Mysterious Performance Drop in OOD Generalization for Generative Transformer Models
por: Xu, Xingcheng, et al.
Publicado: (2023)

Modeling Matches as Language: A Generative Transformer Approach for Counterfactual Player Valuation in Football
por: Hong, Miru, et al.
Publicado: (2026)

Exploring Transformer Placement in Variational Autoencoders for Tabular Data Generation
por: Silva, Aníbal, et al.
Publicado: (2026)

Spectral Discovery of Continuous Symmetries via Generalized Fourier Transforms
por: Karjol, Pavan, et al.
Publicado: (2026)

N-vium: Mixture-of-Exits Transformer for Accelerated Exact Generation
por: Lorenc, Aleksander, et al.
Publicado: (2026)

GraphGPT: Generative Pre-trained Graph Eulerian Transformer
por: Zhao, Qifang, et al.
Publicado: (2023)

Understanding the Training and Generalization of Pretrained Transformer for Sequential Decision Making
por: Wang, Hanzhao, et al.
Publicado: (2024)

Extreme Precipitation Nowcasting using Transformer-based Generative Models
por: Meo, Cristian, et al.
Publicado: (2024)

Generative Modeling of Networked Time-Series via Transformer Architectures
por: Elnady, Yusuf
Publicado: (2025)

Versatile Cardiovascular Signal Generation with a Unified Diffusion Transformer
por: Chen, Zehua, et al.
Publicado: (2025)

A Hybrid Model for Traffic Incident Detection based on Generative Adversarial Networks and Transformer Model
por: Lu, Xinying, et al.
Publicado: (2024)

Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers
por: Bengesi, Staphord, et al.
Publicado: (2023)

Representational Homomorphism Predicts and Improves Compositional Generalization In Transformer Language Model
por: An, Zhiyu, et al.
Publicado: (2026)

Adaptive Ensembles of Fine-Tuned Transformers for LLM-Generated Text Detection
por: Lai, Zhixin, et al.
Publicado: (2024)

Arithmetic Transformers Can Length-Generalize in Both Operand Length and Count
por: Cho, Hanseul, et al.
Publicado: (2024)

Generative Sequential Notification Optimization via Multi-Objective Decision Transformers
por: Ocejo, Borja, et al.
Publicado: (2025)

JTreeformer: Graph-Transformer via Latent-Diffusion Model for Molecular Generation
por: Shi, Ji, et al.
Publicado: (2025)