Cover Image

Transformers are Expressive, But Are They Expressive Enough for Regression?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nath, Swaroop, Khadilkar, Harshad, Bhattacharyya, Pushpak
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Leveraging Domain Knowledge for Efficient Reward Modelling in RLHF: A Case-Study in E-Commerce Opinion Summarization
by: Nath, Swaroop, et al.
Published: (2024)

Efficiency Boost in Decentralized Optimization: Reimagining Neighborhood Aggregation with Minimal Overhead
by: Kalwar, Durgesh, et al.
Published: (2025)

AEGIS: An Agent for Extraction and Geographic Identification in Scholarly Proceedings
by: Vishesh, Om, et al.
Published: (2025)

Using Common Random Numbers for Simulation-based Planning with Rollouts
by: Yadav, Sandarbh, et al.
Published: (2026)

On the Expressive Power of Floating-Point Transformers
by: Park, Sejun, et al.
Published: (2026)

On the Expressive Power of Contextual Relations in Transformers
by: Fraiman, Demián
Published: (2026)

Expressivity of Transformers: A Tropical Geometry Perspective
by: Su, Ye, et al.
Published: (2026)

Understanding the Expressive Power and Mechanisms of Transformer for Sequence Modeling
by: Wang, Mingze, et al.
Published: (2024)

Expanding Expressivity in Transformer Models with MöbiusAttention
by: Halacheva, Anna-Maria, et al.
Published: (2024)

Material Microstructure Design Using VAE-Regression with Multimodal Prior
by: Sardeshmukh, Avadhut, et al.
Published: (2024)

Expressive Symbolic Regression for Interpretable Models of Discrete-Time Dynamical Systems
by: Iyer, Adarsh, et al.
Published: (2024)

Exact Expressive Power of Transformers with Padding
by: Merrill, William, et al.
Published: (2025)

A Meta Reinforcement Learning Approach to Goals-Based Wealth Management
by: Das, Sanjiv R., et al.
Published: (2026)

Polynormer: Polynomial-Expressive Graph Transformer in Linear Time
by: Deng, Chenhui, et al.
Published: (2024)

On The Expressive Power of GNN Derivatives
by: Eitan, Yam, et al.
Published: (2025)

On the Role of Depth in the Expressivity of RNNs
by: Lizaire, Maude, et al.
Published: (2026)

On Expressivity of Height in Neural Networks
by: Fan, Feng-Lei, et al.
Published: (2023)

The Expressive Power of Transformers with Chain of Thought
by: Merrill, William, et al.
Published: (2023)

Pause Tokens Strictly Increase the Expressivity of Constant-Depth Transformers
by: London, Charles, et al.
Published: (2025)

From Scaling to Structured Expressivity: Rethinking Transformers for CTR Prediction
by: Yan, Bencheng, et al.
Published: (2025)

Expressive Power of Temporal Message Passing
by: Wałęga, Przemysław Andrzej, et al.
Published: (2024)

On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding
by: Xu, Kevin, et al.
Published: (2024)

Tropical Expressivity of Neural Networks
by: Lezeau, Paul, et al.
Published: (2024)

On the Expressive Power of Transformers for Maxout Networks and Continuous Piecewise Linear Functions
by: Gu, Linyan, et al.
Published: (2026)

Scalable Expressiveness through Preprocessed Graph Perturbations
by: Saber, Danial, et al.
Published: (2024)

Expressivity and Generalization: Fragment-Biases for Molecular GNNs
by: Wollschläger, Tom, et al.
Published: (2024)

On The Expressivity of Objective-Specification Formalisms in Reinforcement Learning
by: Subramani, Rohan, et al.
Published: (2023)

The Expressive Limits of Diagonal SSMs for State-Tracking
by: Shakerinava, Mehran, et al.
Published: (2026)

On the Expressive Power of GNNs to Solve Linear SDPs
by: Qian, Chendi, et al.
Published: (2026)

Expressivity-Efficiency Tradeoffs for Hybrid Sequence Models
by: Cooper, John, et al.
Published: (2026)

Multi-View Oriented GPLVM: Expressiveness and Efficiency
by: Yang, Zi, et al.
Published: (2025)

Distilling Opinions at Scale: Incremental Opinion Summarization using XL-OPSUMM
by: Muddu, Sri Raghava, et al.
Published: (2024)

On the Expressive Power of Graph Neural Networks
by: Nalwade, Ashwin, et al.
Published: (2024)

On the Expressive Power of Sparse Geometric MPNNs
by: Sverdlov, Yonatan, et al.
Published: (2024)

Level Generation with Constrained Expressive Range
by: Bazzaz, Mahsa, et al.
Published: (2025)

On the Expressive Power of GNNs for Boolean Satisfiability
by: Peltonen, Saku, et al.
Published: (2026)

Understanding Expressivity of GNN in Rule Learning
by: Qiu, Haiquan, et al.
Published: (2023)

On the Stability of Expressive Positional Encodings for Graphs
by: Huang, Yinan, et al.
Published: (2023)

An Empirical Study of Realized GNN Expressiveness
by: Wang, Yanbo, et al.
Published: (2023)

Expressivity of Quadratic Neural ODEs
by: Hanson, Joshua, et al.
Published: (2025)