Cover Image

Breaking the Correlation Plateau: On the Optimization and Capacity Limits of Attention-Based Regressors

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yan, Jingquan, Miao, Yuwei, Yu, Peiran, Huang, Junzhou
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

GenePheno: Interpretable Gene Knockout-Induced Phenotype Abnormality Prediction from Gene Sequences
by: Yan, Jingquan, et al.
Published: (2025)

GoBERT: Gene Ontology Graph Informed BERT for Universal Gene Function Prediction
by: Miao, Yuwei, et al.
Published: (2025)

RL as Regressor: A Reinforcement Learning Approach for Function Approximation
by: Huang, Yongchao
Published: (2025)

Zeroth-Order Methods for Stochastic Nonconvex Nonsmooth Composite Optimization
by: Chen, Ziyi, et al.
Published: (2025)

scpFormer: A Foundation Model for Unified Representation and Integration of the Single-Cell Proteomics
by: Zhou, Qifeng, et al.
Published: (2026)

Diffusion Counterfactuals for Image Regressors
by: Ha, Trung Duc, et al.
Published: (2025)

Assessing the Probabilistic Fit of Neural Regressors via Conditional Congruence
by: Young, Spencer, et al.
Published: (2024)

Cryptocurrency Price Forecasting Using XGBoost Regressor and Technical Indicators
by: Hafid, Abdelatif, et al.
Published: (2024)

Symbolic Foundation Regressor on Complex Networks
by: Liu, Weiting, et al.
Published: (2025)

Consistency of the $k$-Nearest Neighbor Regressor under Complex Survey Designs
by: Hasler, Caren
Published: (2026)

COMET-SG1: Lightweight Autoregressive Regressor for Edge and Embedded AI
by: Gogoi, Shakhyar
Published: (2026)

DTOR: Decision Tree Outlier Regressor to explain anomalies
by: Crupi, Riccardo, et al.
Published: (2024)

InversionGNN: A Dual Path Network for Multi-Property Molecular Optimization
by: Niu, Yifan, et al.
Published: (2025)

Breaking the Attention Bottleneck
by: Hilsenbek, Kalle
Published: (2024)

A Sensitivity-Driven Expert Allocation Method in LoRA-MoE for Efficient Fine-Tuning
by: Xu, Junzhou, et al.
Published: (2025)

Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training
by: Shirkavand, Reza, et al.
Published: (2025)

Cost-Aware Contrastive Routing for LLMs
by: Shirkavand, Reza, et al.
Published: (2025)

Breaking the Bottlenecks: Scalable Diffusion Models for 3D Molecular Generation
by: Das, Adrita, et al.
Published: (2026)

Decomposed Direct Preference Optimization for Structure-Based Drug Design
by: Cheng, Xiwei, et al.
Published: (2024)

OmniPred: Language Models as Universal Regressors
by: Song, Xingyou, et al.
Published: (2024)

Effects of Feature Correlations on Associative Memory Capacity
by: Bielmeier, Stefan, et al.
Published: (2025)

A Capacity-Based Rationale for Multi-Head Attention
by: Adler, Micah
Published: (2025)

PEIRA: Learning Predictive Encoders through Inter-View Regressor Alignment
by: Arbel, Michael, et al.
Published: (2026)

FNODE: Flow-Matching for data-driven simulation of constrained multibody systems
by: Wang, Hongyu, et al.
Published: (2025)

New Hybrid Fine-Tuning Paradigm for LLMs: Algorithm Design and Convergence Analysis Framework
by: Ma, Shaocong, et al.
Published: (2026)

Curvature Dynamic Black-box Attack: revisiting adversarial robustness via dynamic curvature estimation
by: Sun, Peiran
Published: (2025)

Memorization Capacity of Multi-Head Attention in Transformers
by: Mahdavi, Sadegh, et al.
Published: (2023)

LimeSoDa: A Dataset Collection for Benchmarking of Machine Learning Regressors in Digital Soil Mapping
by: Schmidinger, J., et al.
Published: (2025)

Density-Regression: Efficient and Distance-Aware Deep Regressor for Uncertainty Estimation under Distribution Shifts
by: Bui, Ha Manh, et al.
Published: (2024)

Regressor-free Molecule Generation to Support Drug Response Prediction
by: Li, Kun, et al.
Published: (2024)

Revisiting Convergence: Shuffling Complexity Beyond Lipschitz Smoothness
by: He, Qi, et al.
Published: (2025)

Provably Mitigating Corruption, Overoptimization, and Verbosity Simultaneously in Offline and Online RLHF/DPO Alignment
by: Chen, Ziyi, et al.
Published: (2025)

Multi-Task Semantic Communication With Graph Attention-Based Feature Correlation Extraction
by: Yu, Xi, et al.
Published: (2025)

BridgePure: Limited Protection Leakage Can Break Black-Box Data Protection
by: Wang, Yihan, et al.
Published: (2024)

Paying Attention to Facts: Quantifying the Knowledge Capacity of Attention Layers
by: Wong, Liang Ze
Published: (2025)

Regressor-guided Diffusion Model for De Novo Peptide Sequencing with Explicit Mass Control
by: Chen, Shaorong, et al.
Published: (2026)

Numerical Approximation Capacity of Neural Networks with Bounded Parameters: Do Limits Exist, and How Can They Be Measured?
by: Liu, Li, et al.
Published: (2024)

CoRe-Net: Co-Operational Regressor Network with Progressive Transfer Learning for Blind Radar Signal Restoration
by: Zahid, Muhammad Uzair, et al.
Published: (2025)

Adaptive Cubic Regularized Second-Order Latent Factor Analysis Model
by: Wang, Jialiang, et al.
Published: (2025)

Learning Heat-based Equations in Self-similar variables
by: Wang, Shihao, et al.
Published: (2026)