:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Dong, Yihe, Shigida, Boris
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2605.08478
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning Rate Transfer in Normalized Transformers
by: Shigida, Boris, et al.
Published: (2026)

How Memory in Optimization Algorithms Implicitly Modifies the Loss
by: Cattaneo, Matias D., et al.
Published: (2025)

The Effect of Mini-Batch Noise on the Implicit Bias of Adam
by: Cattaneo, Matias D., et al.
Published: (2026)

Modified Loss of Momentum Gradient Descent: Fine-Grained Analysis
by: Cattaneo, Matias D., et al.
Published: (2025)

On the Implicit Bias of Adam
by: Cattaneo, Matias D., et al.
Published: (2023)

When Do Multi-Agent Systems Outperform? Analysing the Learning Efficiency of Agentic Systems
by: Su, Junwei, et al.
Published: (2026)

AdaRank: Disagreement Based Module Rank Prediction for Low-rank Adaptation
by: Dong, Yihe
Published: (2024)

When Does Predictive Inverse Dynamics Outperform Behavior Cloning?
by: Schäfer, Lukas, et al.
Published: (2026)

Flow-DPO: Improving LLM Mathematical Reasoning through Online Multi-Agent Learning
by: Deng, Yihe, et al.
Published: (2024)

When Do Transformers Outperform Feedforward and Recurrent Networks? A Statistical Perspective
by: Mousavi-Hosseini, Alireza, et al.
Published: (2025)

When Do Neural Nets Outperform Boosted Trees on Tabular Data?
by: McElfresh, Duncan, et al.
Published: (2023)

When Less Is More: Binary Feedback Can Outperform Ordinal Comparisons in Ranking Recovery
by: Xu, Shirong, et al.
Published: (2025)

Natural Synthesis: Outperforming Reactive Synthesis Tools with Large Reasoning Models
by: Schmitt, Frederik, et al.
Published: (2026)

Challenging GPU Dominance: When CPUs Outperform for On-Device LLM Inference
by: Zhang, Haolin, et al.
Published: (2025)

Understanding When Poisson Log-Normal Models Outperform Penalized Poisson Regression for Microbiome Count Data
by: Agyapong, Daniel, et al.
Published: (2026)

Scaling Laws of SignSGD in Linear Regression: When Does It Outperform SGD?
by: Kim, Jihwan, et al.
Published: (2026)

SFT-then-RL Outperforms Mixed-Policy Methods for LLM Reasoning
by: Limozin, Alexis, et al.
Published: (2026)

Task-Specific Efficiency Analysis: When Small Language Models Outperform Large Language Models
by: Cao, Jinghan, et al.
Published: (2026)

When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning
by: Deng, Mengyi, et al.
Published: (2025)

Learned Feature Importance Scores for Automated Feature Engineering
by: Dong, Yihe, et al.
Published: (2024)

Is Random Attention Sufficient for Sequence Modeling? Disentangling Trainable Components in the Transformer
by: Dong, Yihe, et al.
Published: (2025)

Full-Batch Gradient Descent Outperforms One-Pass SGD: Sample Complexity Separation in Single-Index Learning
by: Kovačević, Filip, et al.
Published: (2026)

A Sample Efficient Conditional Independence Test in the Presence of Discretization
by: Sun, Boyang, et al.
Published: (2025)

PASS: Probabilistic Agentic Supernet Sampling for Interpretable and Adaptive Chest X-Ray Reasoning
by: Feng, Yushi, et al.
Published: (2025)

When Does Visual Prompting Outperform Linear Probing for Vision-Language Models? A Likelihood Perspective
by: Tsao, Hsi-Ai, et al.
Published: (2024)

Model Comparisons: XNet Outperforms KAN
by: Li, Xin, et al.
Published: (2024)

LANISTR: Multimodal Learning from Structured and Unstructured Data
by: Ebrahimi, Sayna, et al.
Published: (2023)

Neurosymbolic Reasoning Shortcuts under the Independence Assumption
by: van Krieken, Emile, et al.
Published: (2025)

COSTAR: Improved Temporal Counterfactual Estimation with Self-Supervised Learning
by: Meng, Chuizheng, et al.
Published: (2023)

On Size-Independent Sample Complexity of ReLU Networks
by: Sellke, Mark
Published: (2023)

RAGEN-2: Reasoning Collapse in Agentic RL
by: Wang, Zihan, et al.
Published: (2026)

Why Softmax Attention Outperforms Linear Attention
by: Deng, Yichuan, et al.
Published: (2023)

Finite-Sample Analysis of Nonlinear Independent Component Analysis:Sample Complexity and Identifiability Bounds
by: Jiang, Yuwen
Published: (2026)

Agentic Unlearning: When LLM Agent Meets Machine Unlearning
by: Wang, Bin, et al.
Published: (2026)

Can a Single Tree Outperform an Entire Forest?
by: Mao, Qiangqiang, et al.
Published: (2024)

Enhancing Neural Function Approximation: The XNet Outperforming KAN
by: Li, Xin, et al.
Published: (2025)

Adaptive Federated LoRA in Heterogeneous Wireless Networks with Independent Sampling
by: Hou, Yanzhao, et al.
Published: (2025)

When and Why SignSGD Outperforms SGD: A Theoretical Study Based on $\ell_1$-norm Lower Bounds
by: Tao, Hongyi, et al.
Published: (2026)

LightHGNN: Distilling Hypergraph Neural Networks into MLPs for $100\times$ Faster Inference
by: Feng, Yifan, et al.
Published: (2024)

LLMs Outperform Experts on Challenging Biology Benchmarks
by: Justen, Lennart
Published: (2025)