Cover Image

Low-Dimension-to-High-Dimension Generalization And Its Implications for Length Generalization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Yang, Yang, Long, Liang, Yitao, Lin, Zhouchen
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the Limitations and Capabilities of Position Embeddings for Length Generalization
by: Chen, Yang, et al.
Published: (2025)

DIGIC: Domain Generalizable Imitation Learning by Causal Discovery
by: Chen, Yang, et al.
Published: (2024)

Understanding Generalization from Embedding Dimension and Distributional Convergence
by: Yu, Junjie, et al.
Published: (2026)

General Loss Functions Lead to (Approximate) Interpolation in High Dimensions
by: Lai, Kuo-Wei, et al.
Published: (2023)

Golden Ratio-Based Sufficient Dimension Reduction
by: Yang, Wenjing, et al.
Published: (2024)

On the Statistical Properties of Generative Adversarial Models for Low Intrinsic Data Dimension
by: Chakraborty, Saptarshi, et al.
Published: (2024)

Stochastic Dimension-Free Zeroth-Order Estimator for High-Dimensional and High-Order PINNs
by: Liang, Zhangyong, et al.
Published: (2026)

To Clip or not to Clip: the Dynamics of SGD with Gradient Clipping in High-Dimensions
by: Marshall, Noah, et al.
Published: (2024)

Scalable Importance Sampling in High Dimensions with Low-Rank Mixture Proposals
by: Kruse, Liam A., et al.
Published: (2025)

On Conditional Stochastic Interpolation for Generative Nonlinear Sufficient Dimension Reduction
by: Xu, Shuntuo, et al.
Published: (2025)

Asymptotics of Non-Convex Generalized Linear Models in High-Dimensions: A proof of the replica formula
by: Vilucchio, Matteo, et al.
Published: (2025)

Dimension-Free Saddle-Point Escape in Muon
by: Long, Yanlin, et al.
Published: (2026)

The Rank-Reduced Kalman Filter: Approximate Dynamical-Low-Rank Filtering In High Dimensions
by: Schmidt, Jonathan, et al.
Published: (2023)

Relational Learning in Pre-Trained Models: A Theory from Hypergraph Recovery Perspective
by: Chen, Yang, et al.
Published: (2024)

Sparse Semantic Dimension as a Generalization Certificate for LLMs
by: Bandyopadhyay, Dibyanayan, et al.
Published: (2026)

On Leveraging Unlabeled Data for Concurrent Positive-Unlabeled Classification and Robust Generation
by: Yu, Bing, et al.
Published: (2020)

Generalized Robust Adaptive-Bandwidth Multi-View Manifold Learning in High Dimensions with Noise
by: Ding, Xiucai, et al.
Published: (2026)

On the Limitations of Fractal Dimension as a Measure of Generalization
by: Tan, Charlie B., et al.
Published: (2024)

Stochastic-Dimension Frozen Sampled Neural Network for High-Dimensional Gross-Pitaevskii Equations on Unbounded Domains
by: Liang, Zhangyong
Published: (2026)

Local Intrinsic Dimension of Representations Predicts Alignment and Generalization in AI Models and Human Brain
by: Yu, Junjie, et al.
Published: (2026)

Stochastic Dimension Implicit Functional Projections for Exact Integral Conservation in High-Dimensional PINNs
by: Liang, Zhangyong
Published: (2026)

The No-Clash Teaching Dimension is Bounded by VC Dimension
by: Liu, Jiahua, et al.
Published: (2026)

Convergence of Unadjusted Langevin in High Dimensions: Delocalization of Bias
by: Chen, Yifan, et al.
Published: (2024)

The Dimension Strikes Back with Gradients: Generalization of Gradient Methods in Stochastic Convex Optimization
by: Schliserman, Matan, et al.
Published: (2024)

Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization
by: Li, Huan, et al.
Published: (2021)

Dimension Mixer: Group Mixing of Input Dimensions for Efficient Function Approximation
by: Sapkota, Suman, et al.
Published: (2023)

TeZO: Empowering the Low-Rankness on the Temporal Dimension in the Zeroth-Order Optimization for Fine-tuning LLMs
by: Sun, Yan, et al.
Published: (2025)

Vanilla Bayesian Optimization Performs Great in High Dimensions
by: Hvarfner, Carl, et al.
Published: (2024)

Pruning is Optimal for Learning Sparse Features in High-Dimensions
by: Vural, Nuri Mert, et al.
Published: (2024)

Rethinking Trust Region Bayesian Optimization in High Dimensions
by: Tang, Wei-Ting, et al.
Published: (2026)

An Observation on Lloyd's k-Means Algorithm in High Dimensions
by: Silva-Sánchez, David, et al.
Published: (2025)

Bridging Dimensions: Confident Reachability for High-Dimensional Controllers
by: Geng, Yuang, et al.
Published: (2023)

Smoothed Analysis for Learning Concepts with Low Intrinsic Dimension
by: Chandrasekaran, Gautam, et al.
Published: (2024)

Invariant Kernels: Rank Stabilization and Generalization Across Dimensions
by: Díaz, Mateo, et al.
Published: (2025)

Sandwiching Polynomials for Geometric Concepts with Low Intrinsic Dimension
by: Klivans, Adam R., et al.
Published: (2026)

On the Saturation Effects of Spectral Algorithms in Large Dimensions
by: Lu, Weihao, et al.
Published: (2025)

Dimension-free Private Mean Estimation for Anisotropic Distributions
by: Dagan, Yuval, et al.
Published: (2024)

Federated Learning with Unlabeled Clients: Personalization Can Happen in Low Dimensions
by: Zakerinia, Hossein, et al.
Published: (2025)

Exact Risk Curves of signSGD in High-Dimensions: Quantifying Preconditioning and Noise-Compression Effects
by: Xiao, Ke Liang, et al.
Published: (2024)

Non-Asymptotic Length Generalization
by: Chen, Thomas, et al.
Published: (2025)