Cover Image

The Geometric Wall: Manifold Structure Predicts Layerwise Sparse Autoencoder Scaling Laws

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zaher, Eslam, Trzaskowski, Maciej, Nguyen, Quan, Roosta, Fred
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Differential Geometry
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Manifold Integrated Gradients: Riemannian Geometry for Feature Attribution
by: Zaher, Eslam, et al.
Published: (2024)

Counterfactual Explanations on Robust Perceptual Geodesics
by: Zaher, Eslam, et al.
Published: (2026)

Pullback Flow Matching on Data Manifolds
by: de Kruiff, Friso, et al.
Published: (2024)

Radial Compensation: Fixing Radius Distortion in Chart-Based Generative Models on Riemannian Manifolds
by: Papamichalis, Marios, et al.
Published: (2025)

Geometry-Aware Generative Autoencoders for Warped Riemannian Metric Learning and Generative Modeling on Data Manifolds
by: Sun, Xingzhi, et al.
Published: (2024)

Learning with Confidence
by: Richardson, Oliver Ethan
Published: (2025)

Tensor Gauge Flow Models
by: Strunk, Alexander, et al.
Published: (2025)

Gauge Flow Models
by: Strunk, Alexander, et al.
Published: (2025)

Higher Gauge Flow Models
by: Strunk, Alexander, et al.
Published: (2025)

Carré du champ flow matching: better quality-generalisation tradeoff in generative models
by: Bamberger, Jacob, et al.
Published: (2025)

Space filling positionality and the Spiroformer
by: Maurin, M., et al.
Published: (2025)

Geometry-aware similarity metrics for neural representations on Riemannian and statistical manifolds
by: Cayco-Gajic, N Alex, et al.
Published: (2026)

Variational Geometry-aware Neural Network based Method for Solving High-dimensional Diffeomorphic Mapping Problems
by: Li, Zhiwen, et al.
Published: (2025)

Sum-of-Squares Programming for Ma-Trudinger-Wang Regularity of Optimal Transport Maps
by: Shivakumar, Sachin, et al.
Published: (2024)

Disentanglement Learning via Topology
by: Balabin, Nikita, et al.
Published: (2023)

Distance Measure Based on an Embedding of the Manifold of K-Component Gaussian Mixture Models into the Manifold of Symmetric Positive Definite Matrices
by: Vishwakarma, Amit, et al.
Published: (2025)

Staying on the Manifold: Geometry-Aware Noise Injection
by: Jacobsen, Albert Kjøller, et al.
Published: (2025)

Aligning the Unseen in Attributed Graphs: Interplay between Graph Geometry and Node Attributes Manifold
by: Labarthe, Aldric, et al.
Published: (2026)

Hardness of Learning Neural Networks under the Manifold Hypothesis
by: Kiani, Bobak T., et al.
Published: (2024)

Discretized Gradient Flow for Manifold Learning in the Space of Embeddings
by: Gold, Dara, et al.
Published: (2019)

Exploring the Stratified Space Structure of an RL Game with the Volume Growth Transform
by: Curry, Justin, et al.
Published: (2025)

Thinner Latent Spaces: Detecting Dimension and Imposing Invariance with Conformal Autoencoders
by: Kevrekidis, George A., et al.
Published: (2024)

Learning Beyond Euclid: Curvature-Adaptive Generalization for Neural Networks on Manifolds
by: Sarkar, Krisanu
Published: (2025)

Manifold Learning with Normalizing Flows: Towards Regularity, Expressivity and Iso-Riemannian Geometry
by: Diepeveen, Willem, et al.
Published: (2025)

Geometric Learning with Positively Decomposable Kernels
by: Da Costa, Nathael, et al.
Published: (2023)

Score-based Pullback Riemannian Geometry: Extracting the Data Manifold Geometry using Anisotropic Flows
by: Diepeveen, Willem, et al.
Published: (2024)

Geometric and Spectral Alignment for Deep Neural Network I
by: Liu, Ziran, et al.
Published: (2026)

Geometric and Spectral Alignment for Deep Neural Network II
by: Liu, Ziran, et al.
Published: (2026)

Logifold: A Geometrical Foundation of Ensemble Machine Learning
by: Jung, Inkee, et al.
Published: (2024)

Riemannian Integrated Gradients: A Geometric View of Explainable AI
by: Costanza, Federico, et al.
Published: (2025)

Fiber Bundle Networks: A Geometric Machine Learning Paradigm
by: Liu, Dong
Published: (2025)

Jet Functors and Weil Algebras in Automatic Differentiation: A Geometric Analysis
by: Sangha, Amandip
Published: (2025)

TopoGeoScore: A Self-Supervised Source-Only Geometric Framework for OOD Checkpoint Selection
by: Hazratian, Farid, et al.
Published: (2026)

Chernoff Bounds for Tensor Expanders on Riemannian Manifolds Using Graph Laplacian Approximation
by: Chang, Shih-Yu
Published: (2024)

Surrogate-Based Differentiable Pipeline for Shape Optimization
by: Rehmann, Andrin, et al.
Published: (2025)

RETR: Multi-View Radar Detection Transformer for Indoor Perception
by: Yataka, Ryoma, et al.
Published: (2024)

Geometric Contact Flows: Contactomorphisms for Dynamics and Control
by: Testa, Andrea, et al.
Published: (2025)

Recovering Manifold Structure Using Ollivier-Ricci Curvature
by: Saidi, Tristan Luca, et al.
Published: (2024)

Importance Sampling for Nonlinear Models
by: Rajmohan, Prakash Palanivelu, et al.
Published: (2025)

GeoHNNs: Geometric Hamiltonian Neural Networks
by: Aboussalah, Amine Mohamed, et al.
Published: (2025)