Cover Image

CAT: Curvature-Adaptive Transformers for Geometry-Aware Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lin, Ryan Y., Ojha, Siddhartha, Bai, Nicholas
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Bayesian Geometry of Transformer Attention
by: Agarwal, Naman, et al.
Published: (2025)

Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domains
by: Wen, Shizheng, et al.
Published: (2025)

Geometry-Aware Backdoor Attacks: Leveraging Curvature in Hyperbolic Embeddings
by: Baheri, Ali
Published: (2025)

Tri-Accel: Curvature-Aware Precision-Adaptive and Memory-Elastic Optimization for Efficient GPU Usage
by: Sheibanian, Mohsen, et al.
Published: (2025)

Mousse: Rectifying the Geometry of Muon with Curvature-Aware Preconditioning
by: Zhang, Yechen, et al.
Published: (2026)

Stepping on the Edge: Curvature Aware Learning Rate Tuners
by: Roulet, Vincent, et al.
Published: (2024)

CAT: Can Trust be Predicted with Context-Awareness in Dynamic Heterogeneous Networks?
by: Wang, Jie, et al.
Published: (2025)

BanditCAT and AutoIRT: Machine Learning Approaches to Computerized Adaptive Testing and Item Calibration
by: Sharpnack, James, et al.
Published: (2024)

Noise-Adaptive Layerwise Learning Rates: Accelerating Geometry-Aware Optimization for Deep Neural Network Training
by: Hao, Jie, et al.
Published: (2025)

Quantization of Ricci Curvature in Information Geometry
by: Rodriguez, Carlos C.
Published: (2026)

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training
by: Tabesh, Soroush, et al.
Published: (2025)

Towards a Certificate of Trust: Task-Aware OOD Detection for Scientific AI
by: Raonić, Bogdan, et al.
Published: (2025)

CAT: Circular-Convolutional Attention for Sub-Quadratic Transformers
by: Yamada, Yoshihiro
Published: (2025)

A Neural Tension Operator for Curve Subdivision across Constant Curvature Geometries
by: Ugail, Hassan, et al.
Published: (2026)

Geometry matters: insights from Ollivier Ricci Curvature and Ricci Flow into representational alignment through Ollivier-Ricci Curvature and Ricci Flow
by: Torbati, Nahid, et al.
Published: (2025)

Curvature-Aware Safety Restoration In LLMs Fine-Tuning
by: Bach, Thong, et al.
Published: (2025)

Learning Beyond Euclid: Curvature-Adaptive Generalization for Neural Networks on Manifolds
by: Sarkar, Krisanu
Published: (2025)

Backpropagation Neural Tree
by: Ojha, Varun, et al.
Published: (2022)

FedSPDnet: Geometry-Aware Federated Deep Learning with SPDnet
by: Pautrel, Thibault, et al.
Published: (2026)

Adaptive Discretization in Online Reinforcement Learning
by: Sinclair, Sean R., et al.
Published: (2021)

Geometric Mixture-of-Experts with Curvature-Guided Adaptive Routing for Graph Representation Learning
by: Cao, Haifang, et al.
Published: (2026)

Curvature-Aware PCA with Geodesic Tangent Space Aggregation for Semi-Supervised Learning
by: Levada, Alexandre L. M.
Published: (2026)

CurvaDion: Curvature-Adaptive Distributed Orthonormalization
by: Kumar, Bhavesh, et al.
Published: (2025)

Molecular De Novo Design through Transformer-based Reinforcement Learning
by: Xu, Pengcheng, et al.
Published: (2023)

Spectral-factorized Positive-definite Curvature Learning for NN Training
by: Lin, Wu, et al.
Published: (2025)

Contrast-CAT: Contrasting Activations for Enhanced Interpretability in Transformer-based Text Classifiers
by: Han, Sungmin, et al.
Published: (2025)

CAT: Interpretable Concept-based Taylor Additive Models
by: Duong, Viet, et al.
Published: (2024)

GeoTransolver: Learning Physics on Irregular Domains Using Multi-scale Geometry Aware Physics Attention Transformer
by: Adams, Corey, et al.
Published: (2025)

A Scalable Approach to Covariate and Concept Drift Management via Adaptive Data Segmentation
by: Yarabolu, Vennela, et al.
Published: (2024)

Integrating Locality-Aware Attention with Transformers for General Geometry PDEs
by: Koh, Minsu, et al.
Published: (2025)

MC-RFM: Geometry-Aware Few-Shot Adaptation via Mixed-Curvature Riemannian Flow Matching
by: Khazem, Salim, et al.
Published: (2026)

A Geometry-Aware Efficient Algorithm for Compositional Entropic Risk Minimization
by: Wei, Xiyuan, et al.
Published: (2026)

Geometry Adaptive Counterfactual Distribution Learning with Diffusion-Guided Smoothing
by: Kim, Kwangho
Published: (2026)

Quotient Geometry, Effective Curvature, and Implicit Bias in Simple Shallow Neural Networks
by: Dong, Hang-Cheng, et al.
Published: (2026)

Geometry-Aware Instrumental Variable Regression
by: Kremer, Heiner, et al.
Published: (2024)

Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization
by: Dong, Youran, et al.
Published: (2025)

Adaptive Sparse Möbius Transforms for Learning Polynomials
by: Erginbas, Yigit Efe, et al.
Published: (2026)

Robust Intervention Learning from Emergency Stop Interventions
by: Pronovost, Ethan, et al.
Published: (2026)

Why GRPO Needs Normalization: A Local-Curvature Perspective on Adaptive Gradients
by: Ge, Cheng, et al.
Published: (2026)

DECOLLAGE: 3D Detailization by Controllable, Localized, and Learned Geometry Enhancement
by: Chen, Qimin, et al.
Published: (2024)