Cover Image

Understanding Mode Connectivity via Parameter Space Symmetry

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhao, Bo, Dehmamy, Nima, Walters, Robin, Yu, Rose
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Latent Space Symmetry Discovery
by: Yang, Jianke, et al.
Published: (2023)

Symmetry-Informed Governing Equation Discovery
by: Yang, Jianke, et al.
Published: (2024)

Symmetry in Neural Network Parameter Spaces
by: Zhao, Bo, et al.
Published: (2025)

AtlasD: Automatic Local Symmetry Discovery
by: Bhat, Manu, et al.
Published: (2025)

Discovering Symbolic Differential Equations with Symmetry Invariants
by: Yang, Jianke, et al.
Published: (2025)

Improving Convergence and Generalization Using Parameter Symmetries
by: Zhao, Bo, et al.
Published: (2023)

Improving Learning to Optimize Using Parameter Symmetries
by: Zamir, Guy, et al.
Published: (2025)

The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof
by: Lim, Derek, et al.
Published: (2024)

NRGPT: An Energy-based Alternative for GPT
by: Dehmamy, Nima, et al.
Published: (2025)

To Augment or Not to Augment? Diagnosing Distributional Symmetry Breaking
by: Lawrence, Hannah, et al.
Published: (2025)

Discovering Symmetry Breaking in Physical Systems with Relaxed Group Convolution
by: Wang, Rui, et al.
Published: (2023)

Understanding the Difficulty of Solving Cauchy Problems with PINNs
by: Wang, Tao, et al.
Published: (2024)

A Survey of Weight Space Learning: Understanding, Representation, and Generation
by: Han, Xiaolong, et al.
Published: (2026)

Connecting Independently Trained Modes via Layer-Wise Connectivity
by: Tian, Yongding, et al.
Published: (2025)

Circumventing Backdoor Space via Weight Symmetry
by: Peng, Jie, et al.
Published: (2025)

Small Models, Smarter Learning: The Power of Joint Task Training
by: Both, Csaba, et al.
Published: (2025)

Can LLMs Understand Time Series Anomalies?
by: Zhou, Zihao, et al.
Published: (2024)

Landscaping Linear Mode Connectivity
by: Singh, Sidak Pal, et al.
Published: (2024)

Proving Linear Mode Connectivity of Neural Networks via Optimal Transport
by: Ferbach, Damien, et al.
Published: (2023)

Input Space Mode Connectivity in Deep Neural Networks
by: Vrabel, Jakub, et al.
Published: (2024)

Leveraging Parameter Space Symmetries for Reasoning Skill Transfer in LLMs
by: Horoi, Stefan, et al.
Published: (2025)

Relaxed Equivariant Graph Neural Networks
by: Hofgard, Elyssa, et al.
Published: (2024)

Generalized Linear Mode Connectivity for Transformers
by: Theus, Alexander, et al.
Published: (2025)

Layer-wise Linear Mode Connectivity
by: Adilova, Linara, et al.
Published: (2023)

Understanding Machine Unlearning Through the Lens of Mode Connectivity
by: Cheng, Jiali, et al.
Published: (2025)

On Linear Mode Connectivity of Mixture-of-Experts Architectures
by: Tran, Viet-Hoang, et al.
Published: (2025)

Linear Mode Connectivity in Differentiable Tree Ensembles
by: Kanoh, Ryuichi, et al.
Published: (2024)

Analyzing the Role of Permutation Invariance in Linear Mode Connectivity
by: Zhan, Keyao, et al.
Published: (2025)

On Uncertainty Calibration for Equivariant Functions
by: Berman, Edward, et al.
Published: (2025)

On Universality of Deep Equivariant Networks
by: Pacini, Marco, et al.
Published: (2025)

Reducing the Sensitivity of Neural Physics Simulators to Mesh Topology via Pretraining
by: Vaska, Nathan, et al.
Published: (2025)

ParamReL: Learning Parameter Space Representation via Progressively Encoding Bayesian Flow Networks
by: Wu, Zhangkai, et al.
Published: (2024)

Unveiling Mode Connectivity in Graph Neural Networks
by: Li, Bingheng, et al.
Published: (2025)

Linear Mode Connectivity in Sparse Neural Networks
by: McDermott, Luke, et al.
Published: (2023)

Smoothness Errors in Dynamics Models and How to Avoid Them
by: Berman, Edward, et al.
Published: (2026)

Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods
by: Ito, Akira, et al.
Published: (2024)

MatrixNet: Learning over symmetry groups using learned group representations
by: Laird, Lucas, et al.
Published: (2025)

Federated Learning over Connected Modes
by: Grinwald, Dennis, et al.
Published: (2024)

DeepWeightFlow: Re-Basined Flow Matching for Generating Neural Network Weights
by: Gupta, Saumya, et al.
Published: (2026)

Understanding Hallucinations in Diffusion Models through Mode Interpolation
by: Aithal, Sumukh K, et al.
Published: (2024)