Cover Image

Connecting Independently Trained Modes via Layer-Wise Connectivity

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tian, Yongding, Al-Ars, Zaid, Kitsak, Maksim, Hofstee, Peter
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Vanishing Variance Problem in Fully Decentralized Neural-Network Systems
by: Tian, Yongding, et al.
Published: (2024)

Tywaves: A Typed Waveform Viewer for Chisel
by: Meloni, Raffaele, et al.
Published: (2024)

Layer-wise Linear Mode Connectivity
by: Adilova, Linara, et al.
Published: (2023)

NASH: Neural Architecture Search for Hardware-Optimized Machine Learning Models
by: Ji, Mengfei, et al.
Published: (2024)

NLICE: Synthetic Medical Record Generation for Effective Primary Healthcare Differential Diagnosis
by: Al-Ars, Zaid, et al.
Published: (2024)

Landscaping Linear Mode Connectivity
by: Singh, Sidak Pal, et al.
Published: (2024)

Understanding Mode Connectivity via Parameter Space Symmetry
by: Zhao, Bo, et al.
Published: (2025)

Generalized Linear Mode Connectivity for Transformers
by: Theus, Alexander, et al.
Published: (2025)

Proving Linear Mode Connectivity of Neural Networks via Optimal Transport
by: Ferbach, Damien, et al.
Published: (2023)

On Linear Mode Connectivity of Mixture-of-Experts Architectures
by: Tran, Viet-Hoang, et al.
Published: (2025)

Linear Mode Connectivity in Differentiable Tree Ensembles
by: Kanoh, Ryuichi, et al.
Published: (2024)

Leveraging Apache Arrow for Zero-copy, Zero-serialization Cluster Shared Memory
by: Groet, Philip, et al.
Published: (2024)

Analyzing the Role of Permutation Invariance in Linear Mode Connectivity
by: Zhan, Keyao, et al.
Published: (2025)

Unveiling Mode Connectivity in Graph Neural Networks
by: Li, Bingheng, et al.
Published: (2025)

Linear Mode Connectivity in Sparse Neural Networks
by: McDermott, Luke, et al.
Published: (2023)

Federated Learning over Connected Modes
by: Grinwald, Dennis, et al.
Published: (2024)

Mode Connectivity in Auction Design
by: Hertrich, Christoph, et al.
Published: (2023)

Adaptive Layer-Wise Transformations for Post-Training Quantization of Large Language Models
by: Pham, Cuong, et al.
Published: (2025)

Quantization Error Propagation: Revisiting Layer-Wise Post-Training Quantization
by: Arai, Yamato, et al.
Published: (2025)

SABER: Uncovering Vulnerabilities in Safety Alignment via Cross-Layer Residual Connection
by: Joshi, Maithili, et al.
Published: (2025)

Linear Mode Connectivity under Data Shifts for Deep Ensembles of Image Classifiers
by: Hepburn, C., et al.
Published: (2025)

Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods
by: Ito, Akira, et al.
Published: (2024)

A Five-Layer MLOps Architecture for Connected Automated Driving
by: Lampe, Bastian, et al.
Published: (2026)

Impact of Bottleneck Layers and Skip Connections on the Generalization of Linear Denoising Autoencoders
by: Ham, Jonghyun, et al.
Published: (2025)

Always-Sparse Training by Growing Connections with Guided Stochastic Exploration
by: Heddes, Mike, et al.
Published: (2024)

Do We Really Need Permutations? Impact of Model Width on Linear Mode Connectivity
by: Ito, Akira, et al.
Published: (2025)

Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification
by: ElNokrashy, Muhammad, et al.
Published: (2022)

Layer-Wise High-Impact Parameter Ratio Optimization in Post-Training Quantization for Large Language Models
by: Pham, Cuong, et al.
Published: (2025)

Optimizer-Induced Mode Connectivity: From AdamW to Muon
by: Zhang, Fangzhao, et al.
Published: (2026)

Input Space Mode Connectivity in Deep Neural Networks
by: Vrabel, Jakub, et al.
Published: (2024)

The Optical and Infrared Are Connected
by: Jespersen, Christian K., et al.
Published: (2025)

Towards Layer-Wise Personalized Federated Learning: Adaptive Layer Disentanglement via Conflicting Gradients
by: Nguyen, Minh Duong, et al.
Published: (2024)

From Players to Champions: A Generalizable Machine Learning Approach for Match Outcome Prediction with Insights from the FIFA World Cup
by: Al-Bustami, Ali, et al.
Published: (2025)

TEON: Tensorized Orthonormalization Beyond Layer-Wise Muon for Large Language Model Pre-Training
by: Zhang, Ruijie, et al.
Published: (2026)

Turbo Connection: Reasoning as Information Flow from Higher to Lower Layers
by: Tang, Mohan, et al.
Published: (2026)

The Diffusion-Attention Connection
by: Candanedo, Julio
Published: (2026)

Fine-Grained Classification: Connecting Metadata via Cross-Contrastive Pre-Training
by: Mamtani, Sumit, et al.
Published: (2025)

Connecting the Dots: Is Mode-Connectedness the Key to Feasible Sample-Based Inference in Bayesian Neural Networks?
by: Sommer, Emanuel, et al.
Published: (2024)

Entropic Confinement and Mode Connectivity in Overparameterized Neural Networks
by: Di Carlo, Luca, et al.
Published: (2025)

Understanding Machine Unlearning Through the Lens of Mode Connectivity
by: Cheng, Jiali, et al.
Published: (2025)