Cover Image

Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Yuxin, Hu, Yuanzhe, Zhong, Xiaokun, Wang, Xiaopeng, Lu, Haiquan, Pang, Tianyu, Mahoney, Michael W., Yan, Yujun, Ren, Pu, Yang, Yaoqing
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Computational Physics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SciML Agents: Write the Solver, Not the Solution
by: Gaonkar, Saarth, et al.
Published: (2025)

Introduction to optimization methods for training SciML models
by: Kopaničáková, Alena, et al.
Published: (2026)

Model Balancing Helps Low-data Training and Fine-tuning
by: Liu, Zihang, et al.
Published: (2024)

Position: Optimization in SciML Should Employ the Function Space Geometry
by: Müller, Johannes, et al.
Published: (2024)

Data-Efficient Inference of Neural Fluid Fields via SciML Foundation Model
by: Liu, Yuqiu, et al.
Published: (2024)

MPFBench: A Large Scale Dataset for SciML of Multi-Phase-Flows: Droplet and Bubble Dynamics
by: Shadkhah, Mehdi, et al.
Published: (2025)

LUMOS: Democratizing SciML Workflows with L0-Regularized Learning for Unified Feature and Parameter Adaptation
by: Gao, Shouwei, et al.
Published: (2026)

Iterative Refinement Neural Operators are Learned Fixed-Point Solvers: A Principled Approach to Spectral Bias Mitigation
by: Liu, Xiaotian, et al.
Published: (2026)

A Three-regime Model of Network Pruning
by: Zhou, Yefan, et al.
Published: (2023)

From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks
by: Kothapalli, Vignesh, et al.
Published: (2024)

AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models
by: Lu, Haiquan, et al.
Published: (2024)

Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance
by: Lu, Haiquan, et al.
Published: (2024)

RL4RLA: Teaching ML to Discover Randomized Linear Algebra Algorithms Through Curriculum Design and Graph-Based Search
by: Xiong, Jinglong, et al.
Published: (2026)

Eigenspectrum Analysis of Neural Networks without Aspect Ratio Bias
by: Hu, Yuanzhe, et al.
Published: (2025)

Balancing Learning Rates Across Layers: Exact Two-Step Dynamics and Optimal Scaling in Linear Neural Networks
by: Pang, Tianyu, et al.
Published: (2026)

Depth, Not Data: An Analysis of Hessian Spectral Bifurcation
by: Deng, Shenyang, et al.
Published: (2026)

Spectral Insights into Data-Oblivious Critical Layers in Large Language Models
by: Liu, Xuyuan, et al.
Published: (2025)

Quantile Activation: Correcting a Failure Mode of ML Models
by: Challa, Aditya, et al.
Published: (2024)

Learning to Discover Iterative Spectral Algorithms
by: Liu, Zihang, et al.
Published: (2026)

A Model Zoo on Phase Transitions in Neural Networks
by: Schürholt, Konstantin, et al.
Published: (2025)

Suspicious Alignment of SGD: A Fine-Grained Step Size Condition Analysis
by: Deng, Shenyang, et al.
Published: (2026)

MixReasoning: Switching Modes to Think
by: Lu, Haiquan, et al.
Published: (2025)

RMNP: Row-Momentum Normalized Preconditioning for Scalable Matrix-Based Optimization
by: Deng, Shenyang, et al.
Published: (2026)

HTMuon: Improving Muon via Heavy-Tailed Spectral Correction
by: Pang, Tianyu, et al.
Published: (2026)

Experimental Analysis of Rainfall‐Induced Instability and Failure Patterns in Loess Fill Slopes
by: Jinlian Ma, et al.
Published: (2025)

Model Inversion: A Failure Mode Distinct from Model Collapse in Self-Modifying AI Systems
by: Adversa LCC, et al.
Published: (2026)

No Two Devils Alike: Unveiling Distinct Mechanisms of Fine-tuning Attacks
by: Leong, Chak Tou, et al.
Published: (2024)

Superpose Task-specific Features for Model Merging
by: Qiu, Haiquan, et al.
Published: (2025)

A Soft Wearable Modular Assistive Glove Based on Novel Miniature Foldable Pouch Motor Unit
by: Tianyu Zhang, et al.
Published: (2025)

Thermodynamic formalism for non-uniform systems with controlled specification and entropy expansiveness
by: Wang, Tianyu, et al.
Published: (2025)

Unveiling Chain of Step Reasoning for Vision-Language Models with Fine-grained Rewards
by: Chen, Honghao, et al.
Published: (2025)

Knowledge-Refined Dual Context-Aware Network for Partially Relevant Video Retrieval
by: Yang, Junkai, et al.
Published: (2026)

Unveiling the Potential of Diffusion Large Language Model in Controllable Generation
by: Xiong, Zhen, et al.
Published: (2025)

Mathematical Proof as a Litmus Test: Revealing Failure Modes of Advanced Large Reasoning Models
by: Guo, Dadi, et al.
Published: (2025)

LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning
by: Liu, Zihang, et al.
Published: (2025)

Chapter 12 Economising Failure and Assembling a Failure Regime
by: Kurunmäki, Liisa, et al.
Published: (2023)

Lonely Individuals Show Distinct Patterns of Social Media Engagement
by: Wang, Yajing, et al.
Published: (2025)

From the Termination of Brute Force Numerical Accumulation Computing to a Paradigm Shift toward Topological Quantum Relaxation Physical Computing: An Empirical Investigation of 10⁸ Level 8D Computing Power Enhancement on the RTX 2070
by: Li, Haiquan
Published: (2025)

Lost in Diffusion: Uncovering Hallucination Patterns and Failure Modes in Diffusion Large Language Models
by: Guo, Zhengnan, et al.
Published: (2026)

The Study on Shell‐Breaking Characteristics and Crack Formation Patterns of Walnuts ( Juglans Sigillata D.) Under Static Loading
by: Tianyu Zhang, et al.
Published: (2025)