Imagen de Portada

Structured First-Layer Initialization Pre-Training Techniques to Accelerate Training Process Based on $\varepsilon$-Rank

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Tang, Tao, Yang, Jiang, Zhao, Yuxiang, Zhu, Quanhui
Formato:	Preprint
Publicado:	2025
Materias:	Numerical Analysis
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

$ε$-rank and the Staircase Phenomenon: New Insights into Neural Network Training Dynamics
por: Yang, Jiang, et al.
Publicado: (2024)

Energy Dissipation Preserving Feature-based DNN Galerkin Methods for Gradient Flows
por: Tang, Tao, et al.
Publicado: (2026)

Provable Low-Rank Tensor-Train Approximations in the Inverse of Large-Scale Structured Matrices
por: Xiao, Chuanfu, et al.
Publicado: (2025)

Quantifying Training Difficulty and Accelerating Convergence in Neural Network-Based PDE Solvers
por: Chen, Chuqi, et al.
Publicado: (2024)

Convergence Guarantees for Gradient-Based Training of Neural PDE Solvers: From Linear to Nonlinear PDEs
por: Zhao, Wei, et al.
Publicado: (2025)

Stability in Training PINNs for Stiff PDEs: Why Initial Conditions Matter
por: Hao, Baoli, et al.
Publicado: (2024)

Mixture-of-Experts Operator Transformer for Large-Scale PDE Pre-Training
por: Wang, Hong, et al.
Publicado: (2025)

Local Interpolation via Low-Rank Tensor Trains
por: Guzman, Siddhartha E., et al.
Publicado: (2026)

Reducing Training Complexity in Empirical Quadrature-Based Model Reduction via Structured Compression
por: Liljegren-Sailer, Björn
Publicado: (2025)

lrAA: Low-Rank Anderson Acceleration
por: Appelo, Daniel, et al.
Publicado: (2025)

Cross Interpolation for Solving High-Dimensional Dynamical Systems on Low-Rank Tucker and Tensor Train Manifolds
por: Ghahremani, Behzad, et al.
Publicado: (2024)

Kolmogorov $\varepsilon$-entropy of numerical solutions for scalar conservation laws with convex flux
por: Ancona, Fabio, et al.
Publicado: (2026)

Generative Feature Training of Thin 2-Layer Networks
por: Hertrich, Johannes, et al.
Publicado: (2024)

Numerical Analysis of Simultaneous Reconstruction of Initial Condition and Potential in Subdiffusion
por: Wu, Xu, et al.
Publicado: (2025)

DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training
por: Hao, Zhongkai, et al.
Publicado: (2024)

Energy diminishing implicit-explicit Runge--Kutta methods for gradient flows
por: Fu, Zhaohui, et al.
Publicado: (2022)

On the importance of the $\varepsilon$-regularization of the distribution-dependent Mumford-Shah model for hyperspectral image segmentation
por: Cohrs, Jan-Christopher, et al.
Publicado: (2024)

Energy Approach from $\varepsilon$-Graph to Continuum Diffusion Model with Connectivity Functional
por: Yang, Yahong, et al.
Publicado: (2025)

Convergence Acceleration Techniques
por: Jentschura, U. D., et al.
Publicado: (2002)

HiPhom$\varepsilon$ -: HIgh order Projection-based HOMogenisation for advection diffusion reaction problems
por: Conni, Giovanni, et al.
Publicado: (2023)

An Augmented Backward-Corrected Projector Splitting Integrator for Dynamical Low-Rank Training
por: Kusch, Jonas, et al.
Publicado: (2025)

An Efficient and Robust Projection Enhanced Interpolation Based Tensor Train Decomposition
por: Hayes, Daniel, et al.
Publicado: (2026)

CUR Low Rank Approximation of a Matrix at Sublinear Cost
por: Go, Soo, et al.
Publicado: (2019)

Stabilizing Physics-Informed Consistency Models via Structure-Preserving Training
por: Chang, Che-Chia, et al.
Publicado: (2026)

Tucker Tensor Train Taylor Series
por: Alger, Nick, et al.
Publicado: (2026)

NLTGCR: A class of Nonlinear Acceleration Procedures based on Conjugate Residuals
por: He, Huan, et al.
Publicado: (2023)

DMIS: Dynamic Mesh-based Importance Sampling for Training Physics-Informed Neural Networks
por: Yang, Zijiang, et al.
Publicado: (2022)

Reinforcement Learning-Based Filters for Convection-Dominated Flows: Reference-Free and Reference-Guided Training
por: Ivagnes, Anna, et al.
Publicado: (2026)

An Inexact Low-Rank Source Iteration for Steady-State Radiative Transfer Equation with Diffusion Synthetic Acceleration
por: Guo, Wei, et al.
Publicado: (2025)

An Accelerated Newton-GMRES Method for Multilinear PageRank
por: Boubekraoui, Maryam, et al.
Publicado: (2025)

Dynamical Tensor Train Approximation for Kinetic Equations
por: Wang, Geshuo, et al.
Publicado: (2025)

Sequential Minimal Optimization for $\varepsilon$-SVR with MAPE Loss and Sample-Dependent Box Constraints
por: Benavides-Herrera, Pablo, et al.
Publicado: (2026)

Superfast Low Rank Approximation
por: Go, Soo, et al.
Publicado: (2018)

WinQ: Accelerating Quantization-Aware Training of Language Models Around Saddle Points
por: Li, Dongyue, et al.
Publicado: (2026)

openCFS-Data: Data Pre-Post-Processing Tool for openCFS
por: Schoder, Stefan, et al.
Publicado: (2023)

Low Rank Approximation at Sublinear Cost
por: Luan, Qi, et al.
Publicado: (2019)

Accelerated Kaczmarz methods via randomized sketch techniques for solving consistent linear systems
por: Jiang, Haochen, et al.
Publicado: (2025)

A Tensor Train-Based Isogeometric Solver for Large-Scale 3D Poisson Problems on Complex Geometries
por: Tran, Quoc Thai, et al.
Publicado: (2025)

Training with Fewer Bits: Unlocking Edge LLMs Training with Stochastic Rounding
por: Liu, Taowen, et al.
Publicado: (2025)

The Tensor-Train Stochastic Finite Volume Method for Uncertainty Quantification
por: Walton, Steven, et al.
Publicado: (2024)