Image de couverture de livre

Loss Patterns of Neural Networks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Skorokhodov, Ivan, Burtsev, Mikhail
Format:	Preprint
Publié:	2019
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Can Stationary Distributions of Scale-Invariant Neural Networks Be Described by the Thermodynamics of an Ideal Gas?
par: Sadrtdinov, Ildus, et autres
Publié: (2025)

Cramming 1568 Tokens into a Single Vector and Back Again: Exploring the Limits of Embedding Space Capacity
par: Kuratov, Yuri, et autres
Publié: (2025)

Associative Recurrent Memory Transformer
par: Rodkin, Ivan, et autres
Publié: (2024)

SRMT: Shared Memory for Multi-agent Lifelong Pathfinding
par: Sagirova, Alsu, et autres
Publié: (2025)

Wikontic: Constructing Wikidata-Aligned, Ontology-Aware Knowledge Graphs with Large Language Models
par: Chepurova, Alla, et autres
Publié: (2025)

Limitations of Normalization in Attention Mechanism
par: Mudarisov, Timur, et autres
Publié: (2025)

Scaling Transformer to 1M tokens and beyond with RMT
par: Bulatov, Aydar, et autres
Publié: (2023)

Contextual Bandit Optimization with Pre-Trained Neural Networks
par: Terekhov, Mikhail
Publié: (2025)

Loss Spike in Training Neural Networks
par: Li, Xiaolong, et autres
Publié: (2023)

In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss
par: Kuratov, Yuri, et autres
Publié: (2024)

Classification with Deep Neural Networks and Logistic Loss
par: Zhang, Zihan, et autres
Publié: (2023)

Disentangling the Causes of Plasticity Loss in Neural Networks
par: Lyle, Clare, et autres
Publié: (2024)

Neural Tangent Kernel of Neural Networks with Loss Informed by Differential Operators
par: Gan, Weiye, et autres
Publié: (2025)

Geometric Analysis of Token Selection in Multi-Head Attention
par: Mudarisov, Timur, et autres
Publié: (2026)

LossVal: Efficient Data Valuation for Neural Networks
par: Wibiral, Tim, et autres
Publié: (2024)

Visualization and Analysis of the Loss Landscape in Graph Neural Networks
par: Moustafa, Samir, et autres
Publié: (2025)

Neural Network Plasticity and Loss Sharpness
par: Koster, Max, et autres
Publié: (2024)

Loss Jump During Loss Switch in Solving PDEs with Neural Networks
par: Wang, Zhiwei, et autres
Publié: (2024)

A Quasi-Wasserstein Loss for Learning Graph Neural Networks
par: Cheng, Minjie, et autres
Publié: (2023)

Spectral Alignment as Predictor of Loss Explosion in Neural Network Training
par: Qiu, Haiquan, et autres
Publié: (2025)

Visualizing, Rethinking, and Mining the Loss Landscape of Deep Neural Networks
par: Xu, Yichu, et autres
Publié: (2024)

Loss-aware Curriculum Learning for Heterogeneous Graph Neural Networks
par: Wong, Zhen Hao, et autres
Publié: (2024)

Z-Error Loss for Training Neural Networks
par: Godin, Guillaume
Publié: (2025)

Physics-Informed Neural Networks: Minimizing Residual Loss with Wide Networks and Effective Activations
par: Dashtbayaz, Nima Hosseini, et autres
Publié: (2024)

Evaluating Loss Functions for Graph Neural Networks: Towards Pretraining and Generalization
par: Abbas, Khushnood, et autres
Publié: (2025)

Random Linear Projections Loss for Hyperplane-Based Optimization in Neural Networks
par: Venkatasubramanian, Shyam, et autres
Publié: (2023)

Convex Loss Functions for Support Vector Machines (SVMs) and Neural Networks
par: Portera, Filippo
Publié: (2026)

Per-Loss Adapters for Gradient Conflict in Physics-Informed Neural Networks
par: Kim, Bum Jun, et autres
Publié: (2026)

Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks
par: Bai, Zhiwei, et autres
Publié: (2022)

Fragmentation is Efficiently Learnable by Quantum Neural Networks
par: Mints, Mikhail, et autres
Publié: (2025)

Framework GNN-AID: Graph Neural Network Analysis Interpretation and Defense
par: Lukyanov, Kirill, et autres
Publié: (2025)

Online Neural Networks for Change-Point Detection
par: Hushchyn, Mikhail, et autres
Publié: (2020)

Learning Elementary Cellular Automata with Transformers
par: Burtsev, Mikhail
Publié: (2024)

On Multi-Stage Loss Dynamics in Neural Networks: Mechanisms of Plateau and Descent Stages
par: Chen, Zheng-An, et autres
Publié: (2024)

Jensen-Shannon Divergence Based Novel Loss Functions for Bayesian Neural Networks
par: Thiagarajan, Ponkrshnan, et autres
Publié: (2022)

Wave-RVFL: A Randomized Neural Network Based on Wave Loss Function
par: Sajid, M., et autres
Publié: (2024)

Towards Migrating Neural Network Implementations
par: Daoudi, Nadia, et autres
Publié: (2025)

Zero-Shot Neural Network Evaluation with Sample-Wise Activation Patterns
par: Peng, Yameng, et autres
Publié: (2026)

Learning to be Reproducible: Custom Loss Design for Robust Neural Networks
par: Ahmed, Waqas, et autres
Publié: (2026)

A Unified Theory of Quantum Neural Network Loss Landscapes
par: Anschuetz, Eric R.
Publié: (2024)