Cover Image

An overview of condensation phenomenon in deep learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Zhi-Qin John, Zhang, Yaoyu, Zhou, Zhangchen
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A rationale from frequency perspective for grokking in training neural network
by: Zhou, Zhangchen, et al.
Published: (2024)

Overview frequency principle/spectral bias in deep learning
by: Xu, Zhi-Qin John, et al.
Published: (2022)

Adaptive Preconditioners Trigger Loss Spikes in Adam
by: Bai, Zhiwei, et al.
Published: (2025)

Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks
by: Bai, Zhiwei, et al.
Published: (2022)

Understanding the Language Model to Solve the Symbolic Multi-Step Reasoning Problem from the Perspective of Buffer Mechanism
by: Wang, Zhiwei, et al.
Published: (2024)

Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing
by: Zhang, Zhongwang, et al.
Published: (2024)

Anchor function: a type of benchmark functions for studying language models
by: Zhang, Zhongwang, et al.
Published: (2024)

Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers
by: Zhang, Zhongwang, et al.
Published: (2025)

Phase Diagram of Initial Condensation for Two-layer Neural Networks
by: Chen, Zhengan, et al.
Published: (2023)

Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks
by: Xu, Zhi-Qin John, et al.
Published: (2019)

Scalable Complexity Control Facilitates Reasoning Ability of LLMs
by: Hang, Liangkai, et al.
Published: (2025)

An approach of deep reinforcement learning for maximizing the net present value of stochastic projects
by: Xu, Wei, et al.
Published: (2025)

Embedding principle of homogeneous neural network for classification problem
by: Zhang, Jiahan, et al.
Published: (2025)

Uncovering Critical Sets of Deep Neural Networks via Sample-Independent Critical Lifting
by: Zhang, Leyang, et al.
Published: (2025)

Probability Signature: Bridging Data Semantics and Embedding Structure in Language Models
by: Yao, Junjie, et al.
Published: (2025)

KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Coding
by: Xu, Zhangchen, et al.
Published: (2025)

Efficient and Flexible Method for Reducing Moderate-size Deep Neural Networks with Condensation
by: Chen, Tianyi, et al.
Published: (2024)

Loss Spike in Training Neural Networks
by: Li, Xiaolong, et al.
Published: (2023)

Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion
by: Bai, Zhiwei, et al.
Published: (2024)

Disentangle Sample Size and Initialization Effect on Perfect Generalization for Single-Neuron Target
by: Zhao, Jiajie, et al.
Published: (2024)

Understanding Time Series Anomaly State Detection through One-Class Classification
by: Zhou, Hanxu, et al.
Published: (2024)

Generalization analysis with deep ReLU networks for metric and similarity learning
by: Zhou, Junyu, et al.
Published: (2024)

Local Linear Recovery Guarantee of Deep Neural Networks at Overparameterization
by: Zhang, Yaoyu, et al.
Published: (2024)

Geometry and Local Recovery of Global Minima of Two-layer Neural Networks at Overparameterization
by: Zhang, Leyang, et al.
Published: (2023)

Geometry of Critical Sets and Existence of Saddle Branches for Two-layer Neural Networks
by: Zhang, Leyang, et al.
Published: (2024)

Position: Many generalization measures for deep learning are fragile
by: Zhang, Shuofeng, et al.
Published: (2025)

Reasoning Bias of Next Token Prediction Training
by: Lin, Pengxiao, et al.
Published: (2025)

An Analysis for Reasoning Bias of Language Models with Small Initialization
by: Yao, Junjie, et al.
Published: (2025)

Memorization in deep learning: A survey
by: Wei, Jiaheng, et al.
Published: (2024)

Determinism in the Undetermined: Deterministic Output in Charge-Conserving Continuous-Time Neuromorphic Systems with Temporal Stochasticity
by: Yan, Jing, et al.
Published: (2026)

On conceptualisation and an overview of learning path recommender systems in e-learning
by: Fuster-López, A., et al.
Published: (2024)

Review of deep learning models for crypto price prediction: implementation and evaluation
by: Wu, Jingyang, et al.
Published: (2024)

Loss Jump During Loss Switch in Solving PDEs with Neural Networks
by: Wang, Zhiwei, et al.
Published: (2024)

Adaptive trajectory-constrained exploration strategy for deep reinforcement learning
by: Wang, Guojian, et al.
Published: (2023)

Physics-informed deep learning for infectious disease forecasting
by: Qian, Ying, et al.
Published: (2025)

Comparison of deep learning and conventional methods for disease onset prediction
by: John, Luis H., et al.
Published: (2024)

Achilles' Heel of Mamba: Essential difficulties of the Mamba architecture demonstrated by synthetic data
by: Chen, Tianyi, et al.
Published: (2025)

Focus and Dilution: The Multi-stage Learning Process of Attention
by: Chen, Zheng-An, et al.
Published: (2026)

Economic span selection of bridge based on deep reinforcement learning
by: Zhang, Leye, et al.
Published: (2024)

ChatBug: A Common Vulnerability of Aligned LLMs Induced by Chat Templates
by: Jiang, Fengqing, et al.
Published: (2024)