Imagen de Portada

Understanding Representation of Deep Equilibrium Models from Neural Collapse Perspective

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Sun, Haixiang, Shi, Ye
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Revisiting Attention for Multivariate Time Series Forecasting
por: Wu, Haixiang
Publicado: (2024)

Can We Understand Plasticity Through Neural Collapse?
por: Bonifazi, Guglielmo, et al.
Publicado: (2024)

Consistency Deep Equilibrium Models
por: Lin, Junchao, et al.
Publicado: (2026)

A Theoretical Perspective: How to Prevent Model Collapse in Self-consuming Training Loops
por: Fu, Shi, et al.
Publicado: (2025)

Deep Neural Regression Collapse
por: Rangamani, Akshay, et al.
Publicado: (2026)

Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
por: Súkeník, Peter, et al.
Publicado: (2025)

Understanding and Improving Transfer Learning of Deep Models via Neural Collapse
por: Li, Xiao, et al.
Publicado: (2022)

Representation Collapsing Problems in Vector Quantization
por: Zhao, Wenhao, et al.
Publicado: (2024)

Understanding Transformer from the Perspective of Associative Memory
por: Zhong, Shu, et al.
Publicado: (2025)

The Prevalence of Neural Collapse in Neural Multivariate Regression
por: Andriopoulos, George, et al.
Publicado: (2024)

Preventing Model Collapse via Contraction-Conditioned Neural Filters
por: Han, Zongjian, et al.
Publicado: (2025)

Collapsed Inference for Bayesian Deep Learning
por: Zeng, Zhe, et al.
Publicado: (2023)

Certified Robustness for Deep Equilibrium Models via Serialized Random Smoothing
por: Gao, Weizhi, et al.
Publicado: (2024)

Understanding Task Representations in Neural Networks via Bayesian Ablation
por: Nam, Andrew, et al.
Publicado: (2025)

Understanding Sparse Neural Networks from their Topology via Multipartite Graph Representations
por: Cunegatti, Elia, et al.
Publicado: (2023)

Understanding and Mitigating Hyperbolic Dimensional Collapse in Graph Contrastive Learning
por: Zhang, Yifei, et al.
Publicado: (2023)

Attribution Explanations for Deep Neural Networks: A Theoretical Perspective
por: Deng, Huiqi, et al.
Publicado: (2025)

Textual Equilibrium Propagation for Deep Compound AI Systems
por: Chen, Minghui, et al.
Publicado: (2026)

Generalizing Dynamics Modeling More Easily from Representation Perspective
por: Wang, Yiming, et al.
Publicado: (2026)

Enhancing Pre-Trained Model-Based Class-Incremental Learning through Neural Collapse
por: He, Kun, et al.
Publicado: (2025)

Understanding and Preventing Entropy Collapse in RLVR with On-Policy Entropy Flow Optimization
por: Xu, Huimin, et al.
Publicado: (2026)

Understanding Distributed Representations of Concepts in Deep Neural Networks without Supervision
por: Chang, Wonjoon, et al.
Publicado: (2023)

The Homogeneity Trap: Spectral Collapse in Doubly-Stochastic Deep Networks
por: Liu, Yizhi
Publicado: (2026)

Deep Neural Networks via Complex Network Theory: a Perspective
por: La Malfa, Emanuele, et al.
Publicado: (2024)

Robust Weight Imprinting: Insights from Neural Collapse and Proxy-Based Aggregation
por: Westerhoff, Justus, et al.
Publicado: (2025)

PFML: Self-Supervised Learning of Time-Series Data Without Representation Collapse
por: Vaaras, Einari, et al.
Publicado: (2024)

Signal Collapse in One-Shot Pruning: When Sparse Models Fail to Distinguish Neural Representations
por: Saikumar, Dhananjay, et al.
Publicado: (2025)

Tracing the Heart's Pathways: ECG Representation Learning from a Cardiac Conduction Perspective
por: Pan, Tan, et al.
Publicado: (2025)

Model Collapse Demystified: The Case of Regression
por: Dohmatob, Elvis, et al.
Publicado: (2024)

Deep Manifold Part 2: Neural Network Mathematics
por: Ma, Max Y., et al.
Publicado: (2025)

A Flat Minima Perspective on Understanding Augmentations and Model Robustness
por: Yoo, Weebum, et al.
Publicado: (2025)

Efficient Representations are Controllable Representations
por: Ye, Charles, et al.
Publicado: (2026)

Advancing the Understanding of Fixed Point Iterations in Deep Neural Networks: A Detailed Analytical Study
por: Ke, Yekun, et al.
Publicado: (2024)

DeepGate3: Towards Scalable Circuit Representation Learning
por: Shi, Zhengyuan, et al.
Publicado: (2024)

Deep Manifold Part 1: Anatomy of Neural Network Manifold
por: Ma, Max Y., et al.
Publicado: (2024)

Why Do Neural Networks Forget: A Study of Collapse in Continual Learning
por: Zhu, Yunqin, et al.
Publicado: (2026)

Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks
por: Roth, Andreas, et al.
Publicado: (2023)

Directional Neural Collapse Explains Few-Shot Transfer in Self-Supervised Learning
por: Luthra, Achleshwar, et al.
Publicado: (2026)

MENDR: Manifold Explainable Neural Data Representations
por: Chen, Matthew, et al.
Publicado: (2025)

Hyperbolic Hypergraph Neural Networks for Multi-Relational Knowledge Hypergraph Representation
por: Li, Mengfan, et al.
Publicado: (2024)