Cover Image

A Teacher-Student Perspective on the Dynamics of Learning Near the Optimal Point

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Couto, Carlos, Mourão, José, Figueiredo, Mário A. T., Ribeiro, Pedro
Format:	Preprint
Published:	2025
Subjects:	Machine Learning 68T07
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Generalization Bound for a Family of Implicit Networks
by: Fung, Samy Wu, et al.
Published: (2024)

Beyond the Class Subspace: Teacher-Guided Training for Reliable Out-of-Distribution Detection in Single-Domain Models
by: Yang, Hong, et al.
Published: (2026)

A ZeNN architecture to avoid the Gaussian trap
by: Carvalho, Luís, et al.
Published: (2025)

A Comprehensive View of Personalized Federated Learning on Heterogeneous Clinical Datasets
by: Tavakoli, Fatemeh, et al.
Published: (2023)

The Boundaries of Verifiable Accuracy, Robustness, and Generalisation in Deep Learning
by: Bastounis, Alexander, et al.
Published: (2023)

Deep Learning and Transfer Learning Architectures for English Premier League Player Performance Forecasting
by: Frees, Daniel, et al.
Published: (2024)

Feature Learning Beyond the Edge of Stability
by: Terjék, Dávid
Published: (2025)

Markov Chain Estimation with In-Context Learning
by: Lepage, Simon, et al.
Published: (2025)

The Positivity of the Neural Tangent Kernel
by: Carvalho, Luís, et al.
Published: (2024)

Closed-Form Feedback-Free Learning with Forward Projection
by: O'Shea, Robert, et al.
Published: (2025)

BP(λ): Online Learning via Synthetic Gradients
by: Pemberton, Joseph, et al.
Published: (2024)

Tadpole: Autoencoders as Foundation Models for 3D PDEs with Online Learning
by: Liu, Qiang, et al.
Published: (2026)

Cooperative Multi-Agent Deep Reinforcement Learning in Content Ranking Optimization
by: Qin, Zhou, et al.
Published: (2024)

Teaching and Learning under Deductive Errors
by: Telle, Jan Arne, et al.
Published: (2026)

Structured Knowledge Accumulation: The Principle of Entropic Least Action in Forward-Only Neural Learning
by: Quantiota, Bouarfa Mahi
Published: (2025)

From Features to Graphs: Exploring Graph Structures and Pairwise Interactions via GNNs
by: Yamchote, Phaphontee, et al.
Published: (2025)

Influence-Inspired Spectral Rotations for Extreme Low-Bit LLM Quantization
by: Pavlov, Gorgi
Published: (2026)

Generalization Error of GAN from the Discriminator's Perspective
by: Yang, Hongkang, et al.
Published: (2021)

The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers under Fully Homomorphic Encryption on the Torus
by: Brännvall, Rickard, et al.
Published: (2023)

Multi-modal Transfer Learning between Biological Foundation Models
by: Garau-Luis, Juan Jose, et al.
Published: (2024)

A Unified Perspective on the Dynamics of Deep Transformers
by: Castin, Valérie, et al.
Published: (2025)

Wave-Attractor-Tree: A Hierarchical Binary Tree Reduction Architecture for Efficient Sequence Modeling
by: Berezkin, Igor
Published: (2026)

Data-Driven Estimation of Conditional Expectations, Application to Optimal Stopping and Reinforcement Learning
by: Moustakides, George V.
Published: (2024)

Learning Latent Spaces for Domain Generalization in Time Series Forecasting
by: Deng, Songgaojun, et al.
Published: (2024)

Multi-Point Proximity Encoding For Vector-Mode Geospatial Machine Learning
by: Collins, John
Published: (2025)

Graph-Conditional Flow Matching for Relational Data Generation
by: Scassola, Davide, et al.
Published: (2025)

Optimizing Basis Function Selection in Constructive Wavelet Neural Networks and Its Applications
by: Huang, Dunsheng, et al.
Published: (2025)

Iterative Orthogonalization Scaling Laws
by: Selvaraj, Devan
Published: (2025)

MLPs at the EOC: Spectrum of the NTK
by: Terjék, Dávid, et al.
Published: (2025)

Segmentation of cracks in 3d images of fiber reinforced concrete using deep learning
by: Nowacka, Anna, et al.
Published: (2025)

Deep generative models as the probability transformation functions
by: Bondar, Vitalii, et al.
Published: (2025)

MLPs at the EOC: Concentration of the NTK
by: Terjék, Dávid, et al.
Published: (2025)

Two-Stage Generative Model for Intracranial Aneurysm Meshes with Morphological Marker Conditioning
by: Ding, Wenhao, et al.
Published: (2025)

ConFIG: Towards Conflict-free Training of Physics Informed Neural Networks
by: Liu, Qiang, et al.
Published: (2024)

Flow matching on homogeneous spaces
by: Ruscelli, Francesco
Published: (2026)

Improving Fairness and Mitigating MADness in Generative Models
by: Mayer, Paul, et al.
Published: (2024)

Stability Analysis of Equivariant Convolutional Representations Through The Lens of Equivariant Multi-layered CKNs
by: Chowdhury, Soutrik Roy
Published: (2024)

Training-Free Generative Sampling via Moment-Matched Score Smoothing
by: Yao, Zhenyu, et al.
Published: (2026)

Generative Design of Ship Propellers using Conditional Flow Matching
by: Kruger, Patrick, et al.
Published: (2026)

The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks
by: Chizat, Lénaïc, et al.
Published: (2023)