Image de couverture de livre

Learning Capacity: A Measure of the Effective Dimensionality of a Model

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Chen, Daiwei, Chang, Wei-Kai, Chaudhari, Pratik
Format:	Preprint
Publié:	2023
Sujets:	Machine Learning Information Theory
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Innovation Capacity of Dynamical Learning Systems
par: Polloreno, Anthony M.
Publié: (2026)

Diffusion Models Are Statistically Optimal for Learning Low-Dimensional Multi-Modal Distributions
par: Wu, Jingda, et autres
Publié: (2026)

Rate-Distortion-Perception Tradeoff Based on the Conditional-Distribution Perception Measure
par: Salehkalaibar, Sadaf, et autres
Publié: (2024)

Kalman Filter Aided Federated Koopman Learning
par: Chen, Yutao, et autres
Publié: (2025)

The Curious Price of Distributional Robustness in Reinforcement Learning with a Generative Model
par: Shi, Laixi, et autres
Publié: (2023)

Maximal-Capacity Discrete Memoryless Channel Identification
par: Egger, Maximilian, et autres
Publié: (2024)

LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
par: Ouyang, Xu, et autres
Publié: (2026)

The Conditional Regret-Capacity Theorem for Batch Universal Prediction
par: Bondaschi, Marco, et autres
Publié: (2025)

A Measurement Report Data-Driven Framework for Localized Statistical Channel Modeling
par: Qin, Xinyu, et autres
Publié: (2025)

Understanding Encoder-Decoder Structures in Machine Learning Using Information Measures
par: Silva, Jorge F., et autres
Publié: (2024)

Breaking the Sample Size Barrier in Model-Based Reinforcement Learning with a Generative Model
par: Li, Gen, et autres
Publié: (2020)

Model Zoo: A Growing "Brain" That Learns Continually
par: Ramesh, Rahul, et autres
Publié: (2021)

An Effective Gram Matrix Characterizes Generalization in Deep Networks
par: Yang, Rubing, et autres
Publié: (2025)

Capacity-Constrained Continual Learning
par: Wen, Zheng, et autres
Publié: (2025)

MIMO Detection via Gaussian Mixture Expectation Propagation: A Bayesian Machine Learning Approach for High-Order High-Dimensional MIMO Systems
par: Shayovitz, Shachar, et autres
Publié: (2024)

Sharp Capacity Thresholds in Linear Associative Memory: From Winner-Take-All to Listwise Retrieval
par: Barnfield, Nicholas, et autres
Publié: (2026)

How Big Should a Wireless Foundation Model Be?
par: Cheng, Wei-Lun, et autres
Publié: (2026)

Spectral Scaling Laws in Language Models: How Effectively Do Feed-Forward Networks Use Their Latent Space?
par: Jha, Nandan Kumar, et autres
Publié: (2025)

In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Models
par: Zecchin, Matteo, et autres
Publié: (2023)

Near-optimal Rank Adaptive Inference of High Dimensional Matrices
par: Zheng, Frédéric, et autres
Publié: (2025)

Separable Computation of Information Measures
par: Xu, Xiangxiang, et autres
Publié: (2025)

Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models
par: Li, Gen, et autres
Publié: (2023)

Irregular Sampling of High-Dimensional Functions in Reproducing Kernel Hilbert Spaces
par: Iske, Armin, et autres
Publié: (2025)

Settling the Sample Complexity of Model-Based Offline Reinforcement Learning
par: Li, Gen, et autres
Publié: (2022)

Time-Series JEPA for Predictive Remote Control under Capacity-Limited Networks
par: Girgis, Abanoub M., et autres
Publié: (2024)

A Tensor-Train Framework for Bayesian Inference in High-Dimensional Systems: Applications to MIMO Detection and Channel Decoding
par: Schmid, Luca, et autres
Publié: (2026)

Measuring the Intrinsic Dimension of Earth Representations
par: Rao, Arjun, et autres
Publié: (2025)

Measures of Information Reflect Memorization Patterns
par: Bansal, Rachit, et autres
Publié: (2022)

Curvature-Weighted Capacity Allocation: A Minimum Description Length Framework for Layer-Adaptive Large Language Model Optimization
par: Amaefuna, Theophilus, et autres
Publié: (2026)

Data-Driven Estimation of Capacity Upper Bounds
par: Häger, Christian, et autres
Publié: (2022)

Measuring Uncertainty in Transformer Circuits with Effective Information Consistency
par: Krasnovsky, Anatoly A.
Publié: (2025)

Pragmatic Goal-Oriented Communications under Semantic-Effectiveness Channel Errors
par: Hüttebräucker, Tomás, et autres
Publié: (2024)

An Effective Information Theoretic Framework for Channel Pruning
par: Chen, Yihao, et autres
Publié: (2024)

Byzantine-Resilient Over-the-Air Federated Learning under Zero-Trust Architecture
par: Yao, Jiacheng, et autres
Publié: (2025)

Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression
par: Ioushua, Shahar Stein, et autres
Publié: (2023)

Causal Entropy and Information Gain for Measuring Causal Control
par: Simoes, Francisco Nunes Ferreira Quialheiro, et autres
Publié: (2023)

Information-Theoretic Measures on Lattices for High-Order Interactions
par: Liu, Zhaolu, et autres
Publié: (2024)

Tighter Information-Theoretic Generalization Bounds via a Novel Class of Change of Measure Inequalities
par: Liu, Yanxiao, et autres
Publié: (2026)

Dual-Mind World Models: A General Framework for Learning in Dynamic Wireless Networks
par: Wang, Lingyi, et autres
Publié: (2025)

Measuring the Predictability of Recommender Systems using Structural Complexity Metrics
par: Abeliuk, Andrés, et autres
Publié: (2024)