Image de couverture de livre

Quantifying Memory Utilization with Effective State-Size

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Parnichkun, Rom N., Tumma, Neehal, Thomas, Armin W., Moro, Alessandro, An, Qi, Suzuki, Taiji, Yamashita, Atsushi, Poli, Michael, Massaroli, Stefano
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

STAR: Synthesis of Tailored Architectures
par: Thomas, Armin W., et autres
Publié: (2024)

State-Free Inference of State-Space Models: The Transfer Function Approach
par: Parnichkun, Rom N., et autres
Publié: (2024)

Preconditioned DeltaNet: Curvature-aware Sequence Modeling for Linear Recurrences
par: Tumma, Neehal, et autres
Publié: (2026)

Sliding Window Recurrences for Sequence Models
par: Secrieru, Dragos, et autres
Publié: (2025)

Mechanistic Design and Scaling of Hybrid Architectures
par: Poli, Michael, et autres
Publié: (2024)

Transformers as Measure-Theoretic Associative Memory: A Statistical Perspective and Minimax Optimality
par: Kawata, Ryotaro, et autres
Publié: (2026)

State Space Models are Provably Comparable to Transformers in Dynamic Token Selection
par: Nishikawa, Naoki, et autres
Publié: (2024)

Educação Permanente para o aperfeiçoamento do Controle de Infecção Hospitalar: revisão integrativa
par: Aline Massaroli
Publié: (2014)

Towards a Unified Analysis of Neural Networks in Nonparametric Instrumental Variable Regression: Optimization and Generalization
par: Chen, Zonghao, et autres
Publié: (2025)

Direct Distributional Optimization for Provable Alignment of Diffusion Models
par: Kawata, Ryotaro, et autres
Publié: (2025)

Intrinsic Wasserstein Rates for Score-Based Generative Models on Smooth Manifolds
par: Fu, Guoji, et autres
Publié: (2026)

Quantifying the Optimization and Generalization Advantages of Graph Neural Networks Over Multilayer Perceptrons
par: Huang, Wei, et autres
Publié: (2023)

Competitividade e gap tecnológico – uma análise comparativa entre Brasil e países europeus
par: Tatiana Massaroli Melo
Publié: (2017)

Um modelo setorial baseado na abordagem kaleckiana da distribuição setorial funcional da renda e na teoria schumpeteriana da concorrência
par: Tatiana Massaroli Melo
Publié: (2016)

An energy landscape-based theoretical framework for understanding the emergence of functions in a living system under the dynamical component interaction
par: Suzuki, Ryunosuke, et autres
Publié: (2025)

Direct Density Ratio Optimization: A Statistically Consistent Approach to Aligning Large Language Models
par: Higuchi, Rei, et autres
Publié: (2025)

Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscape
par: Kim, Juno, et autres
Publié: (2024)

Deep Two-Way Matrix Reordering for Relational Data Analysis
par: Watanabe, Chihiro, et autres
Publié: (2021)

The Mechanism of Weak-to-Strong Generalization: Feature Elicitation from Latent Knowledge
par: Awano, Ryoya, et autres
Publié: (2026)

Transformers Provably Solve Parity Efficiently with Chain of Thought
par: Kim, Juno, et autres
Publié: (2024)

Mean-field Analysis on Two-layer Neural Networks from a Kernel Perspective
par: Takakura, Shokichi, et autres
Publié: (2024)

AutoLL: Automatic Linear Layout of Graphs based on Deep Neural Network
par: Watanabe, Chihiro, et autres
Publié: (2021)

Test time training enhances in-context learning of nonlinear functions
par: Kuwataka, Kento, et autres
Publié: (2025)

In-Context Learning Is Provably Bayesian Inference: A Generalization Theory for Meta-Learning
par: Wakayama, Tomoya, et autres
Publié: (2025)

Approximation and Estimation Ability of Transformers for Sequence-to-Sequence Functions with Infinite Dimensional Input
par: Takakura, Shokichi, et autres
Publié: (2023)

Koopman-based generalization bound: New aspect for full-rank weights
par: Hashimoto, Yuka, et autres
Publié: (2023)

Moving Object Detection from Moving Camera Using Focus of Expansion Likelihood and Segmentation
par: Ogawa, Masahiro, et autres
Publié: (2025)

Effective Treatment Case of Esophagogastric Varices With a To‐and‐Fro Flow State Using Convex Ultrasound Endoscopy
par: Kazunori Nagashima, et autres
Publié: (2026)

From Saddle Points Toward Global Minima: A Newton-Type Method on Wasserstein Space
par: Lascu, Razvan-Andrei, et autres
Publié: (2026)

Propagation of Chaos for Mean-Field Langevin Dynamics and its Application to Model Ensemble
par: Nitanda, Atsushi, et autres
Publié: (2025)

Degrees of Freedom for Linear Attention: Distilling Softmax Attention with Optimal Feature Efficiency
par: Nishikawa, Naoki, et autres
Publié: (2025)

Transformers are Minimax Optimal Nonparametric In-Context Learners
par: Kim, Juno, et autres
Publié: (2024)

Mamba Can Learn Low-Dimensional Targets In-Context via Test-Time Feature Learning
par: Oh, Junsoo, et autres
Publié: (2025)

Hessian-guided Perturbed Wasserstein Gradient Flows for Escaping Saddle Points
par: Yamamoto, Naoya, et autres
Publié: (2025)

A note on lenses in arrangements of pairwise intersecting circles in the plane
par: Pinchasi, Rom
Publié: (2024)

The Impact of Banking Competition on Interest Rates for Household Consumption Loans in the Euro Area
par: Rom, Alexander
Publié: (2024)

El papel de los estudios lingüísticos en la investigación psicosocial: el caso de las pasiones y los sentimientos
par: Rom Harré
Publié: (2002)

Rebekka Denz. Bürgerlich, jüdisch, weiblich: Frauen im Centralverein deutscher Staatsbürger jüdischen Glaubens (1918–1938). Jüdische Kulturgeschichte in der Moderne 16. Berlin: Neofelis Verlag, 2021. 392 Seiten, EUR 32, ISBN 978-3-95808-159-8
par: Sharon Rom
Publié: (2022)

Hybrid Psychology: The marriage of discourse analysis with neuroscience
par: Rom Harré
Publié: (2010)

A Model-Free Method to Quantify Memory Utilization in Neural Point Processes
par: Mijatovic, Gorana, et autres
Publié: (2024)