Cover Image

The impact of memory on learning sequence-to-sequence tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Seif, Alireza, Loos, Sarah A. M., Tucci, Gennaro, Roldán, Édgar, Goldt, Sebastian
Format:	Preprint
Published:	2022
Subjects:	Machine Learning Statistical Mechanics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sliding down the stairs: how correlated latent variables accelerate learning with neural networks
by: Bardone, Lorenzo, et al.
Published: (2024)

Factual recall in linear associative memories: sharp asymptotics and mechanistic insights
by: Giorlandino, Alessio, et al.
Published: (2026)

Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks
by: Székely, Eszter, et al.
Published: (2023)

Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation
by: Giorlandino, Alessio, et al.
Published: (2025)

Memorisation, convergence and generalisation in generative models
by: Maillard, Antoine, et al.
Published: (2026)

A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights
by: Ricci, Fabiola, et al.
Published: (2026)

Feature learning from non-Gaussian inputs: the case of Independent Component Analysis in high dimensions
by: Ricci, Fabiola, et al.
Published: (2025)

Machine learning for cerebral blood vessels' malformations
by: Topal, Irem, et al.
Published: (2024)

Mapping of attention mechanisms to a generalized Potts model
by: Rende, Riccardo, et al.
Published: (2023)

Boltzmann machine learning and regularization methods for inferring evolutionary fields and couplings from a multiple sequence alignment
by: Miyazawa, Sanzo
Published: (2019)

Expanding functional protein sequence space using high entropy generative models
by: Netti, Roberto, et al.
Published: (2026)

Stochastic thermodynamics of a probe in a fluctuating correlated field
by: Venturelli, Davide, et al.
Published: (2023)

Coding schemes in neural networks learning classification tasks
by: van Meegen, Alexander, et al.
Published: (2024)

Quo vadis, stochastic thermodynamics?
by: Korbel, Jan, et al.
Published: (2026)

Identifying percolation phase transitions with unsupervised learning based on largest clusters
by: Xu, Dian, et al.
Published: (2023)

When can in-context learning generalize out of task distribution?
by: Goddard, Chase, et al.
Published: (2025)

Model-free learning of probability flows: Elucidating the nonequilibrium dynamics of flocking
by: Boffi, Nicholas M., et al.
Published: (2024)

Nonreciprocal collective dynamics in a mixture of phoretic Janus colloids
by: Tucci, Gennaro, et al.
Published: (2024)

Demonstration of Robust and Efficient Quantum Property Learning with Shallow Shadows
by: Hu, Hong-Ye, et al.
Published: (2024)

A simple reconstruction method to infer nonreciprocal interactions and local driving in complex systems
by: Hempel, Tim, et al.
Published: (2024)

Fundamentals of quantum Boltzmann machine learning with visible and hidden units
by: Wilde, Mark M.
Published: (2025)

Interpretable machine learning of amino acid patterns in proteins: a statistical ensemble approach
by: Braghetto, Anna, et al.
Published: (2023)

Finite-time transitions in optimal control and non-equilibrium relaxation
by: Meibohm, Jan, et al.
Published: (2026)

How does Chain of Thought decompose complex tasks?
by: Nadgir, Amrut, et al.
Published: (2026)

Geometric origin of adversarial vulnerability in deep learning
by: Ren, Yixiong, et al.
Published: (2025)

Maximum diffusion reinforcement learning
by: Berrueta, Thomas A., et al.
Published: (2023)

Machine learning for structure-property relationships: Scalability and limitations
by: Tian, Zhongzheng, et al.
Published: (2023)

Quantum-data-driven dynamical transition in quantum learning
by: Zhang, Bingzhi, et al.
Published: (2024)

Controlling dynamics of stochastic systems with deep reinforcement learning
by: Mukhamadiarov, Ruslan
Published: (2025)

Interpretable representation learning of quantum data enabled by probabilistic variational autoencoders
by: de Schoulepnikoff, Paulin, et al.
Published: (2025)

Hydrodynamic stresses in a multi-species suspension of active Janus colloids
by: Tucci, Gennaro, et al.
Published: (2025)

Active particles in moving traps: minimum work protocols and information efficiency of work extraction
by: Schüttler, Janik, et al.
Published: (2025)

Optimal closed-loop control of active particles and a minimal information engine
by: Garcia-Millan, Rosalba, et al.
Published: (2024)

Meta-learning of Gibbs states for many-body Hamiltonians with applications to Quantum Boltzmann Machines
by: Bhat, Ruchira V, et al.
Published: (2025)

On sequences of convex records in the plane
by: Godrèche, Claude, et al.
Published: (2024)

On the area swept by a biased diffusion till its first-exit time: Martingale approach and gambling opportunities
by: Sarmiento, Yonathan, et al.
Published: (2023)

Susceptibilities and Patterning: A Primer on Linear Response in Bayesian Learning
by: Elliott, Chris, et al.
Published: (2026)

Review and Prospect of Algebraic Research in Equivalent Framework between Statistical Mechanics and Machine Learning Theory
by: Watanabe, Sumio
Published: (2024)

Statistics of Min-max Normalized Eigenvalues in Random Matrices
by: Nakada, Hyakka, et al.
Published: (2025)

Laws of thermodynamics for exponential families
by: Balsubramani, Akshay
Published: (2025)