Copertina

Sampling at intermediate temperatures is optimal for training large language models in protein structure prediction

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ghiringhelli, L., Zambon, A., Tiana, G.
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Disordered Systems and Neural Networks Machine Learning Biomolecules
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Selective Imperfection as a Generative Framework for Analysis, Creativity and Discovery
di: Buehler, Markus J.
Pubblicazione: (2025)

Fluctuations and the limit of predictability in protein evolution
di: Rossi, Saverio, et al.
Pubblicazione: (2024)

Controlled Langevin Dynamics for Sampling of Feedforward Neural Networks Trained with Minibatches
di: Zambon, Alessandro, et al.
Pubblicazione: (2026)

Lattice Protein Folding with Variational Annealing
di: Khandoker, Shoummo Ahsan, et al.
Pubblicazione: (2025)

Emergent time scales of epistasis in protein evolution
di: Di Bari, Leonardo, et al.
Pubblicazione: (2024)

Autonomous Agents Coordinating Distributed Discovery Through Emergent Artifact Exchange
di: Wang, Fiona Y., et al.
Pubblicazione: (2026)

Fast and Functional Structured Data Generators Rooted in Out-of-Equilibrium Physics
di: Carbone, Alessandra, et al.
Pubblicazione: (2023)

Modeling Protein Evolution via Generative Inference From Monte Carlo Chains to Population Genetics
di: Di Bari, Leonardo, et al.
Pubblicazione: (2026)

Holographic nature of critical quantum states of proteins
di: Papp, Eszter, et al.
Pubblicazione: (2024)

Liquid Hopfield model: retrieval and localization in multicomponent liquid mixtures
di: Teixeira, Rodrigo Braz, et al.
Pubblicazione: (2023)

Discrete-space and -time analogue of a super-diffusive fractional Brownian motion
di: Marinari, Enzo, et al.
Pubblicazione: (2025)

Functional bottlenecks can emerge from non-epistatic underlying traits
di: Schulte, Anna Ottavia, et al.
Pubblicazione: (2025)

Sampling the space of solutions of an artificial neural network
di: Zambon, Alessandro, et al.
Pubblicazione: (2025)

Statistical physics analysis of graph neural networks: Approaching optimality in the contextual stochastic block model
di: Duranthon, O., et al.
Pubblicazione: (2025)

Computation of Biological Conductance with Liouville Quantum Master Equation
di: Papp, Eszter, et al.
Pubblicazione: (2024)

How does training shape the Riemannian geometry of neural network representations?
di: Zavatone-Veth, Jacob A., et al.
Pubblicazione: (2023)

Field theory for optimal signal propagation in ResNets
di: Fischer, Kirsten, et al.
Pubblicazione: (2023)

A solvable high-dimensional model where nonlinear autoencoders learn structure invisible to PCA while test loss misaligns with generalization
di: Mendes, Vicente Conde, et al.
Pubblicazione: (2026)

Restoring balance: principled under/oversampling of data for optimal classification
di: Loffredo, Emanuele, et al.
Pubblicazione: (2024)

Autoregressive model path dependence near Ising criticality
di: Teoh, Yi Hong, et al.
Pubblicazione: (2024)

Sampling Data with Chains of Forward-Backward Diffusion Steps
di: Kang, Hyunmo, et al.
Pubblicazione: (2026)

EB-RANSAC: Random Sample Consensus based on Energy-Based Model
di: Yasuda, Muneki, et al.
Pubblicazione: (2026)

Towards a theory of how the structure of language is acquired by deep neural networks
di: Cagnetta, Francesco, et al.
Pubblicazione: (2024)

Specialization of softmax attention heads: insights from the high-dimensional single-location model
di: Sagitova, M., et al.
Pubblicazione: (2026)

Symmetry in language statistics shapes the geometry of model representations
di: Karkada, Dhruva, et al.
Pubblicazione: (2026)

Training neural networks with structured noise improves classification and generalization
di: Benedetti, Marco, et al.
Pubblicazione: (2023)

Nadaraya-Watson kernel smoothing as a random energy model
di: Zavatone-Veth, Jacob A., et al.
Pubblicazione: (2024)

Cascade of phase transitions in the training of Energy-based models
di: Bachtis, Dimitrios, et al.
Pubblicazione: (2024)

An exactly solvable model for emergence and scaling laws in the multitask sparse parity problem
di: Nam, Yoonsoo, et al.
Pubblicazione: (2024)

Bayes optimal learning of attention-indexed models
di: Boncoraglio, Fabrizio, et al.
Pubblicazione: (2025)

A solvable model of learning generative diffusion: theory and insights
di: Cui, Hugo, et al.
Pubblicazione: (2025)

Generative modeling through internal high-dimensional chaotic activity
di: Fournier, Samantha J., et al.
Pubblicazione: (2024)

A Federated Many-to-One Hopfield model for associative Neural Networks
di: Alessandrelli, Andrea, et al.
Pubblicazione: (2026)

Non-equilibrium active noise enhances generative memory in diffusion models
di: Behera, Agnish Kumar, et al.
Pubblicazione: (2024)

Bias-inducing geometries: an exactly solvable data model with fairness implications
di: Mannelli, Stefano Sarao, et al.
Pubblicazione: (2022)

Optimal thresholds and algorithms for a model of multi-modal learning in high dimensions
di: Keup, Christian, et al.
Pubblicazione: (2024)

The Persian Rug: solving toy models of superposition using large-scale symmetries
di: Cowsik, Aditya, et al.
Pubblicazione: (2024)

Fundamental limits of learning in sequence multi-index models and deep attention networks: High-dimensional asymptotics and sharp thresholds
di: Troiani, Emanuele, et al.
Pubblicazione: (2025)

Asymptotic generalization error of a single-layer graph convolutional network
di: Duranthon, O., et al.
Pubblicazione: (2024)

Experimental Data Confirm Carrier-Cascade Model for Solid-State Conductance across Proteins
di: Papp, Eszter, et al.
Pubblicazione: (2024)