Image de couverture de livre

Semantic Chunking and the Entropy of Natural Language

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhong, Weishun, Sivan, Doron, Can, Tankut, Katkov, Mikhail, Tsodyks, Misha
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Disordered Systems and Neural Networks Statistical Mechanics Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Synaptic Theory of Chunking in Working Memory
par: Zhong, Weishun, et autres
Publié: (2024)

Statistical Mechanics of Semantic Compression
par: Can, Tankut
Publié: (2025)

Random Tree Model of Meaningful Memory
par: Zhong, Weishun, et autres
Publié: (2024)

The Garden of Forking Paths: Observing Dynamic Parameters Distribution in Large Language Models
par: Nicolini, Carlo, et autres
Publié: (2024)

Spin glass model of in-context learning
par: Li, Yuhao, et autres
Publié: (2024)

Impact of ChatGPT on the writing style of condensed matter physicists
par: Xu, Shaojun, et autres
Publié: (2024)

Entropy and chirality in sphinx tilings
par: Huber, Greg, et autres
Publié: (2023)

Spectral Entropy via Random Spanning Forests
par: Nicolini, Carlo
Publié: (2025)

Entropy alternatives for equilibrium and out of equilibrium systems
par: Vogel, Eugenio E., et autres
Publié: (2024)

Ferromagnetic and Spin-Glass Finite-Temperature Order but no Antiferromagnetic Order in the d=1 Ising Model with Long-Range Power-Law Interactions
par: Artun, E. Can, et autres
Publié: (2025)

Nematic Phase of the n-Component Cubic-Spin Spin Glass in d=3: Liquid-Crystal Phase in a Dirty Magnet
par: Artun, E. Can, et autres
Publié: (2023)

Axial, Planar-Diagonal, Body-Diagonal Fields on the Cubic-Spin Spin Glass in d=3: A Plethora of Ordered Phases under Finite Fields
par: Artun, E. Can, et autres
Publié: (2024)

Multifractal Spin-Glass Chaos Projection and Interrelation of Multicultural Music and Brain Signals
par: Artun, E. Can, et autres
Publié: (2022)

Learning in Wilson-Cowan model for metapopulation
par: Marino, Raffaele, et autres
Publié: (2024)

A Generative Neural Annealer for Black-Box Combinatorial Optimization
par: Zhang, Yuan-Hang, et autres
Publié: (2025)

Entropic Confinement and Mode Connectivity in Overparameterized Neural Networks
par: Di Carlo, Luca, et autres
Publié: (2025)

Spectral Architecture Search for Neural Network Models
par: Peri, Gianluca, et autres
Publié: (2025)

Deterministic versus stochastic dynamical classifiers: opposing random adversarial attacks with noise
par: Chicchi, Lorenzo, et autres
Publié: (2024)

Statistical Mechanics and Artificial Neural Networks: Principles, Models, and Applications
par: Böttcher, Lucas, et autres
Publié: (2024)

Estimating Global Input Relevance and Enforcing Sparse Representations with a Scalable Spectral Neural Network Approach
par: Chicchi, Lorenzo, et autres
Publié: (2024)

Phase transitions in the mini-batch size for sparse and dense two-layer neural networks
par: Marino, Raffaele, et autres
Publié: (2023)

Stable Attractors for Neural networks classification via Ordinary Differential Equations (SA-nODE)
par: Marino, Raffaele, et autres
Publié: (2023)

A Minimal Model of Representation Collapse: Frustration, Stop-Gradient, and Dynamics
par: Yao, Louie Hong, et autres
Publié: (2026)

Mapping of attention mechanisms to a generalized Potts model
par: Rende, Riccardo, et autres
Publié: (2023)

How transformers learn structured data: insights from hierarchical filtering
par: Garnier-Brun, Jerome, et autres
Publié: (2024)

Pattern recognition in the nucleation kinetics of non-equilibrium self-assembly
par: Evans, Constantine Glen, et autres
Publié: (2022)

Performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics models
par: Del Bono, Luca Maria, et autres
Publié: (2025)

Demonstrating Real Advantage of Machine-Learning-Enhanced Monte Carlo for Combinatorial Optimization
par: Del Bono, Luca Maria, et autres
Publié: (2025)

The critical slowing down in diffusion models
par: Del Bono, Luca Maria, et autres
Publié: (2026)

Multi-channel pattern reconstruction through $L$-directional associative memories
par: Agliari, Elena, et autres
Publié: (2025)

Equilibrium and out-of-equilibrium critical dynamics of the three-dimensional Heisenberg model with random cubic anisotropy
par: Astillero, A., et autres
Publié: (2024)

Investigating Stark many-body localization with continuous unitary transformation flows
par: Herre, Jan-Niklas, et autres
Publié: (2024)

Microscopic and collective signatures of feature learning in neural networks
par: Corti, Andrea, et autres
Publié: (2025)

The Wishart--Rosenzweig--Porter random matrix ensemble
par: Delapalme, Victor, et autres
Publié: (2025)

Reentrant phase transitions involving glassy and superfluid orders in the random hopping Bose-Hubbard model
par: Piekarska, Anna M., et autres
Publié: (2022)

Thermodynamic Curvature and the Widom Ridge in Interacting Spin Systems
par: Bittner, Eric R.
Publié: (2026)

Energy-Weighted Site Percolation in Two Dimensions
par: Sircar, Sayan, et autres
Publié: (2026)

Diagrammatics of free energies with fixed variance for high-dimensional data
par: Kühn, Tobias
Publié: (2025)

Higher-order contagion processes in 3.99 dimensions
par: Meloni, Sandro, et autres
Publié: (2025)

Algorithm-independent bounds on complex optimization through the statistics of marginal optima
par: Kent-Dobias, Jaron
Publié: (2024)