Rank-frequency distribution of natural languages: a difference of probabilities approach
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2018
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910010184826880 |
|---|---|
| author | Cocho, Germinal Rodríguez, R. F. Sánchez, Sergio Flores, Jorge Pineda, Carlos Gershenson, Carlos |
| author_facet | Cocho, Germinal Rodríguez, R. F. Sánchez, Sergio Flores, Jorge Pineda, Carlos Gershenson, Carlos |
| contents | The time variation of the rank $k$ of words for six Indo-European languages is obtained using data from Google Books. For low ranks the distinct languages behave differently, maybe due to syntaxis rules, whereas for $k>50$ the law of large numbers predominates. The dynamics of $k$ is described stochastically through a master equation governing the time evolution of its probability density, which is approximated by a Fokker-Planck equation that is solved analytically. The difference between the data and the asymptotic solution is identified with the transient solution, and good agreement is obtained. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_1811_09451 |
| institution | arXiv |
| publishDate | 2018 |
| record_format | arxiv |
| spellingShingle | Rank-frequency distribution of natural languages: a difference of probabilities approach Cocho, Germinal Rodríguez, R. F. Sánchez, Sergio Flores, Jorge Pineda, Carlos Gershenson, Carlos Physics and Society Applications The time variation of the rank $k$ of words for six Indo-European languages is obtained using data from Google Books. For low ranks the distinct languages behave differently, maybe due to syntaxis rules, whereas for $k>50$ the law of large numbers predominates. The dynamics of $k$ is described stochastically through a master equation governing the time evolution of its probability density, which is approximated by a Fokker-Planck equation that is solved analytically. The difference between the data and the asymptotic solution is identified with the transient solution, and good agreement is obtained. |
| title | Rank-frequency distribution of natural languages: a difference of probabilities approach |
| topic | Physics and Society Applications |
| url | https://arxiv.org/abs/1811.09451 |