On the Entropy of Written Spanish
Fuente:
Redalyc
Saved in:
| Main Author: | |
|---|---|
| Format: | Artículo científico |
| Language: | en |
| Published: |
Universidad Nacional de Colombia
2012
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1876489629865082880 |
|---|---|
| author | Fabio G. Guerrero |
| author_facet | Fabio G. Guerrero |
| contents | On the Entropy of Written Spanish Fabio G. Guerrero Física, Astronomía y Matemáticas Zipf’s law Shannon entropy Stochastic process Law of large numbers A discussion on the entropy of the Spanish language by means of a practical method for calculating the entropy of a text by direct computer processing is presented. As an example of application, thirty samples of Spanish text are analyzed, totaling 22.8 million characters. Symbol lengths from n = 1 to 500 were considered for both words and characters. Both direct computer processing and the probability law of large numbers were employed for calculating the probability distribution of the symbols. An empirical relation on entropy involving the length of the text (in characters) and the number of different words in the text is presented. Statistical properties of the Spanish language when viewed as produced by a stochastic source, (such as origin shift invariance, ergodicity and asymptotic equipartition property) are also analyzed. 2012 artículo científico 0120-1751 https://www.redalyc.org/articulo.oa?id=89925367007 en http://www.redalyc.org/revista.oa?id=899 Revista Colombiana de Estadística application/pdf Universidad Nacional de Colombia Revista Colombiana de Estadística (Colombia) Num.3 Vol.35 |
| format | Artículo científico |
| id | redalyc_89925367007 |
| institution | Redalyc |
| language | en |
| publishDate | 2012 |
| publisher | Universidad Nacional de Colombia |
| spellingShingle | On the Entropy of Written Spanish Fabio G. Guerrero Física, Astronomía y Matemáticas Zipf’s law Shannon entropy Stochastic process Law of large numbers On the Entropy of Written Spanish Fabio G. Guerrero Física, Astronomía y Matemáticas Zipf’s law Shannon entropy Stochastic process Law of large numbers A discussion on the entropy of the Spanish language by means of a practical method for calculating the entropy of a text by direct computer processing is presented. As an example of application, thirty samples of Spanish text are analyzed, totaling 22.8 million characters. Symbol lengths from n = 1 to 500 were considered for both words and characters. Both direct computer processing and the probability law of large numbers were employed for calculating the probability distribution of the symbols. An empirical relation on entropy involving the length of the text (in characters) and the number of different words in the text is presented. Statistical properties of the Spanish language when viewed as produced by a stochastic source, (such as origin shift invariance, ergodicity and asymptotic equipartition property) are also analyzed. 2012 artículo científico 0120-1751 https://www.redalyc.org/articulo.oa?id=89925367007 en http://www.redalyc.org/revista.oa?id=899 Revista Colombiana de Estadística application/pdf Universidad Nacional de Colombia Revista Colombiana de Estadística (Colombia) Num.3 Vol.35 |
| title | On the Entropy of Written Spanish |
| topic | Física, Astronomía y Matemáticas Zipf’s law Shannon entropy Stochastic process Law of large numbers |
| url | https://www.redalyc.org/articulo.oa?id=89925367007 |